It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
1676
 
 
The original post: /r/datahoarder by /u/Unfair_Ad_9046 on 2025-04-26 19:07:27.

I need to acquire two used windows drives or devices that have not been wiped for my capstone project. Does anyone have any suggestions on what to search?? Most of the listings I’ve seen on eBay/mercari have been wiped. My degree is in digital forensics so I’ll just be analyzing the contents.

1677
 
 
The original post: /r/datahoarder by /u/Juaguel on 2025-04-26 12:41:26.

Run the code to automatically download all the images from a list of URL-links in a ".txt" file. Works for google books previews. It is a Windows 10 batch script, so save as ".bat".

@echo off
setlocal enabledelayedexpansion

rem Specify the path to the Notepad file containing URLs
set inputFile=
rem Specify the output directory for the downloaded image files
set outputDir=

rem Create the output directory if it doesn't exist
if not exist "%outputDir%" mkdir "%outputDir%"

rem Initialize cookies and counter
curl -c cookies.txt -H "User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3" "https://books.google.ca/" >nul 2>&1
set count=1

rem Read URLs from the input file line by line
for /f "usebackq delims=" %%A in ("%inputFile%") do (
    set url=%%A
    echo Downloading !url!
    curl -b cookies.txt -o "%outputDir%\image!count!.png" -H "User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/58.0.3029.110 Safari/537.3" "!url!" >nul 2>&1 || echo Failed to download !url!
    set /a count+=1
    timeout /t %random:~-1% >nul
)

echo Downloads complete!
pause

You must specify the input file of the URL-list, and specify the output folder for the downloaded images. Can use "copy as path".

URL-link list ".txt" file must contain only links, nothing else. Press "enter" to separate URL-links. To cancel the operation/process, press "Ctrl+C".

If somehow it doesn't work, you can always give it to an AI like ChatGPT to fix it up.

1678
 
 
The original post: /r/datahoarder by /u/forwardslashroot on 2025-04-26 10:46:34.

I think I need to redo my Debian NAS. I have a Chenbro RM42300 chassis with two 5-bay enclosures. I also got a two of the 2-bay 2.5" drive. In the middle front of the chassis has 4-bay for HDD. My power supply is a Corsair HX850.

Currently, I am powering each 5-bays with two SATA power and the 4x HDD in the middle with this 4-in-1 cable. There were random times in the past that one of the HDD would disconnect from the system. When I ran the command lsblk -f, the disk is not there. I am not sure if it is a power issue or SATA cable issue. This probably happened 5 times in 6 years. The only way for me to bring the disk back was to reboot the NAS.

Recently, half of my disks were missing from lsblk -f. I powered down the NAS, and it has been offline since then. I am using an HBA with a SAS expander. I am trying to get an idea what could be causing the HDD to disconnect itself.

I don't know if this is a power issue or the SATA cable that I am using going loose, but this is the SATA cable that I have. The SATA cables don't have locks is my suspect at the moment. The last time I checked the SMART for each disk, it seemed to be in good health.

1679
 
 
The original post: /r/datahoarder by /u/Ill-Candidate8760 on 2025-04-26 18:32:59.

Is it possible to dupe the data on this site before it inevitably gets taken down? Asking for a friend 😈

1680
 
 
The original post: /r/datahoarder by /u/IngwiePhoenix on 2025-04-26 17:58:29.

TL;DR: I want to get into backing up certain repos. So far, I tried to use a cronjob, but it's not really working too well - especially with multiple branches...

What do you use or do you know a tool that does that?

Thanks!

1681
 
 
The original post: /r/datahoarder by /u/Plane_Passion on 2025-04-26 17:43:36.

Hello there! My first post here :)

My family has thousands of images generated on their phones each month (mostly due to the use of Whatsapp, a must in certain countries without free SMS). Problem is, together with real photos they want to keep, there is a LOT of memes, old folk's "good morning" images, quotes images, slop political ones, and the eventual nude/porn...

Most of the family doesn't have the means (or the will) to manually sort through all their files and select those they actually want to backup in our home server, which means (i) they just don't backup anything and keep a huge amount of things on their phones until it's full or lost; or (ii) they backup EVERYTHING they have, which is not only inefficient and expensive (more storage needs for the server), but makes our photo watching family sessions quite interesting, full of unnintended memes and eventual nudes popping up on the screen, not to mention the infinite duplicates.

All jokes apart: is there any easy tool (app) you know that they could install on their phones that does most of the work for me, preselecting actual photos on the whatsapp img folder (or any folder for that matter), and batch-sorting actual photos from all the junk, memes, stickers, etc? Maybe an AI agent that a dummy could use, at least to reduce the amount of trash?

If not, then maybe a PC solution, so I can do it myself for them before the backup? I'm open to both paid and free solutions, although, of course, free and opensource options are preferred.

Yes, I could sort the database for file type, then file size, then maybe some metadata (about which I'm not really too familiar), but it's really hard to do that every month, for many phones, on different homes, all by myself...

Thank you VERY, VERY much for your help. Any input, explanation or shared knowledge (even if to say that there is no easy solution) would be of great assistance for this datahoarder noob :)

1682
 
 
The original post: /r/datahoarder by /u/Soybeanns on 2025-04-26 17:35:29.

I have a friend who’s giving me a t330 and want to set that up as a NAS. I currently run a mini pc and two external drives. I would like to still use my mini pc to maintain the t330. Is that possible?(not sure what I am asking is making sense)

I only use my current server as a jellyfin so nothing crazy. My current mini pc runs Ubuntu 24.04 so I would like to keep using that or some kind of Linux. Sorry if this sounds confusing I am still very new to all this.

1683
 
 
The original post: /r/datahoarder by /u/Chicken_Witch on 2025-04-26 17:15:36.
1684
 
 
The original post: /r/datahoarder by /u/kingkamikaze69 on 2025-04-26 16:18:36.

Hello, for my final project in a machine learning course I am to build a predictive model focusing on the US and China tariffs.

My idea is to train the model based on historical tariff data, cost of goods, wealth inequality, maybe homelessness, economy/job market, but i havent found anything. I don’t know how to scrape data either.

If any of you heroes had anything you thought could help and wanted to share it, I would be very appreciative.

Sorry if this is against the rules but I am 100% just looking for data and thought who has more data than r/datahoarder. Thank you

1685
 
 
The original post: /r/datahoarder by /u/Artistic_Pear1834 on 2025-04-26 16:18:19.

Purchased this to backup 2x 2TB Samsung shields (both about 1.4TB on each). Amazon purchase. Started playing up after day 2. I am a cautious cat, so I stopped using it & finished backing up those 2x 2tb on another WD4tb (instead of the Samsung shield) out of an abundance of caution….

Lo & behold, went back to the Samsung T7 4TB Shield today to complete my original backup plan and it’s failed.

Disk repair won’t work, Exit Code 8. Now a warning from my mac “Back up the disk and reformat it as soon as you can”.

Should I bother reformatting it, or just send it back & get another one? Is the T7 Shield 4TB known for having issues?

1686
 
 
The original post: /r/datahoarder by /u/hausdorffparty on 2025-04-26 16:14:32.
1687
 
 
The original post: /r/datahoarder by /u/MisakaMisakaS100 on 2025-04-26 15:57:24.

I have a lot of shows and movies saved on my hard drives. I'm worried about bit rot and hard drive failure, so I'm planning to create a duplicate of each drive. Is this enough to keep my data safe? I'd love to hear how you guys manage your large collections and any tips or tricks you might have. Also, I'm on a budget, so affordable suggestions would be appreciated!

1688
 
 
The original post: /r/datahoarder by /u/manzurfahim on 2025-04-26 15:31:12.

My first data loss incident: back in 2014.

My last data loss incident: January 2025. Got to know about it in April 2025.

I normally keep a backup my mobile contents (Photos, videos, call recordings etc.) in my PC. I admit, I do not do it regularly, but maybe about once in every two months or so. My mobile backup dates back to 2014. Every time I do a backup, I copy it over to the existing backup, so it gets added to the files that are already there. I do not keep everything on my phone because of storage space issue (Phone only has 512GB).

Back in last January, I was backing up everything because I want to upgrade the RAID5 array to a RAID6, with more drives. I thought I might as well do a new backup of my mobile. I was doing a lot of things together, moving data out of the RAID5 to different drives (I am always running short of drives lol), and I made a mistake. Instead of adding the new backup, I just backed it up on a different drive, forgot to move the old backup completely.

Everything went fine, RAID6 is up and running, I moved all the data back in RAID6 successfully. About two weeks ago, I suddenly realized that I didn't merge the mobile backup. AND IT HIT ME. I've lost all mobile contents that I had backed up except what I have in my mobile. And because I did not have enough spare drives, and the 3 x 20TB that I ordered was a month late, I had to use the Backup versioning drive for moving a good amount of data out of the RAID5. So I have no way of getting it back. RAID5 is gone, same drives and a few more drives were configured in RAID6, fully initialized and then all the data were brought back in, so running recovery won't help.

I ran recovery on the USB SSD that I use to back up my mobile, but I only just started using it for about six months, and it wouldn't have the old files. Most important things on the old mobile backup were the photos and the call recordings, conversations of some family members and others who are not here anymore. I still ran recovery, but nothing was there, in fact not even new files that were on the SSD a month ago. I guess trimming / garbage collection did its job properly. I ran recovery on every other single drive I used for backing up RAID5 data, none had anything in them.

I gave up. I was depressed, sad. It went into background, but it was a horrible feeling.

And then, after a few days I suddenly remembered that I used to use a SanDisk MicroSD for mobile backup back when Samsung mobiles used to have a MicroSD slot. I went through a pile of stuff in my drawer and managed to find it. It was a 400GB SanDisk Extreme PRO MicroSD.

I downloaded the SanDisk Rescue PRO Deluxe and used the license key that I wrote down in Evernote. Activated it and ran a recovery. The card was last used back in 2021, when I upgraded to S21 ultra as soon as it came out. 4 years without being used or without power, I had no hope.

Guess what? After a two hour of running recovery, the software found some 52,000 files with all the images, call recordings, videos etc. and almost all of them are working, except they don't have their original filenames and all metadata is gone. But the files are working. I am going through a duplicate search (byte searching) and sort them as I go. It is going to take a long time, but at least I have the files.

TL, DR: ALWAYS HAVE A BACKUP VERSIONING COPY, YOU NEVER KNOW WHEN YOU ARE GOING TO NEED AN OLD BACKUP.

1689
 
 
The original post: /r/datahoarder by /u/lynivvinyl on 2025-04-26 14:12:26.
1690
 
 
The original post: /r/datahoarder by /u/nail_nail on 2025-04-26 13:50:59.

So, I am trying to figure out if I can get a mini itx board that can directly attach to a SAS 12G backplane (sff 8643) without having to add a pcie HBA. Disks will be SATA

I see that there are quite a few board (say, ASUS P12R-I) which say you can get 4 SATA with a mini SAS HD connector. But those won't work with a backplane right? Same for an oculink to 4 sata adapter, right?

My understanding is that these connectors are universal and you can run many protocols over those. When you do oculink to 4sata then you need a specialized cable, but the motherboard knows how to use each lane independently as a sata one, but an HBA uses it differently.

I think something like an H12ssl-NT would work but it is not itx :)

Is there a solution?

1691
 
 
The original post: /r/datahoarder by /u/SnooBunnies9252 on 2025-04-26 11:57:25.

https://preview.redd.it/mf0dyguh46xe1.png?width=1600&format=png&auto=webp&s=a7d305ed0501f819d4b00a6d6556d6a278b82021

Hi all! I want to see if my WD Elements HDDs are good before shucking them into a NAS. How else can I test that? I'm looking for easy to use GUI that might have tutorials since I don't want to break anything.

1692
 
 
The original post: /r/datahoarder by /u/churnopol on 2025-04-26 10:29:14.

UDO and UDO2 drives. I really wanted so bad. This was supposed to be 9.1gb magneto optical's replacement. Looks like giant minidiscs. 30-60gb discs. I waited for a SATA version to come out. Even at the time SCSI was on the way out, and this drive got released; SCSI only. A slow USB2.0 version was released but it's extremely rare and was reported to be too slow. And this is where UDO kinda froze in time. The drives never got an update; never a SATA or firewire version. They announced the 80gb discs but were never released. But the 30/60gb discs were made well past UDO's decline.

Man, I would love to back up my TV show DVD collection onto those chonky UDO discs.

1693
 
 
The original post: /r/datahoarder by /u/manzurfahim on 2025-04-26 09:42:05.

I did a recovery, and while almost 99% of the file works, their names have changed. Now I need to compare it with a recent backup and delete the duplicates so I can get the old backup files back.

Is there any duplicate finder that will find files with same sizes? I sort both the backup folder and recovered folder in windows by size, and I can see same files with same file sizes on both, except the names have changed. 52,086 files is a lot to go through one by one manually, so I need a duplicate finder.

Thank you very much in advance!

1694
 
 
The original post: /r/datahoarder by /u/Beautiful_Acadia_381 on 2025-04-26 09:27:11.

i want to download this stream https://parti.com/video/74545

im on my ipad rn but can use windows laptop if its required to download stream

1695
 
 
The original post: /r/datahoarder by /u/red__flag_ on 2025-04-26 09:22:32.

Hey, i have a problem. I have a br burner from verbatim and use ashampoo. I can burn the 25 gb mdisc (old version), but the new version, which supports faster writing speeds, no longer does. Firmware etc. is up to date. On the new discs it even says on the packaging that it works with any BR burner that supports 4x. Wtf. Do you have any ideas?

1696
 
 
The original post: /r/datahoarder by /u/spaniardsensei on 2025-04-26 09:11:30.

Hello, Hoarders! I wanted to get some feedback on the change I'm planning for my storage system and see if anyone has a better idea or any useful suggestions.

I'm still using my DS415play with 4x 8TB drives, but I've never been completely happy with the setup since the multimedia section isn't secured, and my data is only mirrored. Basically, two of the drives hold multimedia files without any backup, while the other two are mirrored for redundancy. The multimedia section hasn't worried me much since I could rebuild almost everything, but now that storage space is starting to run out, I want to improve security overall and reorganize my system.

The idea I have in mind, without it being excessively expensive, is the following:

  • Keep the DS415play with the drives but convert it into RAID 5 or SHR, so I gain an extra 8TB drive for multimedia with added redundancy.
  • For backups and general data storage, since I don't need much power and it's mainly for backup purposes, I'm considering buying a Synology 4-bay NAS (I can get a DS413J for around €150 or a bit less if I wait for an offer) and filling it with refurbished 4TB or 6TB drives, setting it up in RAID 6 or SHR-2 for extra security.
  • While I'm at it, I'm also thinking of setting up an S3 Glacier Deep Archive for offsite backups. It's going to be like 1-2€ per month with the amount of data I want to store.

I'm leaning toward Synology because I'm already familiar with the system. At some point, I considered building a separate setup with unRAID, but given my simple usage, it never really convinced me.

That's the plan, any criticism or suggestions?

1697
 
 
The original post: /r/datahoarder by /u/zgrad2 on 2025-04-26 08:30:41.

I've been using 990s for my DAS, but I just bought myself a TerraMaster NAS and was just wondering if I should keep using 990s or if I can buy slower and cheaper m.2s?

1698
 
 
The original post: /r/datahoarder by /u/linsane24 on 2025-04-26 07:03:15.

Have a client that I need to setup with a 400tb nas. Was going to synology DS3622xs+ and expansion bay for a total of 400tb of storage across 2 pools on raid 6 . I was planning on using western digital red pro 20tb drives….but now hearing about their drive lock announcement throws a complete wrench into my situation.

What are other good alternative that are space and noise conscience ? User has limited space and these drives will be sitting in an office so can’t be super loud. So anything 45 drives is out of the question.

Anyone got any recommendations? Thanks!

1699
 
 
The original post: /r/datahoarder by /u/minorminer on 2025-04-26 06:58:27.

My knitting partner used to follow a blog called untangling knots where a prolific knitter hosted patterns they developed for sale. The owner closed up shop and they're no longer available.

Has anybody saved some these by any chance? If not that blog, are there any good archives for knitting patterns?

1700
 
 
The original post: /r/datahoarder by /u/Responsible_Help_277 on 2025-04-26 06:17:01.

Has anyone ever had a WD elements drive shucked and not show up anymore? Wont initialize but i could here it spinning up. Used kapton tape on the 3 pins it didnt work but didnt have problems with the others. Then it didnt even work back in the enclosure

view more: ‹ prev next ›