It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
126
 
 
The original post: /r/datahoarder by /u/thinvanilla on 2025-07-03 18:42:17.

I set up my first NAS a year ago and bought 3x8TB WD Red Plus drives direct from WD, and they were £209 each (Before discounts). Now I'm looking at the page and they're £180 each, exact same model number.

Do hard drives normally drop in price like this? Is there a chance they go up in price? I'm almost out of storage so need to buy one, making me wonder if I should buy two in case this model gets discontinued or rise in price or something.

127
 
 
The original post: /r/datahoarder by /u/AlwaysFlanAhead on 2025-07-03 18:39:17.

I had bought one of those ssd+nvme hubs for my Mac Studio that just sits on top and matches the looks. It had 4tb in raid 1 for things like my photo library, sample instruments, llm models … basically anything bigger that I want quick access to without bogging down my internal drive.

But apparently the power/cooling on these things is generally pretty bad and it seems to have cooked the ssd. Everything’s backed up to the NAS so no issues there, and since only one drive failed raid 1 did its thing and my data is safe with no downtime.

My question is: is it worth getting a new (hopefully better) dual enclosure and rebuilding the raid 1, or should I just rawdog with a single drive and rely on my NAS as a backup?

Any quality nvme enclosures yall are using? Preferably with thunderbolt and SMART data pass through (some of my cheaper enclosures don’t report)

128
 
 
The original post: /r/datahoarder by /u/Key-Contact-648 on 2025-07-03 18:21:41.

Hello Everyone,

I’ve read on various posts here that many people want to download Erome videos on their devices. So, I created a lightweight, easy-to-use Erome video downloader.

I developed https://eromesaver.com/ to download Erome videos in HD or audio format. It is completely safe to use, responsive and lightweight. I am not loading any external scripts & I am not saving any videos on my servers, you're in safe hands.

There might be some other downloaders out there, but they're all full of ads, log in screens, popups & cookie consent screens.

Give it a try, and I hope you will love it!

129
 
 
The original post: /r/datahoarder by /u/heygravity9 on 2025-07-03 17:59:34.

Hello! I am an avid picture taker, I also go to lots of concerts which equal to a big amount of videos and photos. Currently I am using the Toshiba Canvio Basics 4TB Portable as my external data storage, which I love very much. But I'm scared to run out of space and have my files in multiple different corners. For that I rather have maybe even an external hard drive that sits on my desk, that I can constantly connect too when I seek those data.

This is why I turn to you guys for hopefully some insight, what's the best external hard drive over 4TB that I could get? Happy to even get something between 6-12TB :3 12 is probably way too much but yeah.

130
 
 
The original post: /r/datahoarder by /u/kt8t on 2025-07-03 07:53:31.

I’ve got a weird one. My old WD Green drive, with over 92,000 power-on hours (about 10.5 years), is still working perfectly. Zero reallocated sectors, zero pending sectors, zero uncorrectable errors. SMART data looks clean.

On the other hand, my 8TB Seagate IronWolf NAS drive, just over 3 years old, is starting to fall apart.

Here are the SMART numbers:

  • 4336 Retired Sectors
  • 120 Reported Uncorrectable Errors
  • Seek Error Rate: Raw 3.9 billion
  • ECC On-the-Fly Count: 75 million
  • Reported Uncorrectables (ID 187): Value 1, Raw 120
  • Power-On Hours: 24,230

This IronWolf has been running in a Synology NAS in a clean, temperature-controlled home environment. Same setup as the WD Green. It’s acting like it was built to fail right after the 3-year warranty.

Is this just a bad drive or is this a trend with Seagate IronWolfs? Curious if anyone else has seen failures line up this perfectly with the end of warranty.

131
 
 
The original post: /r/datahoarder by /u/BlinkingJarl482 on 2025-07-03 13:09:38.

Should I return it my requirements for the HDD were 10TB of Storage and 5 years waranty. The HDD will be put in my Desktop and will need to do a lot of random Reads and writes and as far as I understand the ST10000NM0126 has better random write speeds so should I keep it?

132
 
 
The original post: /r/datahoarder by /u/Fgrant_Gance_12 on 2025-07-03 12:43:40.

How do I convert 50000+ hospital form with some hand written portion in jpeg to an OCR PDF format which then needs to be extracted to excel in proper orientation as of the form (without using AI or cloud services for privacy protection reasons)?

133
 
 
The original post: /r/datahoarder by /u/SirBiggusBrainius on 2025-07-03 12:40:01.

I don't remember the original file system on the drive, it was a seagate 2tb HDD. I first backed up files from android and windows on it, and eventually moved files from my linux system with a ext4 file system. I only realised this an year later that the conflicting file systems might make the drive unaccessible in other OS. Have I messed this up beyond repair?

134
 
 
The original post: /r/datahoarder by /u/Green_Pride_8587 on 2025-07-03 10:20:06.

I’ve scanned a bunch of old letters, photos, and receipts as JPGs and want to preserve them in clean PDF format. Don’t want to use clunky offline software. I tested a few tools and found one browser-based converter that worked really well for batch jobs. Anyone here have a better workflow for this? Would love to streamline it further.

135
 
 
The original post: /r/datahoarder by /u/guaranteednotabot on 2025-07-03 07:49:23.

I am currently running a Synology NAS. What happens when I lose power while the NAS is writing to the disk? Is BTRFS robust enough to recover from power loss while in use?

I’m deciding whether to buy a UPS. Would prefer not to buy one. I will have backups so in the event of data loss, the only annoyance would be to restore from them. I will not be writing to the NAS often, and most of the time it will only be for scheduled maintenance (snapshots, clearing recycle bin, data scrubbing, etc.). I don’t mind losing the written file since most of the writes will be copying from SD cards or exporting from RAW files

Edit: I’m using SHR with 1 drive redundancy

136
 
 
The original post: /r/datahoarder by /u/QUAKE on 2025-07-03 06:06:56.

It seems USB enclosures are unreliable. I use a 3.5" hotswap bay similar to: https://www.amazon.com/ORICO-1106SS-Trayless-Internal-adapter/dp/B0093FINMU

But its impossible to find a modern case with 3.5" bay today and this thing sucks for 2.5" drives and im never sure a drive is actually connected because i can't see it.

How do I connect an hdd to my pc on the outside? is eSata still a thing?

What about somthing like this? https://www.cablesonline.com/1posal7da15p.html https://www.delock.com/produkt/90418/merkmale.html

Why are these only molex, not sata inside, nothing uses 3.3v?

And something like this for one cable?

https://www.amazon.com/DKARDU-22-pin-Extension-Optical-20-inch/dp/B0969BKPSD?xpid=nP2ulAaUNfQdu

or a different route?

long sata cable? https://www.amazon.com/dp/B0001Y7UAI

What about power?

sas to sata + LSI 9200-8e 6Gbps 8-lane external SAS ? https://www.amazon.com/CableCreation-SFF-8088-Female-Controller-Backplane/dp/B013G4EX9K/

https://www.ebay.com/itm/163534822734?epid=28034148027hash%3Ditem26136f5d4e%3Ag%3A5sEAAOSwdwlcX2E3

Please advise

137
 
 
The original post: /r/datahoarder by /u/Broad_Sheepherder593 on 2025-07-03 05:14:33.

Hi,

I work in a corporate environment with the usual implemented security controls on our laptops - 2fa, sso, disabled admin account and usb. etc.

By habit, i usually take a backup of my work files to my personal account but IT informed us they monitor all the emails we send and check if we send to our personal accounts.

I discovered that our network does not restrict access to synology quick connect via the browser. If i do backup there manually via upload, any chance IT can see the files i upload?

138
 
 
The original post: /r/datahoarder by /u/friendlylobotomist on 2025-07-02 22:15:52.

I can understand why you might hoard some adult video over threat of censorship removing it from the internet, but how much do you really need? The one guy who just posted said he had over 200TB of it. That's like multiple years of adult video. Even 1000 hours sounds insane to me. How could you justify needing that much for yourself or for others?

This kind of content doesn't have much artistic or historical value and negatively affects the minds of many. I'm not trying to sound like some worried Christian mother but I really just don't understand, I would love to hear why you think that saving this content is important.

139
 
 
The original post: /r/datahoarder by /u/RegularVast1045 on 2025-07-02 21:36:14.

I tried Yt dlp and maybe Jdownloader 4kdownloader only aloud 10 videos for a trial. I’m not sure I can code from GitHub using python to download YouTube playlist.

140
 
 
The original post: /r/datahoarder by /u/Vipre7 on 2025-07-03 05:01:58.

I was going to just buy a new USB 3.2 Gen 2 flash drive, but to be more reliable, I was thinking an external SSD if they are more reliable? 64GB is plenty but I know the newer drives have a higher minimum capacity.

Curious the best bang for buck. Is 3.2 Gen 2 worth it? Speed is good but not necessary.

141
 
 
The original post: /r/datahoarder by /u/metahades1889_ on 2025-07-03 03:59:03.
142
143
 
 
The original post: /r/datahoarder by /u/TheRealHarrypm on 2025-07-03 01:52:03.
144
 
 
The original post: /r/datahoarder by /u/jasper-zanjani on 2025-07-03 01:40:44.

I recently found this reddit and I thought I'd ask if anyone else has scratched the itch to archive and locally host social media? I'm a heavy user of the Save feature on Instagram and I find it really doesn't do the trick. I have like a dozen or more categories for various countries (especially the Caribbean) or different meme genres (people dancing, people getting hurt, people gagging). Sometimes I find myself wanting to find an old meme or funny video and I can never find it.

I've tried to use instaloader but Instagram definitely does not like it. Saving individual posts isn't that big a deal, I don't need to have absolutely everything.

On the self-hosting side I think some of the image hosting options like immich kinda sorta work. I would definitely have to develop a good tag system.

Has anyone already solved this problem?

145
 
 
The original post: /r/datahoarder by /u/foetus66 on 2025-07-03 00:00:41.

Hi, I recently installed MariaDB on a Buffalo NAS (LS-720D) so instances of Kodi on different devices can share the same library db. It took a fair amount of fiddling, but I got it working with Kodi

It occurred to me later that because of the way I installed and configured MariaDB, the database itself is being stored in the Buffalo OS boot disk (which I think is probably some kind of flash storage, but don't really know so pls correct me if wrong!) and not on the NAS disks/RAID array. For some reason that seemed like a bad idea so I got a mount created on the array to be MariaDB's new default location for databases, and was just about to reconfigure it to point to the new path instead... and only then did it occur to me that maybe leaving it on the OS disk is not a bad idea. It appears to have a capactity of 4gb and with the database fully populated, the disk still has 70% free space due to the lightweight Linux OS

My thoughts are that I wonder if the OS disk was not designed to be accessed a lot since the Buffalo firmware seems simple enough to mostly boot and reside in memory. So should I worry about a mysql database being out of spec for the onboard storage? If it wears out the OS disk in a couple years, the device is bricked. But on the other hand maybe that's crazy talk/not even a thing, and since the HDD array isn't all that fast, maybe the flash storage is actually better for a database..? Thought y'all might have some opinions on this

146
 
 
The original post: /r/datahoarder by /u/Big-Tune9944 on 2025-07-02 22:33:10.

I have a lot of photos of me and my family from different places around the world, and I want to organize them. I was thinking of using Pinterest, but my wife suggested not to. Are there any good websites or computer apps specifically made for organizing photos?

147
 
 
The original post: /r/datahoarder by /u/abudab1 on 2025-07-02 22:26:45.

Download ffmpeg by typing in Powershell:

choco install ffmpeg-full

then create .bat file which contains:

@echo off
setlocal enabledelayedexpansion

REM Input and output folders
set "input=E:\Videos to encode"
set "output=C:\Output videos"

REM Create output root if it doesn't exist
if not exist "%output%" mkdir "%output%"

REM Loop through all .mp4, .mkv, .avi files recursively
for /r "%input%" %%f in (*.mp4 *.mkv *.avi) do (
    REM Get relative path
    set "relpath=%%~pf"
    set "relpath=!relpath:%input%=!"

    REM Create output directory
    set "outdir=%output%!relpath!"
    if not exist "!outdir!" mkdir "!outdir!"

    REM Output file path
    set "outfile=!outdir!%%~nf.mp4"

    REM Run ffmpeg encode
    echo Encoding: "%%f" to "!outfile!"
    ffmpeg -i "%%f" ^
    -c:v av1_nvenc ^
    -preset p7 -tune hq ^
    -cq 40 ^
    -temporal-aq 1 ^
-rgb_mode yuv420 ^
    -rc-lookahead 32 ^
    -c:a libopus -b:a 64k -ac 2 ^
    "!outfile!" -y
)

set "input=E:\Videos to encode"

set "output=C:\Output videos"

it will convert all videos (*.mp4 *.mkv *.avi) in this folder and subfolders to E:\Videos to encode

using Nvidia videcard(you need latest nvidia driver)

drastically lowers file size

148
 
 
The original post: /r/datahoarder by /u/Emergency-Ice-754 on 2025-07-02 20:16:49.

Looking to replace my current "main" external media drive, which is a WD MyBook. I've had a couple Seagate external drives fail on me but this was probably over a decade ago. I've also had WD fail on me but overall, I seem to have a better impression of them. I want to get the largest external drive within a reasonable price. Largest MyBook is a 26TB. Largest Seagate is a 28TB and it's significantly cheaper than the WD.

  1. How in the Seagate so much cheaper per TB than the WD? Are news on WD releasing larger MyBooks and making their price more competitive?
  2. How reliable are Seagate drives these days?
149
 
 
The original post: /r/datahoarder by /u/PussyMangler421 on 2025-07-02 19:00:51.

My porn collection was just absurdly large, 220TB.

I decided to finally setup Tdarr and throw in a bunch of cheap intel arc GPU's to encode to AV1. I was nervous because i'd heard it's a pain to setup but for my scenario it was ridiculously easy, no complex flows, just encode and replace. It is very good at handling failed encodes.

It took a good year of 24/7 encoding but I went from 220TB to only 88TB. I was literally able to build a backup array with the space I saved and then have drives left over. I'll never notice the quality difference, I wasn't even able to in the few test files I compared at the beginning.

150
 
 
The original post: /r/datahoarder by /u/Haunting_Meal_3157 on 2025-07-02 06:22:38.

I have around 12k files downloaded with yt-dlp that need renaming because I missed out on adding the upload date in the filename. I have the .json file together with the downloaded video file. Here's an example of what I want to accomplish

Filename Example Old: "Funniest 5 Second Video Ever! [YKsQJVzr3a8].mkv" Desired New Filename: "2010-01-16 Funniest 5 Second Video Ever! [YKsQJVzr3a8].mkv"

Additional Files available: "Funniest 5 Second Video Ever! [YKsQJVzr3a8].info.json" containing all necessary metadata like display_id, upload_date, fulltitle.

I've read that this can be accomplished with scripts, but please consider that I have no knowledge in coding or how to use stuff like bash, jq which I read about, so I can't write it myself. What do I need to do to accomplish this renaming process.

view more: ‹ prev next ›