It's A Digital Disease!

The original post: /r/datahoarder by /u/metahades1889_ on 2025-07-03 03:59:03.

The original post: /r/datahoarder by /u/MudAffectionate361 on 2025-07-03 03:00:11.

Had issues opening some of my video files - my multimedia app threw an input/output error, assumed it may just be bad Rclone caching, tilL I got home, and dug deeper - The Affected files were giving me this error.

I just hope this isn't permanent. This represents over a years worth of work......

The original post: /r/datahoarder by /u/TheRealHarrypm on 2025-07-03 01:52:03.

The original post: /r/datahoarder by /u/jasper-zanjani on 2025-07-03 01:40:44.

I recently found this reddit and I thought I'd ask if anyone else has scratched the itch to archive and locally host social media? I'm a heavy user of the Save feature on Instagram and I find it really doesn't do the trick. I have like a dozen or more categories for various countries (especially the Caribbean) or different meme genres (people dancing, people getting hurt, people gagging). Sometimes I find myself wanting to find an old meme or funny video and I can never find it.

I've tried to use instaloader but Instagram definitely does not like it. Saving individual posts isn't that big a deal, I don't need to have absolutely everything.

On the self-hosting side I think some of the image hosting options like immich kinda sorta work. I would definitely have to develop a good tag system.

Has anyone already solved this problem?

The original post: /r/datahoarder by /u/foetus66 on 2025-07-03 00:00:41.

Hi, I recently installed MariaDB on a Buffalo NAS (LS-720D) so instances of Kodi on different devices can share the same library db. It took a fair amount of fiddling, but I got it working with Kodi

It occurred to me later that because of the way I installed and configured MariaDB, the database itself is being stored in the Buffalo OS boot disk (which I think is probably some kind of flash storage, but don't really know so pls correct me if wrong!) and not on the NAS disks/RAID array. For some reason that seemed like a bad idea so I got a mount created on the array to be MariaDB's new default location for databases, and was just about to reconfigure it to point to the new path instead... and only then did it occur to me that maybe leaving it on the OS disk is not a bad idea. It appears to have a capactity of 4gb and with the database fully populated, the disk still has 70% free space due to the lightweight Linux OS

My thoughts are that I wonder if the OS disk was not designed to be accessed a lot since the Buffalo firmware seems simple enough to mostly boot and reside in memory. So should I worry about a mysql database being out of spec for the onboard storage? If it wears out the OS disk in a couple years, the device is bricked. But on the other hand maybe that's crazy talk/not even a thing, and since the HDD array isn't all that fast, maybe the flash storage is actually better for a database..? Thought y'all might have some opinions on this

The original post: /r/datahoarder by /u/Big-Tune9944 on 2025-07-02 22:33:10.

I have a lot of photos of me and my family from different places around the world, and I want to organize them. I was thinking of using Pinterest, but my wife suggested not to. Are there any good websites or computer apps specifically made for organizing photos?

The original post: /r/datahoarder by /u/abudab1 on 2025-07-02 22:26:45.

Download ffmpeg by typing in Powershell:

choco install ffmpeg-full

then create .bat file which contains:

@echo off
setlocal enabledelayedexpansion

REM Input and output folders
set "input=E:\Videos to encode"
set "output=C:\Output videos"

REM Create output root if it doesn't exist
if not exist "%output%" mkdir "%output%"

REM Loop through all .mp4, .mkv, .avi files recursively
for /r "%input%" %%f in (*.mp4 *.mkv *.avi) do (
    REM Get relative path
    set "relpath=%%~pf"
    set "relpath=!relpath:%input%=!"

    REM Create output directory
    set "outdir=%output%!relpath!"
    if not exist "!outdir!" mkdir "!outdir!"

    REM Output file path
    set "outfile=!outdir!%%~nf.mp4"

    REM Run ffmpeg encode
    echo Encoding: "%%f" to "!outfile!"
    ffmpeg -i "%%f" ^
    -c:v av1_nvenc ^
    -preset p7 -tune hq ^
    -cq 40 ^
    -temporal-aq 1 ^
-rgb_mode yuv420 ^
    -rc-lookahead 32 ^
    -c:a libopus -b:a 64k -ac 2 ^
    "!outfile!" -y
)

set "input=E:\Videos to encode"

set "output=C:\Output videos"

it will convert all videos (*.mp4 *.mkv *.avi) in this folder and subfolders to E:\Videos to encode

using Nvidia videcard(you need latest nvidia driver)

drastically lowers file size

The original post: /r/datahoarder by /u/Emergency-Ice-754 on 2025-07-02 20:16:49.

Looking to replace my current "main" external media drive, which is a WD MyBook. I've had a couple Seagate external drives fail on me but this was probably over a decade ago. I've also had WD fail on me but overall, I seem to have a better impression of them. I want to get the largest external drive within a reasonable price. Largest MyBook is a 26TB. Largest Seagate is a 28TB and it's significantly cheaper than the WD.

1. How in the Seagate so much cheaper per TB than the WD? Are news on WD releasing larger MyBooks and making their price more competitive?
2. How reliable are Seagate drives these days?

The original post: /r/datahoarder by /u/PussyMangler421 on 2025-07-02 19:00:51.

My porn collection was just absurdly large, 220TB.

I decided to finally setup Tdarr and throw in a bunch of cheap intel arc GPU's to encode to AV1. I was nervous because i'd heard it's a pain to setup but for my scenario it was ridiculously easy, no complex flows, just encode and replace. It is very good at handling failed encodes.

It took a good year of 24/7 encoding but I went from 220TB to only 88TB. I was literally able to build a backup array with the space I saved and then have drives left over. I'll never notice the quality difference, I wasn't even able to in the few test files I compared at the beginning.

The original post: /r/datahoarder by /u/Haunting_Meal_3157 on 2025-07-02 06:22:38.

I have around 12k files downloaded with yt-dlp that need renaming because I missed out on adding the upload date in the filename. I have the .json file together with the downloaded video file. Here's an example of what I want to accomplish

Filename Example Old: "Funniest 5 Second Video Ever! [YKsQJVzr3a8].mkv" Desired New Filename: "2010-01-16 Funniest 5 Second Video Ever! [YKsQJVzr3a8].mkv"

Additional Files available: "Funniest 5 Second Video Ever! [YKsQJVzr3a8].info.json" containing all necessary metadata like display_id, upload_date, fulltitle.

I've read that this can be accomplished with scripts, but please consider that I have no knowledge in coding or how to use stuff like bash, jq which I read about, so I can't write it myself. What do I need to do to accomplish this renaming process.

The original post: /r/datahoarder by /u/ffhhkk on 2025-07-02 18:25:02.

Hey guys. Not gonna bore u with my sob story, but need some help sourcing hard disks for cheaper than usual due to employment issues causing budgetary constraints.

Id appreciate any tips, sources for 14TB or greater Satas that I can purchase. I have some friends in the States that will be travelling back so I'll save on international shipping.

Thank u!

Also, if someone can help with the definitions of recertified, refurbished and re-anything terms, it wud be helpful.

My current setup. DS1819 + EXPANSION. DS 2419+ expansion( the expansion machine for the 2419 doesn't have any drives so I'm looking to populate it now since I'm running out of space.)

The original post: /r/datahoarder by /u/alin_im on 2025-07-02 18:24:47.

Hi all,

Please help me decide which would be the best option for a new NAS?

I preordered the N5 Pro and now I need to fill it. My budget is 1000EUR for 5x 8TB drives.

I have experience with a pair of Ironwolf 6TB in Raid 1 on a synology DS719+. No problems with them for the past 5 years. Shall I consider the other options?

Seagate Exos 7E10 -8TB - ST8000NM017B (170EUR)

Seagate IronWolf PRO 8TB - ST8000NT001 (200EUR)

Seagate IronWolf 8TB - ST8000VN004 (180EUR)

TBH on paper the 7E10 looks like a no brainer the cheapest and enterprise grade... sounds too good to be true, why is that?

Also Raidz1 or Raidz2 with 5 drives? I want to be able to use the NAS as a server aswell and I will have 1TB NVMe for cache and I will use the Synology as a backup for important files. Just to give you a little bit of context when considering RW speeds and fault tolerance. I am tempted with Raidz1, but AI insists on Raidz2...

Please share your wisdom!

The original post: /r/datahoarder by /u/zwelly23 on 2025-07-02 17:39:16.

I can get either 4x500gb or 2x2tb drives to put into a home server for nas purposes, which option would be better? Mainly to store photos and videos and docs

The original post: /r/datahoarder by /u/pmttyji on 2025-07-02 16:46:39.

Time to time, I'm checking here & other subreddits for this one for sometime. I don't see any recent threads. Looks like so far none have this. So today posting this thread for this.

Even if there's any complete archive, I would like to have some tropes of archive(Writing, Literature, Poetry, Film, Art, Comics, ) for my research. Here few questions.

1. What software is best & possible to download tvtropes site(even partial contents[mentioned tropes above] is fine for now)? In past, I used to download tiny sites using HTtrack, but it's not working good on sites like tvtropes(both download & archive wise). So please share resources & best practices on this.
2. Plan B : What're alternative sites to tvtropes? So I would search offline archives of those sites or will try to download those sites if no offline archives.

I'm not looking only for latest up-to-date offline archives .... even old archives also fine.

For now, fortunately I use kiwix offline wiki archives for research. But tropes could help me more better.

Thanks.

The original post: /r/datahoarder by /u/NekoTrix on 2025-07-02 16:38:24.

The original post: /r/datahoarder by /u/VviFMCgY on 2025-07-02 16:02:02.

The original post: /r/datahoarder by /u/d2racing911 on 2025-07-02 15:19:05.

Hi everyone, I'm currently creating a 321 backup workflow for my NAS and I'm using this workflow :

1. I run a couple of jobs with SyncBack Free to sync 2-3 shared folders to my external drive(drive #1).
2. That external drive is then sync to an another external drive (drive #2).
3. I use Backblaze to backup that second drive (drive #2) to have my offsite Backup.

I saw that there's a Goodsync package for my DS923+.

Is there any avantages to install Goodsync directly to my Synology ?

Anyone is using their GoodSync connect feature too ?

I'm trying to determine if I should buy GoodSync or Syncback Pro to sync my stuff or if I should stick with the Free version of Syncback ?

Thanks for your comments :P

The original post: /r/datahoarder by /u/redditmail9999 on 2025-07-02 14:25:52.

SPD has 14TB exos new listed for $189.99. it's labelled as "HP/Seagate Exos X18" with 3 yrs seller warranty.

i'm assuming these are OEM of the exos -- ergo not the usual 5 yrs seagate warranties?

The original post: /r/datahoarder by /u/mtlynch on 2025-07-02 14:13:12.

The original post: /r/datahoarder by /u/pleiad_m45 on 2025-07-02 13:19:39.

Hi fellow DataHoarders.

maybe I'm just in a bad mood but seeing some videos about geopolitics and the increasing possibility of SOME kind of conflict, .. I began thinking about a solution to backup & store all my data at a different geolocation (I'm in Europe) so in case I need to move to another country, flee of a 'smaller' war .. whatever.. I have all my precious family photos and videos and music etc. at a location where it's (most probably in that very moment and afterwards for a while) SAFE.

A lot of considerations popped up in my mind, some of them I tried to answer by myself.

Feel free to add some options I might forgot but are useful to consider.

1. shall it be instantly accessible or can I wait couple of minutes / hours for the files to be ready and downloadable ?

• Waiting is ok but I really need 'pool as files' to be stored in the cloud then, so zfs send into huuuge file(s) will be the first step..

2. what kind of remote storage is ideal ? Cloud, e.g. Amazon S3 Glacier Deep Archive kind of stuff (with still A LOT of extra egress costs when I need to download my data) or dedicated hosting with a low-spec'd server with 4 identical HDD-s like mine here at home or what else ?

a. - cloud not sure due to high egress costs when I need to get everything back

b. - distributed storage maybe across several providers ? (Gluster is dead although it seemed a great project some years ago)

c. - buying co-location/dedicated servers with empty HDD-s and create everything for myself there ?

(e.g. shinjiru or similar) Then zfs-send the whole pool via a wireguard-established VPN maybe. But tbh I can't find a place where I could tell the hosting company "please buy me a consumer grade low-fi server and stuff it with 4x SATA Exos drives".. there are only packages predefined :/ 3. Pool as files. Most options accept files so my existing pools need to be exported into files maybe.

• Can zfs send's output be automatically split into several pieces with some kind of logical file numbering or do I need to use some kind of piping with mbuffer or similar ?

4. Encryption

• Do I need encryption ? Yes, for sure.. data would be LUKS- or Veracrypt-encrypted either at the receiving side or even here at home prepared, before copying.

There's the low-fi solution (creating backup pool onto 4 HDD-s, ZFS snapshot/send into it, place it at a friend far away and sleep well) or the mid-fi (colocation / dedicated server) or even the hi-fi solution (bunch of unlimited-egress VPS instances at different providers and locations, each with their own ZFS mirrors, with a distributed filesystem on top of that or something similarly crazy overengineered solution).

Any other ideas ? :)

Cost is a factor of course, I'm just a random mortal IT guy, the cheaper the better as long as I can retrieve my pool(s) within 1 day or even instantly.

Amount of data would be let's say 38TB.

The original post: /r/datahoarder by /u/ElGatoBavaria on 2025-07-02 12:47:13.

I am surprised why the Windows File Explorer does not have the option of creating favorites, as is possible in various browsers, for example. In addition to Windows File Explorer, I use Total-Commander, in which you can create a tree structure of favorites. Next to programs like "Everything Search" i still like to have some kind of structure - at least for the favourite paths.

I would be interested to know how you handle this? I am explicitly interested in file/folder paths and not in website links etc.

-Text file

-OneNote / Obsidian

....

Translated with DeepL.com (free version)

The original post: /r/datahoarder by /u/tahayparker on 2025-07-02 11:47:50.

hey there!

i'm looking to get a 4TB SSD to dump all my data onto. Currently, it's spread across multiple 250GB and 1TB HDDs, some on my laptop, phone and USBs as well.

I was looking at the Crucial X10 Pro but browsing reddit recently I see that there are some issues with the drive on Mac (I'm a Windows user tho). I was also looking into the Samsung T7 Shield as people have said that's a good drive as well, but I don't like the speeds and i've seen some videos showing that they too did start acting up after a couple years. so, what ssd should i buy? the data is mostly pics and vids, and i will not be using the ssd much. it's mainly as a backup, hdd isnt an option as i will travel with it and i need something that wont die in my backpack. also i need the speeds to be fast.

thank youu for your help!

The original post: /r/datahoarder by /u/DotDotExe on 2025-07-02 09:26:00.

Recently looking to get rid of pretty much all our DVDs as they haven't been touched in years, but for some reason I'm getting hit with the "what if" mindset. The main issue is space, so initially I was thinking of getting a big DVD storage booklet like this one and just getting rid of cases (and likely the heavily scratched discs), but have also considered ripping them as ISOs.

I've done up an excel spreadsheet to create an "archive" at least in terms of what I have. I'm also considering just keeping this and torrenting when I feel like watching one.

Just looking for some advice at what might be the best option, it'll be around 250-300 discs in the end. All just standard DVDs, as I don't have a blu-ray drive

https://preview.redd.it/8vzbmh9hifaf1.jpg?width=800&format=pjpg&auto=webp&s=9c9ef17c4e52dd13a08d1a6aec0b7dcbb9d8dd7e

The original post: /r/datahoarder by /u/SuperbToe2689 on 2025-07-02 07:52:48.

Seagate is exponentially cheaper here, for some reason. Should i be worried about the quality? Is WD that much superior , thus the much higher price range for its higher capacity external drives? i don't have much knowledge on this stuff. Just that i need a reliable storage for all my needs. Will be buying 2 , so the other can act as a cold storage for weekly backups..

The original post: /r/datahoarder by /u/zandadoum on 2025-07-02 06:48:34.

Story time

It started as a simple backup NAS. A simple 2 bay Synology. This was in 2019 or so.

Soon a 5 bay extension unit was added, so I could rip my dvd and make a media server.

The NAS cpu wasn’t good enough as my library grew. So a minipc was added.

By this time I also started to datahoard stuff. Some of it didn’t need much space, like backing up all of gamefaqs or that one subtitle site that closed. Other did occupy a lot, like photo archives, old Linux ISOs, etc.

The minipc wasn’t enough anymore either if I wanted to host a few more docker stuff. So 2 more were added for a proxmox cluster.

And now I notice how every year I consume 7-10TB, requiring to spend 400€ on yet another HDD. Which I can barely afford, I live in Spain and I am not swimming in money right now.

Talking about Spain: it get effing hot here. Dusty too. Right now it’s 30ºC outdoor. 28º inside with a/c off. 32º in my office. A freaking oven.

The cpus are at 60º, the HDD at around 45-48º, the electric bill is through the roof (because other appliances as well to be fair) and don’t even get me started of running a/c almost 24/7 in the summer

Now I need to upgrade HDD again. If only serverpartsdeals had a warehouse in the EU. shipping and import tax almost doubles costs. I find a decent Toshiba somewhere like 60€ cheaper than an EXO but then I read bad opinions about Toshiba.

It is at this time that I feel “too old (and poor) for this shit” and my wife comes in and sees me pulling my hair out while comparing prices and reading reviews while sweating like a pig at 27°C (a/c was on)

“What’s wrong?”

And after I explain

“Why don’t you just delete some stuff?”

Yeah. Why don’t I?