The original post: /r/datahoarder by /u/Alberts_Here on 2025-06-08 04:07:27.

I'd like to preface by apologizing if this question was answered before, but I couldn't find it myself.

I'm looking to upgrade my old WD Red 8TB in my computer with a newer and larger one, specificly either the:

• WD Gold 18TB (WD181KRYZ)
• WD Red Pro 18TB (WD181KFGX)

I'm a photographer and would use this drive as a 1st copy for my photos (already have a dedicated NAS). I see they're both going for the same price here in Canada, and am wondering if there's an advantage to either drive for my use case.

I'm aware the theoretical max write speed for the Red Pro is 4mbps faster, but are there other factors that would affect what you would recomend I get?

Cheers!

The original post: /r/datahoarder by /u/OctoHelm on 2025-06-08 00:35:43.

If anyone wants to help archive SAMHSA before it is effectively dissolved, please feel free to help!

I’m just starting on it now!

The original post: /r/datahoarder by /u/Arcueid-no-Mikoto on 2025-06-07 22:07:32.

Got that error trying to download their manga database:

https://www.mangaupdates.com/series/

Any way to circumvent the URL limit? It's annoying it just decides to give up on it's own and reset the progress.

The original post: /r/datahoarder by /u/moonshot100 on 2025-06-07 21:26:15.

Hi all - excuse me if this question seems obvious, I am not that tech savvy.

I bought two external hard drives (one back up) to transfer all my photos/videos/files from my iPhones. I connected my phone to my PC and the iPhone storage stores the items in folders by the month. When I drag and drop each folder to my PC, not all the items in the folder are transferring over. I see no errors when importing and it completes fine.

I even used the windows Photos app and imported from there and not all the items transferred. It feels like I need to import them in batches per item, not by folder to make sure all of them transfers over.

Are there any other methods that work better? I’m in no rush to if I have to be meticulous it’s ok, so long as I don’t lose any files.

Thanks in advance for any guidance and tips.

The original post: /r/datahoarder by /u/ExaminationNo1070 on 2025-06-07 20:56:01.

First time poster here. So, I currently have one 4TB Toshiba drive (Jellyfin, Navidrome, etc.) and am looking to upgrade to 14TB of total capacity.

My question: if I ran two 14TB drives in a ZFS mirror, would that make it fairly resilient to data failure? I don't have any actual NAS boxes with 4+ bays (rn I'm using an HP Z440) so I'm working with what I've got, not to mention my low total storage needs...

Any advice would be helpful!

The original post: /r/datahoarder by /u/TheLastAirbender2025 on 2025-06-07 19:33:20.

Hello everyone,

Hope you're all doing well.

I am open to other ideas and suggestions and as well platforms Immich is just an example of the one i tested and like it alot

I'm reaching out for advice on organizing my massive and messy photo/video collection. Over the years, I’ve accumulated over 5TB of media files scattered across various devices and hard drives. Sorting through everything manually has become overwhelming.

Here are some of the main challenges I’m facing:

• Lots of duplicates
• At least 2TB of low-value images (e.g., random downloads from Google) that just clutter everything
• Voice messages, screenshots, and technical notes saved loosely that I’d like to preserve
• Incorrect timestamps — photos taken in 2011 show up as 2021, etc., making timeline organization unreliable

Current Setup (Testing Immich)

I'm currently testing Immich, and I really like it — it's by far the best app I’ve come across for managing personal media. That said, my current setup feels a bit clunky:

• Running on a Proxmox VM
• Inside that VM: CasaOS on Debian
• Immich installed via Docker
• Media is stored across a Synology NAS and several individual HDDs

To scan media, I copy or move files to the Synology NAS, mount them in CasaOS, and then Immich processes them from there. It works… but it's slow and messy with all the mounts (CIFS, NFS, local paths). Feels like I'm patching things together just to make it work.

Questions / Concerns:

1. Would setting up Immich on a dedicated PC be more efficient? I have an old i7 (12 years old) with 20GB DDR3 RAM running Proxmox. I’m unsure if another old PC could improve performance or just add more complexity.
2. Is there a better way to simplify all the mounting across Synology and external drives?
3. Should I move away from Docker and try a bare-metal Debian install for Immich?
4. Would mounting shares directly in the host OS (instead of via CasaOS) improve performance?
5. Should I just install Immich directly on my Synology NAS since it’s already my main storage/backup system?
6. Alternatively, I was thinking of using an old PC, installing Linux, adding 4x 4TB drives, setting everything up locally with Docker and Immich, and using that as a standalone media server. Would that be more reliable?

Also, I’m unclear about how Immich handles files internally:

• Does it actually import files into the OS, or just reference them?
• If I delete a file from Immich, does it remove the original file, or just an internal copy?

Looking for suggestions:

If you’ve set up Immich with multiple drives, old hardware, or a NAS, I’d love to know what’s worked for you. I’m aiming for something fast, stable, and low-maintenance.

Thanks so much in advance!

The original post: /r/datahoarder by /u/March_Embers_13 on 2025-06-07 19:17:59.

Anyone know of an updated archive of collection of strategy guides? Specifically the past 10 years? I have older guides.

Thanks!

The original post: /r/datahoarder by /u/cheater00 on 2025-06-07 17:55:24.

Hi all, I want to set up a local file server for making files available to my Windows computers. Literally a bunch of disks, no clustering or mirroring or anything special like that. Files would be made available via SMB. As a secondary item, it could also run some long lived processes, like torrent downloads or irc bots. I'd normally just slap Ubuntu on it and call it a day, but I was wondering what everyone else thought was a good idea.

Thanks!

The original post: /r/datahoarder by /u/SHDrivesOnTrack on 2025-06-07 17:39:02.

Question: how much do you test a new drive before you start trusting it with data.

I have a 16T NAS (ubuntu) and I am in the process of upgrading. I bought some drives, one of which is a 28T seagate factory refurbished drive. Normally I would test drives using the linux badblocks command, however I am noticing that larger drives take, well, longer. An 8T drive takes almost 4 days to test. Started testing the 28T drive and estimated that it will take 12 days.

Would you test a drive for 12 days before you merge it into a RAID array ?

edit to add: running badblocks with defaults: 4 byte pattern tests (AA,55,FF,00), destructive read/write.

The original post: /r/datahoarder by /u/Spektre99 on 2025-06-07 17:01:18.

Examples of 20TB Seagate Exos drive part numbers.

ST20000NM007D

ST20000NM004E

ST20000NM002C

So I can guess.

ST = Seagate Technologies

2000 = 20TB

NM = Perhaps the Exos line?

Then what are the 4 digits following?

The original post: /r/datahoarder by /u/David15M3SGT on 2025-06-07 16:42:28.

Ok, so I don't know if I am a date hoarder or not, but I have a lot of files on a NAS that are 100% of my family. Most of the files are JPEG, RAW and either cellphone videos or GoPro footage. My NAS is accessible via my laptop as well as the TV that is in the living room via Plex, but that's what led me here. My wife is a little less tech savvy than I am and while the files are accessible fairly easily to me, I am concerned that if anything happens to me she won't know how to retrieve our memories. Does it make sense to dump all of my files onto CDR's/DVD's? I have heard that USB flash drives can degrade over time or else I'd just purchase a bunch of those.

Edit: About 2 TB that will continue to grow. They are currently backed up on Backblaze. Looking for easy ways for wife to access files in case something happened to me.

Thank you for any advice!

The original post: /r/datahoarder by /u/Foreign_Factor4011 on 2025-06-07 16:39:36.

Hi everyone. I've been trying to save this website: musicmap.info

But saving it directly from the browser won't work, and both HTTrack and Internet Archive can't save the page properly. Do you have any other way?

Thanks in advance to everyone for your time.

The original post: /r/datahoarder by /u/msgenhances on 2025-06-07 16:26:56.

hello. My Softraid Raid 5 setup suddenly stopped giving me access to the data and now it's showing up as it's missing a Disk.

1. observed degraded performance and couldn't write on certain folder structure
2. Reboot
3. Power cycle of the enclosure
4. Validation with repair
5. Windows Disk error check
6. Reseated the Disk 2
7. Changed to a new drive for Disk 2

Did everything above but all I see is drive letter and error saying its not accessible.

Under all drive I see all the drive

Is it worth trying to swap to a new enclosure? possible enclosure issue?

The original post: /r/datahoarder by /u/kettu92 on 2025-06-07 16:17:53.

The original post: /r/datahoarder by /u/thomedes on 2025-06-07 16:15:04.

Been using SyncThing and love it.

Up to now I've only used for "small" work. Some dozens of GB and a maximum a 100K files.

Now I'm doubting on wether to trust it for keeping replicas of may main disc, a few TB and file count of a million, maybe two.

Have you used it for something similar? What is your experience?

And the big question: What about security? Would you trust all your files to it?

The original post: /r/datahoarder by /u/BobDaSloth180 on 2025-06-07 15:53:19.

I was seeing a lot of a brand called UnionSine. Is this brand trusted?

The original post: /r/datahoarder by /u/voidsyourwarranties on 2025-06-07 15:44:27.

Looking for an inepensive high-capacity nvme, but not sure if non-branded used drives like this are worth the low cost.

The original post: /r/datahoarder by /u/axebulb_Alex on 2025-06-07 15:18:49.

Last week, I bought a 2TB HDD from ebay so I could back up a load of my old photos. When I plugged it in, I found it had loads of Nintendo games on it. I was going to wipe the drive but what wondering what (legally) can I do with them? Should I message the seller? I don't own any Nintendo consoles myself.

https://preview.redd.it/61eampe5vi5f1.jpg?width=1280&format=pjpg&auto=webp&s=51face2e4f5670bde549ad50d6ba57b7b8c3fd72

The original post: /r/datahoarder by /u/jugendabest on 2025-06-07 14:45:50.

Hello everyone,

I don't know if it is the right place for such question, but let's go.

I started to do backups of my important files recently and I currently doing it naively.

What I do is that I copy (using cp command) my home folder and other important personnal folder on a HDD drive on my computer, also on an external drive and twice a year I copy that external drive on a home server. For now it works, but with time, the transfer and the copy will start to take more time.

But is it the correct way ? I mean is the "blind" copy/paste a correct way to keep folders/files ? Is there a best and faster way to do it ?

For information, I don't need to do snapshots of my system, just keep my important config files and personal folders safe.

Thanks all !

The original post: /r/datahoarder by /u/MarinatedPickachu on 2025-06-07 13:52:12.

I have found myself pondering this topic more than once so I wonder if others have tools that served them well.

In the current case I'm using an exFAT formatted external drive. ExFAT because I need to use it between windows and MacOS (and occasionally Linux) for reading and writing so there doesn't seem to be a good alternative to that.

exFAT is certainly not the most resilient filesystem so I wonder if there are things I can use on top to improve

1. the detection of data corruption
2. the prevention of data corruption
3. the recovering from data corruption

?

For 1 actually a local git repository where every file is an LFS file would be quite well suited as it maintains a merkle tree of file and repository hashes (repositories just being long filenames), so the silent corruption or disappearance of some data could be detected, but git can become cumbersome if used for this purpose and it would also mean having every file stored on disk twice without really making good use of that redundancy.

Are you using any tools to increase the resilience of your data (outside of backups) independent of what the filesystem provides already?

The original post: /r/datahoarder by /u/Short-Guide4913 on 2025-06-07 07:16:39.

Cant use ytdlp or anything like that for the next 10 ish days and i kind of need this now there was another few posts like this but none of the links from there worked

The original post: /r/datahoarder by /u/orderdisord on 2025-06-07 06:35:02.

Hi all, I need some recommendations for some sort of optical printers that could safely print onto my discs. I don't wanna just write on them with sharpie when I'm trying to record and burn my grandmother's old VHS tapes onto them before the tapes give out, and I know sharpie could affect the shelf life (Plus i want an excuse to design nice labels for my discs!) any recommendations would be great, especially if they might be easy to get second hand!

The original post: /r/datahoarder by /u/Equivalent_Host3709 on 2025-06-07 06:19:27.

A have a huge repository of downloaded porn I am looking to clean-up/downsize; specifically, I have a lot of semi-duplicate videos, where I was able to find one source with a really high quality but low bitrate/FPS, others with lower FPS but higher bitrate, low quality but very high bitrate or FPS, etc. etc.

Obviously, I want to keep the versions that can give the best viewing experience and pleasure (no motion blur, skin detail, etc.). I am wondering how the three metrics affect video quality, which is the most important to keep high, and which I should prioritize when deleting duplicates (i.e., should I delete the one with lower FPS, or lower bitrate? Always prefer 1080p to higher FPS? 2160p but low FPS or 720p but high FPS?)...

Some other dilemmas I'm having: 24FPS vs. 30FPS, if/how high bitrate compensates for lower FPS, data rate vs total bitrate, bitrate vs video quality...

I'm a newbie to datahoarding, so try not to get too technical, but feel free to give me more considerations I should take into account.

Edit: also curious about what AV1 and h264 mean, and which file I should download from my source, if I have the option for one or the other.

The original post: /r/datahoarder by /u/Jman5150mib on 2025-06-07 05:56:00.

I have synology nas and have used shucked drives. Was wonderimg expected lifespans. They are all wd, some are 14tb, 18tb, 20tb, 22 tb and looking into maybe gettimg some 24tb.

Are any of these sizes in a nas like ds1520 or ds1522 have different exoected lifespans. I heard 10tb, 18tb , 20 tb and 24tb are likely to last longer than 14tb, 22 tb but was given no evidence. I was told avearge lifesoand was 3-5 but the longer ones are more like 5. Is all if that bull and they are all likely 3-5 or are some really expected to expire sooner?

Aboit to buy another 5 drives for a dx517 and cocnerned about longevity.

That being said any evidence that some nas or extenders help shorted or lengthen drive life?

Thanks!

The original post: /r/datahoarder by /u/Dev_was_here on 2025-06-07 02:11:53.

I heard earlier firmware caused the SSD to prematurely die