It's A Digital Disease!

The original post: /r/datahoarder by /u/Environmental_Gap_65 on 2025-05-04 16:30:57.

Hiya,

I've been trying to transfer some files to my LaCie SSD from my mac. It's 90gb-ish and its a ton of smaller files inside one folder. It's stuck on 'calculating time left' and never progress from there. I tried compressing them to .zip and then extracting them when they were inside the SSD, but there's an error when unfolding/extracting the files inside the SSD.

How do I deal with this, and why is it so insanely slow.

The original post: /r/datahoarder by /u/dstarr3 on 2025-05-04 15:12:40.

I'm going to be building a small storage server based on a Ryzen 5700G and a Gigabyte A520I AC motherboard. I'm hoping to get some ECC RAM, and I'm starting with the compatibility list provided by Gigabyte, but it's of course not exhaustive and the products I can find for reasonable money on eBay are not specifically listed.

There are two options that particularly stand out to me. There's some Samsung 2133mhz memory, but it's 4DRx4 and there are no 4DRxx items on the compatibility list. There's also some Samsung 2400T memory that is 2Rx4, which there are plenty of 2Rxx items on the compatibility list, though not specifically x4, mostly x8. Also, I'm not sure what "2400T" indicates versus a traditional 2400mhz label.

I'm leaning towards the 2Rx4 memory instead of the 4DRx4 memory, because there is no 4DRxx memory on the compatibility list, but I want to double-check here to see if I'm on the right track in regards to reading the memory compatibility list first. The list is here for anyone wanting to double-check my work:

https://download.gigabyte.com/FileList/Memory/mb_memory_a520i-ac_cezanne.pdf?v=01d5a39004cbc90ef77bc872a9eaccba

Thanks

The original post: /r/datahoarder by /u/Sludge_Punk on 2025-05-04 15:08:27.

I'm archiving comics, and I've started to learn towards naming them with a YYYY.MM.DD at the beginning of their file, to make sorting and reading orders simpler and more efficient. So I was wondering if there was a program that did that, because typing them in manually for hundreds and hundreds of comics is.... not ideal.

The original post: /r/datahoarder by /u/TriedWharf on 2025-05-04 15:08:15.

It's a kingston SSD, and transfers at about 40MB/s (not sure if it's because of my USB enclosure)

The original post: /r/datahoarder by /u/redd-or45 on 2025-05-04 14:48:44.

Not really a serious data hoarder but thanks to Amazon purchase history which goes back to the beginning. Between 2016 and 2021 I purchased an number of 2.5 inch external USB 3 and 3.5 inch SATA HDD 2TB to 5TB drives. Of the ones that are still available or their cousins prices are up about 2.2X since then.

The original post: /r/datahoarder by /u/TheCelestialDawn on 2025-05-04 13:26:46.

Questions:

1. Does this issue also apply for hard desks in PCs? I ask because I still have an old computer with a 1080 sitting next to me whose drives still work perfectly fine. I still use that computer for storage (but I am taking steps now to clean out its contents and store it elsewhere).
2. Does this issue also apply to USB sticks? I keep some USB sandesks with encrypted storage for stuff I really do not want to lose (same data on 3 sticks, so I won't lose it even if the house burns down).
3. Is my current plan good?

My plan as of right now is to buy a 2TB external drive and a 2nd one 1,5 years from now and keep all data duplicated on 2 drives at any one time. When/if one drive fails I will buy 2 new ones, so there is always an overlap. Replace drives every 3 years regardless of signs of failure.

4. Is there a good / easy encryption method for external hard drives? My USBs are encrypted because the encryption software literally came with the sticks, so I thought why not. I keep lots of sensitive data on those in plain .txt, so it's probably for the better. For the majority of the external drives I have no reason to encrypt, but the option would be nice (unless it compromises data shelf life as that is the main point of those drives).

5. I was really hoping I could just buy an 8TB+ and call it a day. I didn't really expect to have to cycle through new ones going forward. Do you have external drives that are super old, or has this issue never happened to you? People talk about finding old bitcoin wallets on old af drives all the time. So I thought it would just kind of last forever. But I understand SSDs can die if not charged regularly, and that HDD can wear down over time due to moving parts. I am just getting started 'hoarding' so I am just using tiny numbers. I wonder how you all are handling this issue.

6. When copying large amounts of data 300-500GB.. Is it okay to select it all and transfer it all over in one go and just let it sit for an hour.., or is it better to do it in smaller chunks?

Thanks in advance for any input you may have!

The original post: /r/datahoarder by /u/notmarkiplier2 on 2025-05-04 13:14:08.

(hope I'm the first one to ask this kind of question around here, may or may not have seen some posts that are similar or exactly like this)

My 2.5 and my 3.5 were both got dropped on the floor. They've just dropped flat and didn't bounce or whatever, but I'm not sure whether or which side of the drive were they got dropped. Probably from behind as one was wrapped in a bubble wrap (3.5) and the 2.5 was just on top of it. When they got dropped they've landed both flat and the 2.5 were still on top of 3.5 and as of now, the 2.5 only rattles when is shaking vertically but isn't horizontally. The 3.5 weren't rattling vertically but I think I could hear a swooshing high pitched sound when you'd shake it horizontally. Kind of like when you swing a very thin stick, you'll get that high pitch sound.

I'm not sure if I should plug it in then see if it boots or just let a professional check the internal parts. Either way, I'm still is uncertain as one would cause more harm to the drives and the other would cost me money that much. However, I'm uncertain whether or not neither of the drives contain something important, so I guess I'll just leave it to that. I'd still would want to see some files around if they're important before totally disposing them. If they boot however but is only readable, how could I make a whole copy of its partitions? I'm guessing some or both of these were being used to boot windows before. Plus, I'm also guessing that while its gonna read it the drive, it would be intermittent. I don't know which software could help me with that sort of problem and surely to extract it as well. I hope some of you guys could help me here

The original post: /r/datahoarder by /u/RajSingh9999 on 2025-05-04 12:47:46.

Couple of years ago, I got GIGABYTE BRIX mini PC with Celeron Processor J4105. The machine details can be found on its home page here.

It basically has following relevant specifications:

• Front IO:
  • 1 x USB3.0
  • 1 x USB3.0 type C
• Rear IO: 2 x USB 3.0
• Storage: Supports 2.5" HDD/SSD, 7.0/9.5 mm thick (1 x 6 Gbps SATA 3)
• Expansion slots
  • 1 x M.2 slot (2280_storage) PCIe x2/SATA
  • 1 x PCIe M.2 NGFF 2230 A-E key slot occupied by the WiFi+BT card

Currently I have following things installed:

• Samsung SSD 850 EVO 500GB
• 8 GB DDR4 RAM.

CPU-Z says following for the RAM:

• Total Size: 8192 MB
• Type: DDR4-SDRAM
• Frequency: 1197.4 MHz (DDR4-2394) - Ratio 1:12
• Slot #1 Module - P/N: CB8GS2400.C8JT

This machine is running Windows 11.

Now, I am embarking my journey to configure this machine as my central storage server / HTPC. These are my usecases:

• Syncing important OneDrive and Google drive folders (currently done with OneDrive and Google Drive clients)
• Downloading torrents (currently done with qBittorrent windows app with WebUI enabled)
• Downloading and streaming YouTube videos / playlists / channels (currently done with TubeArcivist through docker compose)
• Downloading movies, TV serials (not yet done)
• Viewing photos (not yet done)
• Remote Access (currently possible through Windows Remote Desktop on same network. For accessing over Internet, I have installed TeamViewer and enabled unattended access. I know it sounds dirty approach and I should try VPN. But for a moment this works.)

How I am thinking to set up my media center / backup server:

I am still exploring the Media server apps landscape and recently came across apps like sonarr, radarr, jellyfin, jellyserr, prowlerr. I routined work with docker containers and I feel I will end up running everything as a docker container spawned through single docker compose file. Some have already shared such single docker compose files that can configure and spawn all necessary apps docker containers in one go. For example this reddit thread and this medium article share such docker compose files. This github repo also seem to contain docker compose files for different apps.

So as long as I have this docker compose file saved somewhere (say on cloud storage or even in email), I can spawn exact same apps ecosystem and their inter-communication configuration within couple of minutes on Windows (or Ubuntu) with single command. I will no longer have to backup container itself. Only things I will need to backup is media and docker container metadata. I can specify host mounted volumes for all containers for both media and metadata. For metadata (say subscribed youtube playlists / channels in case of TubeArchivist), I can create a cron job to compress and backup corresponding hosted metadata volumes on daily or weekly basis. In fact, I can create these scripts once and run it inside another docker container captured in docker compose so that even backup mechanism will start along with other containers. All I will need is single docker compose file. If metadata is small (need to check), I can backup it to cloud and restore it from cloud in case my server crashes. If it is big, I will need another separate drive may be configured in RAID. But I am currently not thinking of this, as I dont have big storage drive currently. I am planning to buy my first 4TB 3.5 inch storage. In future, I may expand it to multiple HDDs. At that time, I might think of proper RAID / mirrored NAS solution.

I have following doubts:

What storage I should opt for? I read internal SATA HDDs are more reliable than external USB connected HDDs, but a bit costly. Also, SATA SSDs are a lot costlier than SATA HDDs. So am leaning towards internal SATA HDDs. But my challenge is how can I connect it to mini PC ! It can only fit 2.5 inch internal SATA drive (and one NVME SSD). It does not have space for 3.5 nch drive. Also, 2.5 inch SATA connection (5V) cannot be used for 3.5 inch internal HDD since it does not supply enough power (12V) for internal HDD. I also have tower PC with ATX motherboard. I thought I can utilise power connection from tower PC and SATA connection to mini PC. Then I thought I can simply put min PC and HDD inside tower PC's cabinet. But I read its not good idea since mini PC and tower PC will have different grounding and will end up damaging HDD. So now I felt that I am only left with external casing with SATA to USB converter. I can keep the casing open to let HDD cool enough. I am thinking of this 3.5 inch HDD external case and Seagate IronWolf 4TB NAS HDD.

Q1. Will SATA to USB converter end up damaging the HDD.

Q2. Can I use Seagate NAS HDD by fitting it inside external HDD enclosure? Or I should just buy some non-NAS HDD?

Regarding ZFS

• I read ZFS is kind of defacto for NAS.
• But currently I only have 500 GB SATA SSD and am planning to buy 4 TB internal HDD.

Q3.1. Will ZFS consume a lot of storage out of 4TB? Will it cause a lot of reads / writes to wear out my only HDD?

Q3.2. I read ZFS consume considerable amount of RAM. Will it slow down my mini PC?

Q3.3. I believe ZFS (and even RAID) makes more sense when you have huge storage available (may be 16TB+). But, it does not make much sense when I have only single 4 TB HDD and 8 GB RAM. Am I correct with it?

Q3.4. Without ZFS, what kind of data corruption I am staring at?

Q3.5. If I thought it all wrong, and I absolutely should use ZFS even with 4TB drive, is it wiser to go for ubuntu (instead of Windows) with external drive formatted as ZFS?

Regarding proxmox

• I feel there are two things that I will miss if I dont go for proxmox: (1) I wont be able to run multiple Operating Systems on this machine (2) I will miss out of box implementation of ZFS.
• (1) Given that I will never require need for trying another OS on this machine (since I already have other machines running Ubuntu and Windows both), I feel I can get away with inability to run multiple OSs on this mini PC.
• (2) ZFS is already discussed in detail in Q3, so I wont repeat it here.

Q4. Is there anything else that I will miss if I run everything on Windows (or Ubuntu) inside docker containers and dont go for proxmox?

• Also I feel docker containers are faster and lightweight than proxmox LXC containers or VMs, making overall setup more faster in general.

The original post: /r/datahoarder by /u/firatlql on 2025-05-04 12:46:01.

My budget is not that much, so I am considering Epson Perfection V19 and Canon LiDE 400. I will use it to scan old photos. As far as I have researched, the features are very similar, but they say that Epson is better. unfortunately, there are not many scanner models in the country where I live. (apart from these, Epson Perfection V39II is also possible, but if the others are good, I don't want to exceed my budget)

The original post: /r/datahoarder by /u/fx2mx3 on 2025-05-04 12:28:12.

This NAS has one particular feature I really like! 2 Network Cards - 2.5 and 10Gb. It has a lot of other bells and whistles like a a nice Pentium gold 8505 with 5 cores and 6 threads and expandable RAM slots up to 64GB. But for me it was the network design that got me! 10Gb switches are expensive, which is why most of us opt for 2.5Gb switches. You can get them for as little as 30 quid, especially if they are basic ones (no POE and unmanaged)

Which is why I really dig this network NiC setup on this NAS! It allows me to take advantage of old school peer to peer configuration between my main computer and my NAS, while still retaining a 10Gb connection to my asset store. With really good speeds on both 2.5 and 10Gb.

So I made a video not just reviewing this NAS, but also showing how to setup a split network that relies on peer to peer using an ultra cheap $10 10Gb network card!

I personally don't really like proprietary NAS software, so I also show in the video how to replace the current UGREEN OS with something like TrueNAS, Proxmox, or whatever you fancy!

Anyway, I don't really know if this type of post is considered self promotion, but I count it as educational so hopefully it will stay on, but if not, thanks for the consideration anyway! :)

The original post: /r/datahoarder by /u/hundsfutter on 2025-05-04 12:13:25.

Hi!

I've recently bought a new/bigger HDD for my Synology DS218+.

I slapped it into the NAS, formatted it to ext4/jbod and copied all the shared folders onto the new drive.

Now I have totally 3 HDD's for the NAS. The first one is from a few years back with 10TB, the second 16TB and the new one 24TB.

The 16TB and 24TB are currently inside the DS218+, but the 16TB should be removed and stored as backup.

My plan is, to slap the 10TB into a HDD enclosure and backup every new copied stuff that gets copied over to the NAS also on this drive.

So in total that would make 1x24TB inside = 1x16TB + 1x10TB as backup.

But what is, if the NAS itself dies? Is it easy to access the ext4/jbod data and recover it from a normal windows/linux PC?

Is it a good Idea to take out the 16TB and store it as it comes out from the Synology without any formatting/copying?

Thank you for your help!

The original post: /r/datahoarder by /u/diegopau on 2025-05-04 11:26:04.

The original post: /r/datahoarder by /u/DigitalDustOne on 2025-05-04 10:03:14.

Hi everyone, A quick overview before the question comes: I started with a Synology 4-bay NAS, then added an Optiplex with an ARC A310 for transcoding. Soon I'll be running out of space and I want to get out of Synology's ecosystem. The Plex server is already running on the Optiplex so I only need to move the media somewhere else.

I came across Terramaster (D6-320) that I could attach to the Optiplex.

Is it a good idea to run software raid 5 (even 6) on a windows pc with the Terramaster? How high is the CPU load nowadays really running software raid? If the PC crashes for some reason (behind UPS), is the data safe? Is it scalable? I ask because I see different opinions when searching the web.

The original post: /r/datahoarder by /u/Hungry-Wealth-6132 on 2025-05-04 10:02:21.

Hi, as Flickr changes it's way of usability on 16th May 2025 (limit file size downloads via free accounts), I wanted to know what important oder notable account are to save (including URL). Thanks :3

The original post: /r/datahoarder by /u/Creepy_Finish1497 on 2025-05-04 08:53:04.

Hello,

I've got an 8-bay NAS with 4*20TB and 4*16TB drives in (two RAID 5 arrays). I started with the 20TB drives configured in RAID 5 and I have used 28.3TB of the 54.5TB. I had two 16TB drives laying around from a previous build so I bought two more and added them and configured another RAID 5. I have not added any files so I have 43.6TB of space on the second RAID 5 array.

The reality of my storage needs are that I don't foresee needing much more than 50TB total in the near future so I am researching options to utilize the second array to provide more fault tolerance, or creating one RAID array with different size drives.

Keeping the two array configuration, one option I've come across is to have some rsync that automates backing up folders from the two arrays. I know nothing about this so there's a learning curve.

Another option is to delete the 4*16TB RAID 5 array and create one RAID 6 array with all 8 disks. If this is possible with RAID 6 then I calculate my total usuable space to be 87.3TB (the size of the smallest disk is used).

I realize that this wastes 4TB of storage from each 20TB drive, which is why I'm here asking the more experienced folks. 87.3TB is more than I will ever need, and I don't have to deal with rsync, or any other solution.

The downside is that there might be performance issues using RAID 6 with different size drives. At least that's what I read.

Anyone have any other suggestions? Is there an easy to use GUI solution that automates foldes duplication between two RAID arrays in the same NAS?

FWIW, I have the UGREEN NAS, using UGOS.

UPDATE#1: I looked at the UGOS gui and there is a sync, but it is designed to sync external folders to the UGreen NAS. While this could work, I tested and wan't surprised that the PC that has the share must remain powered on for the sync to occur. There doesn't seem to be any UGOS app that can replicate/sync between internal volumes on the same NAS.

UGOS also doesn't allow for the conversion of RAID 5 to 6, o I would have to copy everything from the 4*20TB RAID 5 to the 4*16TB RAID 5, then delete the 20TB RAID and make a new RAID 6, then copy the 16TB RAID 5 data to the new 20TB RAID 6, then delete the 16TB RAID 5 array, then expand the 20TB RAID 6 to include the 16TB disks. Very time consuming, and I'm assuming UGOS allows for a RAID 6 to expand and be able to add disks of different sizes.

The original post: /r/datahoarder by /u/Lactoo on 2025-05-04 08:06:32.

Hi All.

I hope people can help.

I don't haver a NAS or anything like that, so i'm looking for a mass storage disk that I can put in my stationary PC (it's 6 moths old).

EXOS seem to be the most popular choice, but there are so many different types, so I can't figure out what to go for.

There is also Toshiba and Western Digital Ultrastar among others.

I'm looking for at least 16 TB.

The original post: /r/datahoarder by /u/xxthrow2 on 2025-05-04 07:15:46.

Hey hoarders—

I'm looking for anyone who recorded TV news broadcasts (OTA, cable, or streaming) from around early 2024.

There was a specific incident I saw live on the news that has completely vanished online. No trace on search engines, no clips, no mentions—just gone.

I won't go into detail here, but I’d really appreciate if anyone has full DVR dumps, network rips (CNN, Fox, MSNBC, NY1, etc.), or even partial captures from that timeframe.

Could be from Plex libraries, NAS archives, livestream tools, even raw transport streams.

If you have anything recorded—especially from March to May 2024—please PM me. I can give more details privately. Even a few minutes of a nightly newscast might be enough.

Thanks in advance to any fellow hoarders who've got the good

The original post: /r/datahoarder by /u/justsad95 on 2025-05-04 05:10:38.

I saw the recent announcement that Facebook is going to be deleting all live stream videos. At first, when I saw this announcement, I didn’t care cause I never go live. However, I remembered that my dad who passed away in 2021 used to go live daily in post 10 to 15 minute videos of inspirational content. I think the hardest part about somebody passing away is not being able to remember their voice the days and I’m really missing him. I’ll scroll through his Facebook and watch his old live stream videos but now they’re gonna be deleted in 30 days, what is the easiest and quickest way to save a mass amount of Facebook live videos from somebody else else’s account? I’m so stressed and upset over this. I always had the backup of being able to just go on his profile and watch a few videos when I was missing him, but now they’ll be gone forever. Thanks.

The original post: /r/datahoarder by /u/sergeyvk on 2025-05-04 03:45:30.

Hi,

I've got an always on Mac mini m4 running Plex server with a 128gb SSD attached containing some tv series and movies I watch on Plex on my TV and sometimes on my phone when I am at work via Tailscale. I also have 3 different old 2.5 HDD 500gb each one with photos, one with music and some files/apps and one as backup for my documents folders on Mac mini and MacBook.

I would like to consolidate those several small HDDs into 1 or 2 3.5 HDDs maybe. Wanting to put them in raid so the second drive would always be a copy of the first one in case it fails and will have another one external as a backup for most important files which will only be plugged in once a week as a backup. I mainly need those drives to always be accessible for photos and movies (as storage).

Am I better off with a DAS or just 2 external HDD attached all time to my Mac? Would love Synology but don't really have funds available to spend $AUD500 just for an enclosure right now, but I guess you get what you pay for.

The original post: /r/datahoarder by /u/DanHazard on 2025-05-04 01:20:07.

So I've been trying to get some physical media (old photos, family videos) and stuff into the cloud, and decided on using Wasabi.

I've successfully put some things in the cloud, but now I cannot for the life of me figure out how to grant access to the sub user accounts I'm making for my family. I have tried adding just about all the default admin and full access policies to a test account, yet when I try to access my bucket from Cyberduck, it fails because of an explicit deny policy (no idea where or why this is happening?)

I don't want to make it "public" I just want to be able to help my family use Cyberduck to download things I am putting in my Wasabi bucket. I've been going through the Wasabi documentation for a few hours now and nothing is making sense, no tutorials are helping me. Whatever I do Cyberduck won't connect to my Wasabi bucket on any sub user account. I do not want to give out root access. Can anyone please point me in the right policy direction?

The original post: /r/datahoarder by /u/Twiumph184 on 2025-05-03 21:01:25.

The original post: /r/datahoarder by /u/NakulPadave on 2025-05-03 17:52:25.

The original post: /r/datahoarder by /u/Hitthegymsis on 2025-05-03 15:32:17.

The original post: /r/datahoarder by /u/GJSchaller on 2025-05-03 12:03:28.

I am currently helping a friend update his tech - his current setup is an older ReadyNAS with four 14TB WD Red drives, but the NAS itself is beginning to show its age, and he's looking for something that is 1) Faster, and 2) Less complicated. Ideally, I'm looking for Direct Attached Storage of some sort, that would let me attach at least 4 drives in a RAID 5 array to be used with MacOS, that would require minimal maintenance or subscription software to use.

I was thinking Drobo, but I see they are no longer around. I looked at OWC's ThunderBay offerings, but it looks like you need a subscription to their SoftRAID Pro to get any meaningful data out of the device, such as potential drive issues, SMART reporting, etc. Apple's RAID manager does RAID 0 or 1, but not 5, from what I am reading. Oyen Digital has two options - one without hardware RAID (but has USB-C), the other has hardware RAID (but is limited to USB-3 and SATA 3Gbs).

What options would you suggest for something for a simple, easy to manage, but still fast and reliable local storage option?

The original post: /r/datahoarder by /u/Severe_Citron768 on 2025-05-03 23:01:11.

I keep trying to view a site on Wayback machine but its just a white screen and nothing else, anyone know why this happens?