It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
1776
 
 
The original post: /r/datahoarder by /u/Matt45045 on 2025-04-23 19:07:52.

I was trying to wait until the 30TB Hard Drives were available to buy a new hard drive but I ran out of space today and have no choice but to get a new one. I saw a 28 TB external hard drive I was going to get, remove from the case, and install internally into my computer. After some research I've seen that on some of the newer external hard drives this is no longer possible. And upon further research that external drives may be from rejected, lower quality, returned, or under performing stock. I was wondering if I should avoid external drives completely and what the largest capacity consumer hard drive available right now is that I could buy as I haven't seen any 28TB internal drives.

1777
 
 
The original post: /r/datahoarder by /u/poseidoposeido on 2025-04-23 15:13:52.

Hi everyone,

I’ve been a long-time Synology user because of the platform’s simplicity, but my fleet is getting long in the tooth (DS212j, DS218+, plus a half-working DS215-something). I’m ready for an upgrade, and my first thought was to grab a current 4-bay (or larger) Synology model.

Then I read Synology’s recent announcement: future units will be qualified only for their own branded HDDs. I’m not a fan of that kind of vendor lock-in, so I’m exploring alternatives.

The DIY route I’m considering

  • Board/CPU Intel N100 Mini-ITX board (e.g., Jensen N3 or similar)
    • a no name N100 board?
    • A topton N100 board?
  • PSU & case Basic ATX/SFX PSU and a compact 6- to 8-bay chassis
  • OS options TrueNAS SCALE, Unraid, or—even if it’s a bit hacky—XPEnology

The DIY build would give me:

  • Freedom to choose drives (and brands!)
  • Easy hardware swaps if something fails
  • Room to tinker and upgrade over time

Budget is limited, though, so I’m eyeing the “el-cheapo” N100 boards on Aliexpress. That raises a newbie concern:

My big question about RAID portability

If I set up, say, a ZFS or Btrfs pool with redundancy (or any other RAID solution) and the motherboard dies, can I drop the drives into a different board and pick up where I left off? Or is there any hidden “pairing” between the disks, the OS install, and the specific hardware?

I’d love to hear from anyone who has:

  • Migrated a TrueNAS/Unraid array to a new motherboard
  • Recovered pools after a sudden hardware failure
  • Tips on choosing reliable low-cost boards for a home NAS

Thanks in advance for any insight—and for talking me out of (or into) this rabbit hole!

P.D I have also a N100 minipc lying around... what about a DAS solution? would it make sense? how secure is it against failures?

1778
 
 
The original post: /r/datahoarder by /u/MikeLanglois on 2025-04-23 14:42:04.

Hey all, I am looking for a NAS for general home hoarding. Something that can stream to my smart tvs for my videos, store our holiday pictures that kinda thing. We have a 4tb hdd that just gets moved around and plugged in where needed, and its getting boring doing that.

A few review posts list Synology as a good candidate still but looking at recent news is that still the case? We had a WD My Book Live in the past but then they had that security breach and it was formatted by hackers so ideally want to avoid them.

Any recommendations? Most seem to not come with any drives as standard now too?

1779
 
 
The original post: /r/datahoarder by /u/pizza5001 on 2025-04-23 19:35:10.

I used Veeam Agent to backup my PC (with 3 storage drives) to a 4TD external hard drive.

I'd like to do a second backup of my PC to a 4TB partition within a 14TB external drive. This drive has 10 partitions (each one is backup #2 of other drives I own).

Does backing up a PC to one partition of a drive with many partitions carry risk? Is it preferable to backup a PC to an external drive with only one partition, or does it not matter? I'm trying to minimize risk of data destruction.

(Background: All my data exists on source drives ranging 1TB to 4TB, and then I do a backup #1 of those drives, and then the backup #2 of those drives exist on a 14TB drive with multiple partitions that match backup #1. NAS is beyond my skill level, so this is how I do it, and I keep a spreadsheet to stay organized. 12 external drives total.)

Thank you!

1780
 
 
The original post: /r/datahoarder by /u/Professional_Trick67 on 2025-04-23 19:21:31.

Hello, I've been subscribed to patreon for years now and the longer time goes the harder it is to scroll back to specific content so I want to download all posts of this creator by bulk. I've been searching this sub for step by step guides on how to use github stuff to download patreon content but I really don't understand how they work. I tried the one with powershell and the other one with node.js but nothing happens all I get are errors. Maybe you guys have a for idiots guide there that could help me

1781
 
 
The original post: /r/datahoarder by /u/super_starfox on 2025-04-23 19:19:35.

As a frequent user of both generative AI tools like StableDiffusion, the updated language of this massive website is causing lot of people to be concerned.

https://civitai.green/articles/13632

A lot reports are being made about posts being deleted without notice already, and the metadata requirements seem a bit much. Who knows how much and how quickly they will get rid of a lot of people's work.

It's an absolute heaven for models, art, files and help for new users. I personally don't know what to do on my end, but felt it's appropriate to say something here, even just to serve as a notice.

1782
 
 
The original post: /r/datahoarder by /u/GreyAreaManchester on 2025-04-23 18:34:38.

Hi, a friend has a very dead disk with some family photos on he would really like to get back, any solid recommendations for a UK data recovery business that’s reputable and tested?

1783
 
 
The original post: /r/datahoarder by /u/NathanielTat on 2025-04-23 18:33:07.

I have Buffalo link station LS441D I'm going to be using for photo and file storage but it didn't come with the drive mounts, now I've had it running without before but if it gets knocked for any reason it could damage the connectors. Is there anyone who knows where I can buy the mounts for them are they a universal and what would I even search for (I have tried Buffalo link station LS441D drove mounts and it comes up with sweet f all)

1784
 
 
The original post: /r/datahoarder by /u/Either_Awareness_772 on 2025-04-23 18:16:09.

Hey all, I'm a photographer working off of a laptop currently. I need to replace an old banged up external drive that's starting to stick on me. I don't care for it to be the fastest or anything fancy tbh, just something to hold images that I don't have to worry about filling up for a minute. I'll probably also use it as one of a few secondary drives in a PC build I'm aiming on doing later this year.

Thoughts on using something like this with an enclosure?

https://amzn.to/4lHIiiQ

1785
 
 
The original post: /r/datahoarder by /u/polawiaczperel on 2025-04-23 17:52:51.

I'm looking for someone with serious scraping experience for a large-scale data collection project. This isn't your average "let me grab some product info from a website" gig - we're talking industrial-strength, performance-optimized scraping that can handle millions of data points.

What I need:

  • Someone who's battle-tested with high-volume scraping challenges
  • Experience with parallel processing and distributed systems
  • Creative problem-solver who can think outside the box when standard approaches hit limitations
  • Knowledge of handling rate limits, proxies, and optimization techniques
  • Someone who enjoys technical challenges and finding elegant solutions

I have the infrastructure to handle the actual scraping once the solution is built - I'm looking for someone to develop the approach and architecture. I'll be running the actual operation, but need expertise on the technical solution design.

Compensation: Fair and competitive - depends on experience and the final scope we agree on. I value expertise and am willing to pay for it.

If you're the type who gets excited about solving tough scraping problems at scale, DM me with some background on your experience with high-volume scraping projects and we can discuss details.

Thanks!

1786
 
 
The original post: /r/datahoarder by /u/NoVa_PowZ on 2025-04-23 17:42:06.

Hi, as the Title says. Im having a hard time finding a solution for downloading all my saved media. I do not own a PC. Is there a quick way to download all my saved media?

1787
 
 
The original post: /r/datahoarder by /u/impressionista on 2025-04-23 17:19:58.

Hello everyone, currently looking to replace the 5+ years old Toshiba 2TB and WD Green 2TB (https://i.imgur.com/lZNiFaq.jpeg) with new HDDs.

Looks like I am somewhat on the wrong sub probably. I can't remember the sub for hardware suggestions.

Windows is on a WD Blue SSD, frequent backups are on the 870 Evos, also soon 5 years old. Also turns out, SSDs are not that good to use as cold storage. And the beforementioned HDDs are now way old imo to store important stuff.

Kinda want to go with the cheap WD Purple, but apparently these are optimized for non-stop writing, and couldn't find WD Blacks here, another option would be Toshiba. Never touched nor bought Seagate, no particular reason.

TLDR would be the Purple a good pick, just to copy over my stuff every week or month, and remove from power until next back up period?

1788
 
 
The original post: /r/datahoarder by /u/Standard-Composer-20 on 2025-04-23 16:55:15.

Just go to HERE and press remix app, make a free replit account and wait for it to load (might take a few minutes), then it should show something similar to the image. Then you just put in the link, press fetch and you'll see image 2. its straightforward from there I think.

Edit: **Last not alst

https://preview.redd.it/f8rbh1wd7mwe1.png?width=780&format=png&auto=webp&s=56640102129f319f51798de8fae50c954f0ae98d

https://preview.redd.it/gnfwjgub7mwe1.png?width=780&format=png&auto=webp&s=2aafd4d7a19e7231123e72d01ae2844d356780f6

1789
 
 
The original post: /r/datahoarder by /u/biofilmcritic on 2025-04-23 15:53:58.

Seems like some of it is conveniently packaged up for mirroring: https://eric.ed.gov/?download

1790
 
 
The original post: /r/datahoarder by /u/bimmer1977 on 2025-04-23 15:53:35.

Hi

I have a Synology DS1817+ and was look for replace it with the new DS1825+ but after that they won't allow 3rd party disks I will go to one of the open platforms.

I like the size and form factor of the Synology, but I can't really find a good case and motherboard to use. Do you have any good suggestions?

It is only for data storage, I have 2 Proxmox host, so no big graphics card, virtualization ec. Just low power used, 8-10 HDD and perhaps 2 NVMe for caching, but I will like to have a SFP port for 10G lan.

1791
 
 
The original post: /r/datahoarder by /u/MCDodge34 on 2025-04-23 15:50:21.

Ok, some HDD in my server starts to make me worried that one would fail (all HDD in there are 4TB from 2013 or 2014), I have around 3.3TB of data to backup ASAP, the rest, I can survive without it, now what HDD would be the best, I prefer to use an internal drive and stick it into an external usb case, makes it easier to replace whenever the HDD or the case decides to stop working compared to all in one external HDD with soldered boards and not connector to try to recover the data.

I see some Seagate Barracuda 4TB at 129,99$ on amazon canada (yeah sadly I'm in Canada so need to purchase in CAD which makes prices way much higher sadly) I also see a Seagate Barracuda 8TB drive for 184,99$, but I'm scared to death to loose all the data that would be on it, are 8TB drives reliable now, lets say I want to recover this data in 7 yrs from now, I don't also get it why they are clocked at 5400rpm, I could swear its only good for laptops at that low rpm.

1792
 
 
The original post: /r/datahoarder by /u/VIKcentiu on 2025-04-23 15:42:55.

Hi, I need a new HDD for my NAS, and I'm not sure which one to choose. I've found an 8TB IronWolf (NON-PRO) and an 8TB Exos (NON-X) Enterprise 7E10, both priced about the same. The Exos is slightly cheaper, but I'm curious, what do you guys think is the better option? Also, are both CMR?

1793
 
 
The original post: /r/datahoarder by /u/mcg00b on 2025-04-23 15:09:59.

I'm currently backing up to external hard drives and a remote server in another town (also stores on HDD). It wouldn't be hard to keep a few hard drives in rotation to have an "offline" copy as well, but I've been thinking about "alternative" media, which seems to lead to Blu-ray or LTO storage. Main thing that I want to keep is the photographs I've shot over a couple of decades, which is a measly few terabytes. LTO has the cost disadvantage, so I'm leaning towards Blu-ray, unless there's a magical new storage option I've never heard about.

As much as I've read, it seems that either regular 25GB Blu-ray should do the trick or maybe M-Disc if I can justify the media cost for an unclear(?) advantage.

I'm not really clear what drive to choose. Will a Verbatim external slim drive be a good choice? The Verbatim 43890 model is a bit cheaper, but 43888 supports "Ultra HD 4K". I doubt I'll ever watch or rip a single Blu-ray movie. Main function would be burning backup media. Any thoughts?

1794
 
 
The original post: /r/datahoarder by /u/jlkauffman92 on 2025-04-23 12:40:53.

It seems like the online version of the British Sound Archive has been taken down. Am I just out of the loop or is this news? I was looking for some early recordings of Bach’s Violin Concerto in D Minor and the British sound archive is the only source for many of them.

1795
 
 
The original post: /r/datahoarder by /u/Messenger-of-helll on 2025-04-23 11:49:11.

I want to archive a site very fast I have reliable internet connection but I want it to be fast . How do I go about it?

1796
 
 
The original post: /r/datahoarder by /u/AcrobaticComposer on 2025-04-23 11:32:16.

I would like to build a media archive for long term storage (30 years).

What's a future-proof way to do this? So far I'm thinking 1080p videos in mkv and mp4 and probably 320kbps mp3s (mp3 feels more "universal" than FLAC).

How do you guys go about this? Are mp3/mkv/mp4 likely to be still "popular" in the future? (ie will my future TV be able to play it if I connect my external ssd to it). Is 1080p enough or should I do 4K where possible?

Ideally I would want something future proof but at the same time backwards compatible - if I connect to an old device it will still be able to play.

What about the file system of my external ssd? NTFS? FAT? exFAT? Is HDD better than SSD?

What's the best bet?

so many questions... :)

1797
 
 
The original post: /r/datahoarder by /u/ShapeShifter499 on 2025-04-23 11:04:34.

Call me weird or crazy if you like, but in a scenario where one would need to move a home data setup quickly. I'm wondering what the most portable way to store a petabyte might be.

Criteria

  1. Both the storage medium and any drive or device required to read back storage medium are easy to move under short notice. Say 10-30 minutes.
  2. It doesn't need to be fast. Idea is this would be a periotic backup of all of your currently live data. Maybe you might lose yesterday's edit, but you wouldn't lose everything.
  3. Cheaper, the better, but let's entertain a situation where money is no obstacle too.
  4. One person working alone could do it.

Edit: Practical data storage is preferred. Something like a thousand 1TB or 500 2TB sd cards is going to make backups difficult in the first place.

1798
 
 
The original post: /r/datahoarder by /u/Wez4prez on 2025-04-23 11:03:31.

Hello.

Ive noticed that some of my drives are on its last notes. Movies that otherwise would be great and randomly getting errors so Ive decided its time for upgrade.

This is a pure HTPC setup, except initial reading its only going to playback 1080/4K content thst has been stored so Im thinking a 20TB Toshiba Enterprice MG10. Its not going to be a server where its contantly refreshing data so I guess I dont have to worry about writing chugging (sound)?

Anyways, now I have about 8TB of data spread on 3 discs that I want to move into the new HDD.

Ive only noticed one HDD is starting to have issues and the others are fine, but they are all very old.

What program and method would you advice me to use? I dont think using windows own file "software" is the greatest dealing with this unless I copy/cut/paste file by file, but that is going to take forever.

Thanks

1799
 
 
The original post: /r/datahoarder by /u/GoodFroge on 2025-04-23 08:41:38.

This is something that has always confused me about the archive. There are some live recordings from live shows that are either independent artists or major artists, that are audience recordings and not commercially recorded or released, and yet they are locked by the uploader.

So if it’s locked and can’t be accessed by anyone besides the uploader, what is the point of it being archived if literally no one can access the material?

1800
 
 
The original post: /r/datahoarder by /u/Squidia-anne on 2025-04-23 08:04:08.

With so many people being black bagged, arrested, disappeared, and kept in concentration or slave camps I keep thinking what if there was a website with all of the known information on these people.

Where we can click on their file and see everything that happened, news coverage, and even go fund mes etc. Updates on their stories.

A memorial for those that die or never come back. A way to stay in the know and even try to be active when help is possible.

I'm wondering if any similar projects already exist? Or If it's possible.

I think about those trans women being tortured in mens prison and how we don't know who they are or where. I keep thinking of those hundreds of innocent people in the El salvador slave prison or the guantanamo bay concentration camp. How many of them are even known? Will they die and no one will even know who they are?

I only have a mobile phone and I'm not super educated on data hoarding or making websites. I just keep thinking of those people. They deserve to be known. Their stories should be told. We should be able to donate or send letters or have information so we can try to help if possible.

If anyone knows of something like this please let me know. Thank you.

view more: ‹ prev next ›