It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
701
 
 
The original post: /r/datahoarder by /u/CrushedSodaCan_ on 2025-06-23 00:02:46.

Ive been beating my head against my computer trying to make this work.

I have data that I want to be redundant/cloned/mirrored. I need to be able to swap this device between computers that are NOT on the same network.

I figured I would get a USB DAS with raid 1 but I can't seem to make that work for hot swapping from a kvm.

Any suggestions? Hardware raid enclosure? Some other backup method?

I currently have (2) m2 drives that I'm hoping would be the basis of the system or ive got some big Amazon refunds to do 😅

702
 
 
The original post: /r/datahoarder by /u/crossfitdood on 2025-06-22 23:54:54.

Looking for a new case. This one looks awesome but I can’t find anything on it. Anyone have this case?

703
 
 
The original post: /r/datahoarder by /u/MonsieurPotato86 on 2025-06-22 16:26:01.

14 HDDs and low price, probably very cheaply built. Has anyone tried it?

https://www.vevor.ca/computer-cases-c_13781/vevor-pc-gaming-case-mid-tower-computer-case-4-x-120-mm-fans-for-atx-m-atx-itx-p_010344860342

704
 
 
The original post: /r/datahoarder by /u/Dangerous-Maybe-8347 on 2025-06-22 13:07:55.

I need to buy a hdd for daily usage like watching movies,songs etc... in a recrimination room. So is it better to buy 2tb or 4tb? .im thinking if we buy a 4tb hdd it will worn out quickly because of frequent usage ,so much data writing and some people unplugging it wrongly.

705
 
 
The original post: /r/datahoarder by /u/Shlink0 on 2025-06-22 21:23:08.

I've recently purchased a 5 bay DAS (https://www.amazon.com/dp/B0CZL8KPLG) for some offline storage of old junk data, photos, and video footage. I currently have an old 8tb and 2tb drive, as well as 2x 4tb external drives to shuck.

I'd like to get 1 large (18-22tb) new drive for primary storage, and use all the old ones combined as 1 backup. (I'm hoping I can do this with the software "AnyBackup"). The important photos are also in the cloud, and in the future I'll probably get something like BackBlaze.

When I start to fill up the new drive, I can replace the smaller drives as needed.

I've been looking at drive prices for a while and would like to get something with a 5 year warranty from a long time seller.

The DAS I have says it's limited to 22TB, I don't know if that's accurate or not.

I decided to spend a little more $/TB to avoid MDD drives.

I've settled on this drive: https://www.ebay.com/itm/167551337467 and would like your opinion on if it's an adequate match for my setup.

Thanks!

706
 
 
The original post: /r/datahoarder by /u/PuzzleHeadPistion on 2025-06-22 20:23:56.

I have a TrueNAS system with the OS on a 128Gb SATA SSD and:

  • 1Tb WD Black SN750 NVME (PCI-e 3.0)
  • 6Tb WD Red
  • 6Tb Seagate Ironwolf
  • 16Tb Seagate Exos X16

And an Asustor Drivestor 4 for backup with:

  • 2x 8Tb Seagate Barracuda
  • 16Tb Seagate Exos X18

So, these drives were bought needs, system and deals at the time, but the only parity is in the sense that my TrueNAS is synced with the Asustor Drivestor 4. Both 6Tb drives are joined in a stripe pool. The 1Tb and 16Tb are in individual pools. On the Asustor side, both 8Tb are in RAID0 and the 16Tb drive is as single drive (even though the Asustor barely gains any performance from it).

I don't need more storage, but I want to move things around to get the most out of it. I was thinking of returning one 16Tb drive and getting 2 8Tb instead. This way at least the Asustor would be in RAID5 with 4x 8Tb drives.

Or fork out for one more 16Tb drive, move the 3x 16Tb into the TrueNAS as a ZRAID pool and the Asustor would keep 2x6Tb + 2x8Tb...

My main issue I think is that I have all drives in size pairs, not even one set of "three of a kind" or "four of a kind" to use more elaborate setups other than RAID0 or RAID1.

PS: I have a 2.5GbE network and I do take advantage of >280MB/s transfers from my desktop to the TrueNAS. The Asustor will remain as backup only, since it maxes out at 60MB/s and is less powerful for Plex.

707
 
 
The original post: /r/datahoarder by /u/VoNpo on 2025-06-22 20:19:19.

Hi,

I'm building a NAS for home use and I'm struggling with choosing an operating system.

I think this is a fairly neutral place to ask about this, although it will certainly cause debate and strong opinions in both directions.

I've used Linux as my main operating system for a few years now, so the terminal is not a spooky place for me, I've also built some bash scripts for my system.

I've used unRAID for a few years before, and I don't want it as my new operating system anymore. Long story short, it doesn't protect for bitrot, and if an error occurs, there's no information about what happened where and whether it was fixed or incorrectly written to the parity disk etc...

Although my use case is mainly a media library, I value data integrity very highly.

Transferring media from disks to NAS is a very time-consuming task and I don't want to do it twice!

The need is only for NAS use.

Docker, VMs, etc. are used on a separate server. (I don't want "All-In-One" box like unRAID was, I had too many unrecoverable system freezes etc because of apps and don't want to do these kind of "plug off" resets to my nas)

I'm struggling between Truenas Scale and Linux+Snapraid+MergeFS. At the moment I am leaning more towards the Snapraid system. The use is mainly as a media server, but also important data such as personal photos and files.

Planned structure:

Frequently changing and more critical data: -> ZFS Mirror (NVME or SSD)

Static data, such as videos and photos, etc.: -> Snapraid with 2x parity (HDD)

All data is first stored in a ZFS mirror pool, which works in the same way as the cache of the unRAID system. This provides real-time data protection, snapshots, etc. Data going to long-term storage is edited if necessary and sha256 sums are manually created for it using a script, so checksums can be checked later if necessary, for example when transferring to another system. The transfer to the Snapraid disks is done on a scheduled basis using a script (or manually if necessary), and the snapraid sync is run immediately after the transfer. This way, static data is not unprotected in the system. Important data, such as personal photos, etc. is easy to replicate to all data disks, so in the event of a disaster, the data is stored at 1:1 on multiple data disks. Of course, backups should also be in update, but that is another story.

On the other hand, the achievements of all this would be easily accessible directly via ZFS. The biggest problem with it, however, is poor expandability.

It seems unreasonable to buy small disks that meet current needs, for example 6x8TB disks for a RaidZ2 package, because these can fill up very quickly. On the other hand, for example, filling up 6x20TB can take years, so I end up paying quite a bit for unused space. The Snapraid system could be updated disk by disk, and the data protection is not even worse compared to the ZFS system, not to mention that in the worst case scenario, with ZFS, data loss is "all or nothing" situation. With Snapraid, losing all data due to disk failures is practically impossible.

I am also attracted to the idea of having all the settings in config files, so the system can be easily restored to exactly the way it was. For this reason, I have considered switching to NixOS on my desktop. If this seems usable to me, the NAS operating system could also be NixOS or alternatively Debian or Ubuntu server.

https://perfectmediaserver.com/ - this site gave me inspiration for this snapraid system.

Have you been in a similar situation, what solution did you end up with? Of course, opinions for and against are also welcome.

However, I don't deny that, ZFS is certainly a better system, poor expandability, and "All or nothing" in the worst case scenario are just such big minuses on my list that I have considered other systems. I know that the ZFS package can be expanded nowadays, but as far as I understand, this is not very straightforward.

708
 
 
The original post: /r/datahoarder by /u/zeroedit on 2025-06-22 20:08:22.

For those who are still using the non-WebExtension version of DTA!, have you noticed that the download speeds are MUCH SLOWER than just downloading directly through the browser? This is what I'm experiencing in multiple forks of Firefox (e.g., Basilisk).

709
 
 
The original post: /r/datahoarder by /u/KasMA1990 on 2025-06-22 18:52:06.

I'm looking to start ripping my movies to an external harddrive, and I'm thinking I'll have three identical drives in total, so I've got backups and the option of detecting and recovering from bitrot (or any other kind of corruption). Assuming I've got all three drives accessible over the network at any given time, I would want to use something like rsync (I guess?) to actually sync them up, but I really want a way to detect and recover automatically when a corruption occurs. Is there a good piece of software out there that does just that? Or maybe syncs files and does the recovery at the same time?

710
 
 
The original post: /r/datahoarder by /u/Kinder--Joy on 2025-06-22 18:49:36.

I have an old External HDD by trancend which died a few months ago and a pendrive. Whenever i plug them on to my TV they seem to be detected. Today i bought this HDD enclosure and put my internal HDD on it and tried to connect it to the TV and it doesn't detect it?

I first thought it was my enclosure's issue but i just tried to connect it to the PC via the USB. The computer detected it easily. Whats the problem

711
 
 
The original post: /r/datahoarder by /u/hd805 on 2025-06-22 18:42:26.

Has anybody tried to serve video from a raspberry pi NAS locally ; but practically speaking how many video feeds can someone go simultaneously before lagging starts to become apparent? assuming no transcoding.

712
 
 
The original post: /r/datahoarder by /u/hd805 on 2025-06-22 18:36:40.

has anybody attempted to pick up files from "stream only" sites like

the internet archive, especially for tv news archives from some cnn segments ?

713
 
 
The original post: /r/datahoarder by /u/docmartin101 on 2025-06-22 18:13:43.

Guy near me is sell his old pc for $200.

MB is MSI Z97A GAMING 7

Intel Z97 Express chipset

i7-4790k

32GB on board

raid on board but I would install new raid card

M.2 NVMe PCIe gen 2, fast enough for caching?

3 x PCIe 3.0 x16 slots, (support x16, x8/x8, x8/x4/x4 modes)

I would add raid card and 2.5G or 10G nic

HDMI on board GPU not needed.

ATX Case supports 8 drives.

PSU - EVA Supernova 1000p2 80 Plus

Might be worth it just for the case and PSU.

Pass or Play???

714
 
 
The original post: /r/datahoarder by /u/mc__Pickle on 2025-06-22 18:02:10.

https://archive.org/details/sizeofcat-website-archive-2023-08-012.tar

There's been a removal of a lot of articles on sizeof.cat site. If you have a later copy of the archive and don't mind sharing please upload it too.

715
 
 
The original post: /r/datahoarder by /u/DiamondCutter_DDP on 2025-06-22 18:01:28.

Heavy yes but it sure protects them well from damage. Feel it may be overkill. The drives and the enclosures costed me a lot. Anyone else use similar hard case when transporting their drives?

https://preview.redd.it/eugeah5jpi8f1.jpg?width=1414&format=pjpg&auto=webp&s=a098fe691f20322f02ccf9196ca1446b11789aaf

716
 
 
The original post: /r/datahoarder by /u/isavefilms on 2025-06-22 17:44:40.

I use LTO-6 to archive our work data. I'll often receive files via LTO as well. I just tried loading a tape and the LTFS Configuration tool keeps spitting out a "Invalid Class" error. It's never done this before and I can't seem to figure out a solution. I'm kinda screwed if I cannot use my LTO drive. Suggestions?

717
 
 
The original post: /r/datahoarder by /u/hd805 on 2025-06-22 17:41:05.

Hello guys,

What kind of tools can be of use for acquiring a "stream only" video for offline viewing?

such as

https://archive.org/details/CNNW_20250615_170000_Fareed_Zakaria_GPS

718
 
 
The original post: /r/datahoarder by /u/WaspPaperInc on 2025-06-22 17:08:16.

Hello everyone, this is my first time trying to preserve a website and i ran into this problem where image files doesn't seems to be downloaded but an empty folder with the image's filename is present.

I've searched online but can't find a similar case, i haven't checked the whole wget log file yet (it's a bit large) but everything i checked so far seems normal to me.

The WARC, CDX and even 7z are available at https://archive.org/details/stvkwarc_myduc20250619

Any help will be appreciated!

719
 
 
The original post: /r/datahoarder by /u/joostm8 on 2025-06-22 16:07:48.

~~So as the title says, I am installing some Toshiba MG08 drives (MG08ACA16TA) drives. My computer's SATA power connectors don't have 3.3V line connected, only 5 and 12 (It's an HP Elitedesk 800 SFF). Without 3.3V they don't spin up and are not detected, with 3.3V they do (I tested this by connecting another PSU that does have the 3.3V line on the Sata power connectors).~~

~~The drives themselves only list 5V and 12V power draw on them at 0.9A and 0.75A~~

~~I'm looking to just add a regulator from 5 or 12V down to 3.3V, but am wondering if these drives will draw much power from the 3.3V line and if a little LDO will cut it, or if I'm going to need a buck converter.~~

~~Anyone every encountered this before that can shine some light on the issue?~~

EDIT: so taping the 3.3V pin and testing with the USB to Sata adapter, the drives still spin up and show up, so looks like 3.3V is not the cause of the issue. I did measure the motherboard output of the PC with a multimeter to check that 5V and 12V are present, and they are. Also tested with a Sata SSD drive which did power up and show up. I'll go and test with some spare hard drives I guess, see if they work. Will post updates as I go along I suppose.

720
 
 
The original post: /r/datahoarder by /u/Straight_Random_2211 on 2025-06-22 15:50:55.

I recently bought a Transcend ESD310S 1TB portable SSD. It’s small, has a metal body, and includes both USB-A and USB-C connectors — it really resembles a normal USB flash drive.

This reminded me of something I used to do for years: I had a 256GB metal USB 3.1 flash drive from Apacer that I attached to my motorbike keychain. I carried it everywhere — commuting, going to school, work, road trips, even over bumpy roads. It handled daily vibration, stayed in my jeans pocket, was tossed onto beds (not hard surfaces), and even occasionally got slightly wet when I forgot to remove it before driving in the rain.

Despite all of that, it kept working perfectly. I never had any issues with it.

Now with this new portable SSD (Transcend ESD310S), I’ve copied a lot of data from both my laptop and my iPhone. I frequently access the data — it’s not just passive storage. I plug it into different devices regularly.

Naturally, I’d love the convenience of attaching it to my keychain like I did before, but I’m wondering if doing so — with the daily vibration from motorbike riding, regular handling, and occasional soft impacts — would eventually damage the SSD, or if this USB-style portable SSD are generally as durable as rugged flash drives.

I’d appreciate any input from people who’ve tried something similar — or know more about how durable these kinds of SSDs really are in the long term. Thanks!

721
 
 
The original post: /r/datahoarder by /u/happyMonkeySocks on 2025-06-22 15:09:56.
722
 
 
The original post: /r/datahoarder by /u/d2racing911 on 2025-06-22 14:53:38.

Hi everyone , I run a data scrubbing on my ds923+ with a raid5 setup.

One of my friends has a ds1821+ in raid 10, what’s the point to run a scrubbing job since it’s a raid10, I mean it’s a mirror.

How can the data scrubbing job can detect and correct errors since there’s no parity.

AFAIK, running a scrubbing job on a raid1 has the same result as running on a raid10 setup.

Am I missing something ?

Thanks for your input.

723
 
 
The original post: /r/datahoarder by /u/SnooLobsters1308 on 2025-06-22 13:57:31.

Best ssd based das or nas for video backup while traveling?

Hi all, I'm going to be doing a bunch of travel with lots of 4k video. Way more (hopefully) than I can fit on a 4tb external ssd.

I could buy a small mini PC or server (like minisforum ms-01, etc.) and load it with ssds, U2 drive. But, its heavy, hot, I'd need to find a monitor, expensive etc. etc..

The austore looks slow.

I will have a laptop, so maybe small multibay das would be best.

Anyone have any good recommendation for durable(will be traveling), small, stable, medium scale storage?

Thanks!

724
 
 
The original post: /r/datahoarder by /u/forwardslashroot on 2025-06-22 11:37:23.

Last year, I bought a Supermicro X10SDV-4C-TLN2F off Ebay to replace my failing NAS motherboard. I got busy with family and work and 1.3 years later I finally got a chance to work on my NAS.

The issue that I am having is when I connected the VGA to my HDMI monitor and/or TV via the VGA-to-HDMI adapter, all I see is a black screen with "No Signal" message. Then eventually, I could this where I can press Del to enter the BIOS. After this screen, it goes to No Signal again.

View on both IPMI and VGA to monitor/TV

When I factory default the IPMI, I noticed that the couple of minutes of No Signal on my monitor, it was actually something supposed to be showing up. This is what I see when viewing the bootup via the IPMI.

View on IPMI only

Is there a settings in the BIOS to allow this initialization to show up on the output of the VGA?

The BIOS is American Megatrends and the version is 2.3.

725
 
 
The original post: /r/datahoarder by /u/AccordingLeague9797 on 2025-06-22 09:55:27.

Been thinking about the challenge of preserving ephemeral content like instagram stories for personal archiving. These disappear after 24 hours, making them tricky to preserve for legitimate archival purposes.

Traditional methods like screen recording are time-consuming and quality-lossy. The 24-hour deletion model creates real gaps in personal digital archives - family memories, business documentation, research material just vanishes.

Found a few tools that help with systematic preservation. spybroski com allows downloading of stories before they expire, which is useful for archival workflows. No account needed so it doesn't interfere with the original poster's analytics.

What other methods do you use for preserving ephemeral social media content? Are there specific workflows that maintain quality while capturing metadata like timestamps and captions?

Instagram wasn't designed with long-term preservation in mind. Unlike regular posts, stories seem built for disposability. This conflicts with good archival practices where content should be preserved before it's lost forever.

Anyone found reliable methods for systematic preservation of time-sensitive social content? What about maintaining organization and searchability for archived ephemeral media?

The technical challenge is interesting - how do you archive content that platforms actively delete?

view more: ‹ prev next ›