It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
976
 
 
The original post: /r/datahoarder by /u/RainAndWind on 2025-06-11 01:20:38.

Hey, so there's a collection of ps1 roms on archive.org, for archiving.

https://archive.org/download/psx-roms-archive

But, some of the RAR files can't be extracted by Windows 11, and give an error.

But they can be extracted by 7zip.

And when I try to re-compress the files with a single-threaded solid-block level-9 LZMA with a 3GB dictionary into a 7z... The file size is noticably bigger than the RAR which couldn't be extracted with Windows 11 natively. I can't think of how to make my own compression any harsher, yet it still loses out.

What's going on?

  1. What has happened to compress some of these ps1 games beyond my comprehension?

I really wanted to have native windows 11 extract support for archives I keep for myself. It isn't a dealbreaker, but what has gone wrong or right here to make these RARs so compressed but also not easy to extract?

977
 
 
The original post: /r/datahoarder by /u/losingitatinybit on 2025-06-11 00:27:14.

I am a university student and not really in a position to make a commitment to paying for a cloud service monthly. My current routine is transferring my iPhone photos to my 2TB HDD every month using the iCloud website and then deleting the photos from my phone (for storage); this leads to me only having one copy of all my photos.

Do I need to buy a new hard drive every 2-4 years to make a back-up? Or should I buy another one immediately?

I keep my hard drive in its original packaging in a cabinet so I hope that’s okay in terms of storage. I also read about printing photos out and making a photo album which is a unique solution which, in addition to some journaling, seems very worthwhile.

Any advice would be appreciated, thank you.

978
 
 
The original post: /r/datahoarder by /u/Ambitious_Promise_42 on 2025-06-10 19:54:12.

Hi everyone, hoping someone here can advise. I am helping my girlfriend with a very serious harassment case. An anonymous Instagram account, likely linked to a known individual, sent a threatening message involving a private video. We strongly suspect this account is connected to someone we know based on patterns such as burner numbers, previous stalking, and other incidents.

The account used a real email address and has a clear digital trail that we want to capture. We already reported this to Meta through their legal portal, and the NYPD has been notified. The process of getting Meta to provide the necessary logs, such as IP, device, and email verification data, is painfully slow.

Meanwhile, there is a risk that the account data could be wiped or become unavailable. We want to preserve everything as soon as possible and accelerate the subpoena or legal request if possible.

Has anyone here dealt with subpoenaing data from Meta? Is there any way to request expedited handling, ensure full data preservation, or engage with someone inside Meta to push this through faster?

Any tips on the technical or legal side would be hugely appreciated. This is an extremely sensitive and time-critical situation.

Thank you so much.

979
 
 
The original post: /r/datahoarder by /u/Schedule_Main on 2025-06-10 18:34:13.

Just released a new concept project: ResiFS – a decentralized file storage method using self-linking chunks and optional encryption. Designed to survive takedowns, eliminate reliance on seeders, and support replication across platforms. Feedback & contributors welcome

980
 
 
The original post: /r/datahoarder by /u/KrnlPaniq on 2025-06-10 17:49:35.

I have a 2 gigabit internet connection from Comcast, and overall it’s been great. I know that much of the internet's infrastructure isn’t really optimized for speeds above 1 gigabit yet, but I still frequently see download speeds exceeding that when running speed tests or pulling files from other websites so the internet connection itself isn't a concern.

Right now, I’m graduating, and my school is planning to delete everything in our Google accounts. So I’m using Google Takeout to back up my data. Fortunately, I only have about 400 GB to download, so speed isn’t a huge concern. That said, I’ve noticed that each ZIP file download from Takeout seems to max out around 900 Mbps.

For those of you with more data to back up, do you also experience this apparent throttling? Is there something I might be doing wrong, or is this just a built-in limitation...maybe some kind of QoS (Quality of Service) cap applied to individual Google users?

981
 
 
The original post: /r/datahoarder by /u/s4lt3d_h4sh on 2025-06-10 13:08:15.

Hey hoarders,

I'm planning a small storage setup redesign and would love some input on pros/cons or gotchas I might be missing.

My current setup:

  • NAS: Asustor AS3304T w/ 4x12TB HDDs using 2.5gbe
    • Getting too loud for my office setup
    • Occasionally freezes, requiring hard reboots
  • Server: Lenovo M80q Tiny w/ i5-13500T + 96GB RAM, running Proxmox
    • Soon to be replaced with a Mini-ITX 265K + 128GB RAM build, also on Proxmox
    • Main use: VMs for various services, light containers, and now planning to consolidate storage too

The Plan:

I’m considering retiring the NAS and going with an OWC ThunderBay 4 (connected via USB-C or TB), which would be passed through to a VM (either TrueNAS Scale or OpenMediaVault).

My motivations:

  • Simplify everything into one always-on server
  • Reduce noise (NAS fans + HDD vibration = unbearable now)
  • Fewer cables/connections (1 less Ethernet device, no separate IP, easier to backup/monitor)
  • Potentially better performance, since Proxmox + PCI passthrough or USB passthrough has been decent for me in other use cases

Questions & Concerns:

  • Reliability: Is passing through an entire DAS (e.g., OWC ThunderBay) to a VM stable for 24/7 storage duty?
  • Performance: Any bottlenecks I should expect using USB-C / Thunderbolt DAS vs a native SATA controller?
  • Drive management: Is SMART monitoring + spin-down supported properly in this setup?
  • ZFS compatibility: I’d like to use ZFS or maybe mergerfs/snapraid. Any issues passing a USB/Thunderbolt DAS to a ZFS-based VM?
  • Power safety: Any known risks with the OWC enclosures (sudden disconnection, standby quirks, power loss behavior)?
  • OWC SoftRAID: Is it possible to use the OWC ThunderBay 4 without OWC's SoftRAID software, and just present the drives individually to the VM?
  • Community opinion: Is this a downgrade from a NAS? Or just a different flavor of DIY homelab?

Would love to hear if anyone is running a similar setup and how it's held up over time. I value data integrity, silence, and ease of remote management.

Thanks in advance — happy hoarding 🧠💾

982
 
 
The original post: /r/datahoarder by /u/Logical-Economics-99 on 2025-06-10 07:24:41.

I'm considering getting into LTO-9 tape storage and was thinking about offering cold storage backups as a way to offset the cost of the drive. I'm imagining this would be for data where a few days of retrieval time is acceptable.

What would be a reasonable price point for TB/month that you'd be willing to pay for that kind of service?

I know there are a lot of details to work out – security, maintenance, retrieval times, incremental backups, etc. – I'm just trying to gauge feasibility and get a feel for what people would actually pay before I invest further.

983
 
 
The original post: /r/datahoarder by /u/Eskel5 on 2025-06-11 00:44:56.
984
 
 
The original post: /r/datahoarder by /u/spookyapk on 2025-06-10 22:13:06.

Hi there! Hope this is the right sub to ask this in.

There's a TV show I currently have files of— and seeing as it's not a version that is available on physical media or streaming, it's currently the only way to watch it.

Is there a recommended way to go about saving it (to a flash drive or something?) So that it can be plugged into and watched from my TV? Preferably nothing with a monthly cost/subscription based. I've considered uploading it to Internet Archive but don't know if it would get taken down for copyright. I've also considered buying BD-Rs and saving them there— is that even a viable option? Is a lot of equipment needed for that?

I've browsed some old reddit threads but I'm super lost and figured I'd come here since y'all are basically the experts. Thank you so much in advance! ❤️

985
 
 
The original post: /r/datahoarder by /u/Broad_Sheepherder593 on 2025-06-10 21:54:39.

Hi,

I already have a 4 bay, 30tb and 50% used so far. I'm looking to back this up in a separate location (321 rule) with another nas. So far, i only have 3tb of critical files then the rest are movies.

I came across a good deal for a used 224+ for only usd 145 (going out of business sale). Is another synology a good option? (Given their drive lock antics)? Was initially looking at the beelink ssd nas but the usd 145 for a 224+ seems a steal?

986
 
 
The original post: /r/datahoarder by /u/DiggsNC on 2025-06-10 20:16:53.

I sent a 14TB red pro back for RMA in early May. Tracking shows it was delivered to WD on May 13. The RMA case update page for my drive has never once been updated. I have disputed the RMA since they show no Tracking and the drive has not been received. I called over a week ago and the rep told me the drive would be shipped in 24 hours. I call again today, I was told my case has been escalated, and the rep refused to transfer me to a supervisor.

Is this common now with WD? I ask here because I could find a subreddit for WD and I know you guys are all about some storage. I have returned drives in the past without issue, and I really hope this is not a trend because I will admit I am a WD fan.

987
 
 
The original post: /r/datahoarder by /u/akiakiak on 2025-06-10 18:15:17.

Hi! I looked far and wide, and found some old thing and the OWC Thunderbay mini (which is not USB), so I'm looking to you for help.

I need an enclosure that fits 5 (or more) 2.5" drives, is completely silent when disks are spun down (fans turn off), and connects via USB3.

I want to reuse a bunch of old laptop drives for cheap storage, but also for fun. I don't have a lot of space, and I don't want to hear any noise when I'm not reading/writing the drives. Individual access (so I can use zfs) would be a very nice extra, and linux support is a must.

I'm open to alternative solutions that don't make a mess of wires, and need one wall wart for power at most. I found an endless stream of enclosures with SATA ports, which I could connect with USB adapters, but I couldn't figure out a way of powering those - all of this will connect to a low-power, fanless SBC, which can barely power a single drive with USB-SATA adatpters.

Thanks everyone, and happy hoarding!

988
 
 
The original post: /r/datahoarder by /u/AggressiveEmuSlut on 2025-06-10 16:52:45.

Hi guys, when I built my server 10 years ago I repurposed a GIGANTIC overkill CPU cooler I had laying around. And it covers my top PCIE slot.

I need to add another card into my server so now I need to buy a smaller cooler.

My server runs Truenas and is literally just file storage / transfers. Nothing else.

CPU is an 80w Xeon E3-1230 v5 Quad-core 3.40 GHz.

Any recommendations for something quality that won't break the bank and will give me my top PCIE slot back?

989
 
 
The original post: /r/datahoarder by /u/lastninja2 on 2025-06-10 16:09:42.
990
 
 
The original post: /r/datahoarder by /u/OwThatHertz on 2025-06-10 16:04:57.

I have kind of a massive collection of DVD and Blu-ray discs that I’d like to rip because our Blu-ray player is dying and a network drive is just a lot more convenient and accessible. I’m on a pretty tight budget, but I’d like to try to find an efficient way to get this done so long as it doesn’t break the bank. My target budget would be under $100, but cheaper is always better.

Searching this subreddit yielded projects like this one. While I’m no electrical engineer, I’m decent at soldering, have a 3-D printer, and have been building and upgrading my own overkill PCs for almost a decade. I would be comfortable putting together an enclosure like this if necessary. I’ve already got large USB hubs so, if I’ve understood that build correctly, all I would need is the drives and some USB adapters, and possibly to construct a basic enclosure.

Is this kind of set up the best path to inexpensively but efficiently rip my movie collection? What other solutions would people recommend on a sub-$100 budget? I probably don’t need as many drives as the post I linked because there’s no urgency to getting it done; I just don’t want to limit myself to ripping a single disc at a time.

991
 
 
The original post: /r/datahoarder by /u/Ldarieut on 2025-06-10 15:25:30.

I have a NAS server, with a zfs pool made of HDD and a SSD for vm & containers. I also have a remote VPS which is my main mailserver.

The zfs pool is under light use, to the point of the disks being spin downed most of the time. All the heavy lifting of the apps is done on the ssd.

family uses macbooks, sync their iphone with their macbook and timemachine to the zfs pool

I mount the remote mailserver with nfs on the nas and rsync maildirs to the zfs pool

I rsync music from the ssd to the zfs pool

I snapshot vms to the zfs pool

I save my pictures from my camera to the zfs pool with samba mount.

I use backrest/restic to daily backup the zfs pool to B2 (currently, only music and pictures)

I also have a restic job on the VPS to backup maildirs to B2.

Now, what is missing:

vm snapshots are not backuped (I think it's acceptable, it's already a backup).

timemachine is not backuped (maybe acceptable, would imply failure from the macbook and the NAS).

rsync are launched whenever I feel like doing it (not acceptable, I should script this).

restic is runing from different locations for the maildir (proper backup would be vps => nas => B2, not VPS => B2, VPS => NAS)

Would you make things differently?

992
 
 
The original post: /r/datahoarder by /u/wells68 on 2025-06-10 14:13:34.

Are you interested in collecting these old issues of the magazine, The Lawyer's PC?

The 1984 issue has these articles:

  • PFS:FILE Offers Easy-to-Use Database Management Alternative
  • The IBM PC Product Line: Considering Different Models
  • Additional Timekeeping/Billing Sfotware Vendors
  • Fire Protection for Magnetic Media
  • Publications Received
  • Bits and Bytes

I came across these issues while decluttering. I offer to ship them via USPS media mail at the cost of $5.38 for two pounds. They are in mint condition. (Issues from 7/15/94-11/15/94 have my initials written on the cover page.) Please DM me if you'd like them.

| LAWYER'S PC | Volume | Number | |


|


|


| | April 1, 1984 | 1 | 15 | | May 1, 1994 | 11 | 15 | | May 15, 1994 | 11 | 16 | | June 1, 1994 | 11 | 17 | | June 15, 1994 | 11 | 18 | | July 15, 1994 | 11 | 20 | | Sep. 15, 1994 | 11 | 24 | | Oct. 1, 1994 | 12 | 1 | | Nov. 1, 1994 | 12 | 3 | | Nov. 15, 1994 | Annual Software Directory | | | Dec. 15, 1994 | 12 | 6 |

993
 
 
The original post: /r/datahoarder by /u/Mush332 on 2025-06-10 13:28:13.

Im converting my setup from mac to windows and it has become the worst experience. Im in the process of converting drives to ntfs and while doing data transfers my pc keeps locking up and becoming unresponsive. I have 2 enclosures in a daisy chain. Owc 8 bay and owc 4 bay. While doing “backups” from exfat formatted drives to ntfs my pc keeps crashing mid transfer after a hour or so. I have sleep set to never and now set shut off screen to 3hrs previously on 5 min not sure if that was causing a problem. Has anyone else had this issue? Once im doing migrating data and all my drives are ntfs and not apfs or exfat will this stop or is there another cause. I have some programs installed that can read apfs and im not sure if thats causing an issue or its something deeper like enclosure problems or drive issues? Any help will be appreciated thank you!

994
 
 
The original post: /r/datahoarder by /u/NecessarySubject1442 on 2025-06-10 10:13:12.

been trying to seriously log my online casino sessions for patterns, rtp variance, specific game performance (slots, baccarat, craps). i'm talking win/loss, duration, specific bet types, streaks, bonus triggers, etc. right now it's mostly spreadsheets, but it's getting clunky. anyone else here track their play like this? what tools or methods do you use for efficient data capture and analysis? trying to optimize my tracking for better edge play.

995
 
 
The original post: /r/datahoarder by /u/TopdeckIsSkill on 2025-06-10 10:11:37.

Hi everyone,

I'm looking for some software to selfhost on my server to manage all my photos and videos.

I was looking for something that can automatically tag the photos based on the place and faces.

996
 
 
The original post: /r/datahoarder by /u/No-Line-3463 on 2025-06-10 09:17:07.

Hello everyone! I just built a free web app that you can compress your video files without loosing quality up to 2Gb per file. Its unlimited, no ads, no membership is needed.

I would be happy if you give it a try! :)

SquuezeVid

997
 
 
The original post: /r/datahoarder by /u/TomLakeCharles on 2025-06-10 07:50:25.

I was on a binge of crime movies and videos, and upon going to rewatch Kento Bento's content, I found that his video on the ¥300m heist was deleted (bullshit youtube content policies).

Now, I'm under the understanding that this subreddit is dedicated to the art of data hoarding as a concept, not to the data itself. As such, I must ask:

Where would I go on Reddit to find hoarded data?

998
 
 
The original post: /r/datahoarder by /u/nullrevolt on 2025-06-10 06:21:33.

I recently picked up a tape drive off ebay for long term storage of my most important files (HP Quantum 8-00976-04 LTO6 UDS3 Dual FC DRV ASM). I knew this was used so it may be bad, however the description indicates it as "used but working well." I have set it up as an external drive connected via fibre to a SCSI controller pci-e card.

My reason for thinking the tape drive may be bad is that certain commands such as mt -f /dev/st0 erase do seem to operate at first, however the terminal never prompts for another command acting like the previous command never finished. I've tried to use pkill -9 [pid] to kill some commands such as tar cvf /dev/st0 or mt -f /dev/st0 erase but this never finishes. This usually results in the following from mt -f /dev/st0 status reporting dev/st0: Device or resource busy. This is with a brand new LTO-6 tape, so I think the tape may be fine. I have successfully used the drive on a tape previously without issue.

I'm not sure how I can further diagnose a device like this. I can and am willing to provide any information which will be useful, I am just not sure what would be helpful at this time. I'm no linux pro, but I have been around computers my entire life both as a hobby and professionally (just not in a SysAdmin role : D ).

dmesg

[210342.366641] st 10:0:0:0: [st0] Error 30000 (driver bt 0, host bt 0x3).
[210342.366647] st 10:0:0:0: [st0] Error on write filemark.

lsscsi

[10:0:0:0]   tape    HP       Ultrium 6-SCSI   J5WZ  /dev/st0

E: This may just be me being dumb. I think I may have cancelled a tar being written, and just refused to reboot the system to clear the process. It seems to be working OK now, but if I experience more errors I will be back.

sudo tar --acls --xattrs --atime-preserve=system --ignore-failed-read -c -f - /SOURCE| sudo mbuffer -f --tapeaware -s 1M -m 2G -L -P 80 -o /dev/st0

999
 
 
The original post: /r/datahoarder by /u/Heavy-Amphibian-495 on 2025-06-10 04:48:00.

I have a spare PC that I want to run docker apps 24/7 like Immich and Nextcloud and other stuffs (as a sync/backup/files serving server)

I have 4 drives in total (ST26000NM000C 26TB) manufacturer re-certified from serverpartdeals.

And would like some advices on which raid config (or if to use raid at all).

For now I think a single 26 TB would be more than enough, so I figure that I would go with:

  • 2 drives in RAID 1

  • 1 drive as a primary backup

  • 1 drive as a secondary backup

If there is better configuration please enlighten me. Thanks

1000
 
 
The original post: /r/datahoarder by /u/soy_tetones_grande on 2025-06-10 02:53:30.

I have a X11SSM-F

I have an HP SAS 9205-8i (it's pcie 3 x8) which is connected to 8 HDDs

My free pcie slots are pcie 3.0 x4... But I believe x4 for 8 HDDs is more than enough and won't have any bottleneck.

I have 2x 125gb SSDs attached the motherboard SATA ports for my boot drive (mirrored).

So I want to add a New 2nd pool of 8x drives.

I'm wondering, would it be better to simple grab another HP SAS 9205-8i and use my last remaining pcie 3 x4 slot for the other 8 HDDs?

Or get a single 16i card and connect all 16 to pcie slot?

My initial thoughts after research:

  1. I've read that the 16i gets very hot.

  2. I'm assuming splitting the pools between different pcie slots on two separate SAS cards would also theoretically prevent bottlenecks? Since pcie 3 x4 is 4GB/s so 8 drives on each would be totally fine (~270 MBs x 8 = ~2GB/s).. where as 16 drives would push it to the max and maybe bottleneck.

  3. I also would think it's maybe safer to have both pools on Seperate expansion cards? If one expansion card was to fail, it won't take down both pools?

Downsides?

  1. I use up my final pcie slot

  2. more power consumption with ~10w per SAS card. But hey, I'm running 16 drives of spinning rust so that's like a drop in the ocean.

view more: ‹ prev next ›