It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
926
 
 
The original post: /r/datahoarder by /u/Remarkable_You_2870 on 2025-06-12 16:43:50.

I have a ThinkCentre mini pc set up as a Jellyfin server with 2 media sources: an external HDD and a internal HDD. I am using the internal HDD because I download torrents there and use symbolic links to map them to the layout Jellyfin requires , but now I am running out of space. I am considering moving the torrents to the external HDD so I can keep seeding and also using the media for Jellyfin, but I am not sure if that could put too much strain on the external HDD and reduce its life cycle. Is it a big difference to seed from an external HDD (connected via USB3) compared to an internal HDD (connected via SATA)?

927
 
 
The original post: /r/datahoarder by /u/NWSpitfire on 2025-06-12 16:30:48.

Hi all,

TL/DR; 56TB to backup. Expanding rapidly, cloud storage is too expensive. Currently have LTO 4 but wanted to buy second LTO4 drive as a backup in case my one broke. The curse of eBay browsing now has me considering LTO4/5 libraries but I don’t know what I’m looking for/worried about reliability. Do I just get another drive? ———>

I have had an LTO 4 drive for a few years and used it for archival backups and all has been well, it’s saved me a few times.

I’m now facing the prospects of trying to properly backup 36TB of Video data (plus another 20ish TB of software and family photos etc), however the video data is growing rapidly (they are airshow videos, so that 36TB is growing at near 512GB per airshow. Which can sometimes equate to 768GB to 1TB per fortnight/weekend during the spring/summer months).

If my math is correct it will currently cost me £216/month to backup to a service like Backblaze B2, and that will definitely go up as my data balloons.

So, LTO seems like a cost effective option and would suit me well seeing as I already have a drive and lots of tapes, and can get them in bulk very cheap.

So I thought I would buy a second LTO 4 drive in case my first one broke. I can get 2 drives in a 1U shelf for £140 with 99% head/unload life remaining etc.

An alternative for around the same money is LTO5 tape libraries. But I have no experience with these, what should I avoid? And are they reliable enough to buy second hand?

Are there any manufacturers to avoid, or ones to try and get? (Eg there is a brand new NEC T16A2 LTO4 for sale, but there is absolutely no documentation or drivers for this unit at all from NEC and most other websites), alternatively there is a Fujitsu Fibercat TX24 LTO5 for sale - not much info there either).

Others are Dell TL2000/HP MSL2024 or IBM/Overland libraries.

Any advice on what to get?

Price no more than £450. I should pay more but can’t for now. I’d like to go LTO 6 but it would mean my LTO4 drives cannot be written too, also the drives and tapes are still pretty expensive imo.

Part of me feels like I’m doing this all wrong lol. I’m worried about data loss.

928
 
 
The original post: /r/datahoarder by /u/flotaxy on 2025-06-12 16:02:19.

Hi there,

I've got two SN640 SSDs from WD. I'm trying for two years to get them to work. Last time I had them in an HP Gen9 server and got a red screen of death.

Today I tried them with an USB external board from Sabrent, they worked for like an hour and then crashed the system again.

Below is a screenshot from the CLI.

Does anybody here have an idea? Are the SSDs toast?

Thanks.

https://preview.redd.it/xnjd422fri6f1.png?width=2134&format=png&auto=webp&s=ad7de47bbe2a1be5743d809056e71dfa160f369c

929
 
 
The original post: /r/datahoarder by /u/operationcondor91 on 2025-06-12 12:28:07.
930
 
 
The original post: /r/datahoarder by /u/LonePonderer on 2025-06-12 12:21:29.
931
 
 
The original post: /r/datahoarder by /u/lonelyroom-eklaghor on 2025-06-12 09:38:27.

Ok, so I have got a 1 TB SSD with enclosure, which means that I can iuse it as an external drive.

Now, I can install an Operating System (Windows, Linux) here, as well as use it as a storage space. For that purpose, I'll be partitioning the whole space into two partitions:

  1. a whole ext4 part (for using a Linux OS)
  2. an exFAT part (for backups of my entire drive, can even be seen by Android)

The question is, how much to keep for the exFAT part?

I have a 130 GB /home directory (you might think of it as the D drive in Windows).

932
 
 
The original post: /r/datahoarder by /u/LuiGuitton on 2025-06-12 09:04:00.

As per title, is there any archives of data that's endangered (I don't know like books, websites full of knowledge etc, anything) and might get lost forever that I could torrent and seed back for the community?

No idea if it's the right place to ask and where I could find such things, so please bear with me and give me some guidance.

Thank you

933
 
 
The original post: /r/datahoarder by /u/inlinesix81 on 2025-06-12 08:34:52.

Hello everyone.

I like to burn files I don't use anymore/frequently on blu ray discs and keep them stored in dark and room temperature environment.

I also like to backup important things, like family pictures and so on, that aready are in hard disks but as I learnt here it's a good thing to store them in different technology media (optical vs magnetic).

I have two 5"1/4 burners at the moment, I don't like the laptop-kind ones. I'm worrying that in few years buying blu ray drives will became not easy and/or very expensive.

So: at the moment for like 70 bucks you can get a Pioneer BDR-S09 XLB/209 from ebay, seller is in china.

My main goal is to burn data discs, I'm not that interested in ripping movies and/or installing alternative firmwares. Anybody has some good advice for me?

thank you very much, and greetings from sunny Italy

934
 
 
The original post: /r/datahoarder by /u/djtron99 on 2025-06-12 08:28:47.

Do you prioritize same type of disks (All NAS drives vs. mixed drives, e.g., NAS+surveillance+enterprise+desktop) over storage capacity in a NAS?

My main n100 NAS is 4bay that runs 4 to 14hrs/day. My backup i7 5775 NAS is 6bay that is powered on as needed. Current hoard is around 23tb. Also have 8tb enterprise for offsite.

Would it be better to combine the 8tb and 6tb ironwolfs + 2x14tb WD elements/desktop, total of 42tb space in the main NAS for max space. Backup NAS with 8tb Skyhawk + 2x6tb ironwolfs, total of 20tb.

OR

Combine the 8tb + 3x6tb ironwolfs, total of 32tb space in main NAS for same disk types. Backup NAS with 8tb Skyhawk and 2x14tb WD elements/desktop, total of 36tb? Thanks.

935
 
 
The original post: /r/datahoarder by /u/_w_8 on 2025-06-12 08:12:08.

I've been doing some research on which hard drives to get for a new 3 or 4 disk zraid1 setup. Does anyone have any suggestions? I have both SAS and SATA controllers but SATA would be a bit more convenient as my internal hot swap trays are SATA.

HC550 16tb SATA $180 renewed with 3 years warranty. (goharddrive)

HC550 18tb SAS $210 manufacturer recertified (serverpartdeals)

HC550 18tb SAS $199 seller refurbished (serverpartdeals)

x20 20tb SAS for $210 renewed with 3 years warranty (goharddrive)

x20 20tb SATA $230 manufacturer recertified 2 year warranty (serverpartdeals)

new $195 x18 16tb SAS 3 year warranty (serverpartdeals)

new $240 x18 18tb SAS 3 year warranty (serverpartdeals)

new $250 x20 18tb SAS 3 year warranty (serverpartdeals)

936
 
 
The original post: /r/datahoarder by /u/MelodicRecognition7 on 2025-06-12 07:42:28.

I need an enclosure which allows full real PCIe v4 speed (PCIe v5 would be nice) and also has a good active cooling (I live in a fkng Sahara) so the drives would not throttle.

Is ASUS Hyper gen 4 any good? HP Z Turbo Quad? Noname chinese (JEYI, ORICO, etc)? Thanks in advance

937
 
 
The original post: /r/datahoarder by /u/FireBirdeez on 2025-06-12 05:55:46.

Hey there,

I've been editing this YouTube video for 3 months now and have started to work on it once again. I'm really excited for this project and have dumped sooo much freaking time into it. Earlier today, I accidentally permanently deleted the source file to half of the video I previously rendered. Since then, I have been trying to get the file back through qphotoreq_win, ffmpeg, and recuva. After some time, my file popped up in both Recuva and qphotoreq_win. With Recuva, I try to open my file in Windows Runtime Player, but an error message pops up and says it isn't ready to open. However, with qphotoreq_win, I found my deleted file, and it had the same amount of memory that it previously had. However, the video was now 5 hours long without showing a picture. I assume it's because my recovered .mov file isn't working in Recoverit. After all, it's missing the moov atom. Recoverit uses a sample file to rebuild that structure, but in my case, the damage is likely too deep or the sample didn’t match closely enough. The raw data is still there (file size is intact), but without a readable index or header, the repair software can’t reconstruct it into a playable file.I tried using Repairit by Wondershare, but whenever I choose the source video, I get to about 76% just for it to fail. Is there ANY way y'all could help me? This video was my baby, and I have been so upset ever since. If you guys have any solution, please let me know. If you need my deleted and un-fixed video and a sample video, I'd be MORE than happy to provide you with those if that's the case.

If you're at least reading this, thank you.

938
 
 
The original post: /r/datahoarder by /u/Background-Remote765 on 2025-06-12 05:08:39.

Hello all,

I wanted to ask if there is any large scale reddit data out there describing users as members of subreddits. I am wanting to essentially make a giant reddit graph showing which subreddits share the most users. Kinda like social network analysis for reddit but on a large scale lol. So looking for either a list of users per subreddit, or a large number of posts that I can extract a similar graph from. Are there any archives out there detailing this? Naturally, identifiable information would be scrubbed and just assigned an ID :). LMK what's out there! If anything.

939
 
 
The original post: /r/datahoarder by /u/muddy_dewlap on 2025-06-12 04:15:13.

Hi all! As the title says, I'm having difficulty archiving a single Outlook email thread that has hundreds of replies. I'd like to save all replies, & the following methods I've tried save either only the original email or only a handful of replies:

  • Downloading the original message as an .EML file
  • Printing the original message
  • Dragging the email chain into another email to save it as an attachment

I'm really at a loss here; maybe it's just not possible?

Any input & advice is greatly appreciated! =)

940
 
 
The original post: /r/datahoarder by /u/KingSupernova on 2025-06-12 03:49:21.

I want to back up all of my social media use. (Mainly Facebook and Twitter, also Substack, Discord, Reddit, and some others.) Most services offer a personal data export, but I believe these only include literally just *my* data; meaning that if I have a PM with someone, it'll only download the messages I sent, and not the messages they sent. This is not a particularly useful backup.

Is there a tool that can back up my profiles and chats more comprehensively?

941
 
 
The original post: /r/datahoarder by /u/AggressiveEmuSlut on 2025-06-12 02:29:35.

Just curious after I had my first ever failure in my server after 11 years.

I have 2 pools. One full of 11 year old HGST drives, one full of 3 year old Seagate Exos.

A 3 year old Exos failed, and the 11 year olds are chugging along totally fine.

Made me wonder. Is it just a total lottery if a drive lasts 3 minutes or 30 years?

942
 
 
The original post: /r/datahoarder by /u/Edie_T on 2025-06-12 02:24:37.

Apologies if this is redundant news: climate dot gov in danger of being taken offline?

https://www.linkedin.com/posts/craig-mclean-b377a563_major-us-climate-website-likely-to-be-shut-activity-7338563945437323264-KBOy?rcm=ACoAACNQdl8BkvzxHAU2n-g-eNZCtxM-ePg-Z2g

943
 
 
The original post: /r/datahoarder by /u/Ok_Block1784 on 2025-06-12 02:01:59.

Now they are going to shut down climate.gov

Just wanted to say thank you to people helping preserve public data they are trying to remove like they burned books in the past

Also thanks for anyone helping add more backups to what is being done here already

https://www.reddit.com/r/DataHoarder/s/fz4DMJNQ6h

Thank you 🙏🏻

ps. yes help seems necessary https://www.reddit.com/r/DataHoarder/s/XuM60SA0MY

944
 
 
The original post: /r/datahoarder by /u/AnswerGlittering1811 on 2025-06-12 01:50:57.

I am looking for a private LLM which can read my entire data and I can ask questions. The whole point of data hoarding comes to fruition when you have a notebook LLM like interface which can go thru and help me. Any thought on which one should I use? I am ok for one time pay as well as long as product is good. No subscription please and relatively easy setup.

945
 
 
The original post: /r/datahoarder by /u/awolfwearingabanana on 2025-06-12 01:18:10.

Hello! I have archived a bit over 1tb of LA protest/riot footage and I was wondering what is the best way in terms of ease of access and ease of hosting is to circulate it? If the answer is setting up a torrent I have no idea how to do that, and I would like some tips on setting it up. I am pretty technically knowledgeable and can probably figure out stuff. I just want to know my options. Thanks in advance!

EDIT: I will post it to the internet archive and create a torrent. I will post the magnet link when i figure it out. Thanks for the input!

946
 
 
The original post: /r/datahoarder by /u/itsphaser on 2025-06-12 01:11:37.

Currently looking for a 2-4TB hard drive for long-term storage, and I’m looking between WD Blue and Red drives. I plan on getting two, using one of them as a backup. I’ve learned here about RAID setups and such, but I feel that isn’t super necessary for me right now—-but I definitely want to keep it open as an option in the future.

So: What is the best drive for me? I‘m between the WD Blues/Reds, but also open to any other suggestions:) Which will best allow me to carry out my current plan, while still keeping the possibility to use the drive in a basic RAID setup when I am able to do so?

Also, I’m a total beginner, so would you consider this setup (using one of the drives as a backup) sufficient?

947
 
 
The original post: /r/datahoarder by /u/debellate on 2025-06-12 00:34:37.
948
 
 
The original post: /r/datahoarder by /u/mattbee on 2025-06-11 23:39:17.

This anonymous project deserves more attention than it's got - tapectl.

It's a tastefully-designed command-line tool for controlling LTO drives from Windows. It absolutely works. Unlike almost every other GUI tool I tried on Windows, it gets buffering right, so there's very little shoe-shining by default.

It doesn't do any archiving or cataloguing itself. So you need to feed it a .zip file (or several). But it'll just write and mark however many files you give it.

I'd nearly given up building a simple command-line tape workflow on Windows, so was really pleased to find it.

949
 
 
The original post: /r/datahoarder by /u/greenmyrtle on 2025-06-11 23:18:47.
950
 
 
The original post: /r/datahoarder by /u/Suspicious_Dig_5684 on 2025-06-11 21:20:38.

I am currently sitting on windows 10 with adaptec raid controllers with about 4 raid 6 arrays totalling in over 400tb so let's say 100tb each. Now with windows 10 coming to eol I am looking for other options. Would unraid be a good alternative for this and what would be a good way to connect all the drives. I don't think I want to stay with adaptec due to have 1 major rebuild it seems like once every year that leaves me on edge for months at a time since the arrys are so big.

view more: ‹ prev next ›