It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
76
 
 
The original post: /r/datahoarder by /u/LichyBoy on 2025-07-31 21:00:23+00:00.

simple as with the UK laws rolling around to screw my ahh, i wanted to download the entirety of Rule 34 and e621 while keeping it neat and organised

77
 
 
The original post: /r/datahoarder by /u/TheCelestialDawn on 2025-07-31 23:23:30+00:00.

This will likely come across as a newbie question to a lot of people, but.. I have been holding off on learning to use this for MONTHS because it sounds so complicated. Like, why isn't it a simple downloadable program with a gui??

Please explain to me like I am five how to get it, how to use it and why it isn't a literal program that runs locally like one of the 1000s sketchy online youtube downloader/converter websites.

You can use stable diffusion a1111 terminology as analogy if that helps.

I will return the favor by helping others make sense of it if you can make me understand it. thanks, honestly. I am so tired of relying on online mp3/mp4 converters.

78
 
 
The original post: /r/datahoarder by /u/TotezCoolio on 2025-07-31 20:26:18+00:00.

Months that there was a post about it, is it coming, is tech getting there, does anyone know anything? I filled up 2x2 TB NVME is no time, I am looking at the 8 TB option, but honestly I'd prefer a 16 TB stick and later another one (as I already know what 7 TB data would go on the stick) - my PC is old (6700K) but good enough, and I do not plan to replace it until it works (then I will probably need a mac + pc with 128 GB RAM extensible to 256 GB later)

79
 
 
The original post: /r/datahoarder by /u/JaMi_1980 on 2025-07-31 19:19:16+00:00.

Hello,

many people store things on USB sticks, which often ends up with the sticks being damaged by incorrect removal or other things. We don't need to discuss that this is nonsense.

BUT would it be advantageous if these people at least used a regular SSD + USB-to-SATA adapter? It doesn't cost much more. But the data is also cached, and you have to eject the drive.

But if you look at it objectively, it does have some advantages in terms of the "failure rate." in comparision to a usb-stick?

Greetings

80
 
 
The original post: /r/datahoarder by /u/This_Pitch5195 on 2025-07-31 19:18:44+00:00.

this is a straw page custom website https://zegaldubu.straw.page/

i was wondering if there is a way to download it like how it is

81
 
 
The original post: /r/datahoarder by /u/IXI_Fans on 2025-07-31 17:35:16+00:00.
82
 
 
The original post: /r/datahoarder by /u/Heavy_Library6669 on 2025-07-31 14:54:36+00:00.

I'm going to purchase a Samsung DUO Plus USB stick and trying to decide between the 128GB and 256GB version. The 128GB is enough capacity but I understand that different capacity models may have different performance.

I'm looking at tests of the 128GB version and tests of the 256GB version but am confused by the results. The 256GB wins (sometimes by a lot) in the AS SSD Benchmark, Copy Performance Test, CrystalDiskMark Benchmark and ATTO Disk Benchmark tests. But the HD Tune Pro Benchmark test seems to singularly, and massively, favor the 128GB version. Why would writes favor the 256GB version in the other tests, but not that one?

I'm just going to be using this stick as a Ventoy platform (holding and deploying multiple ISOs for different Linux distros and Windows installs, as well as general file storage. Bleeding edge performance isn't necessary, but which would you recommend given the numbers you're seeing in those tests?

83
 
 
The original post: /r/datahoarder by /u/weisineesti on 2025-07-31 14:13:30+00:00.

Hey r/DataHoarder,

With permission from the mods team, I’d like to share an open source email archiving tool I’ve created.

So the backstory is that I run a small software company and all our contracts, financial documents and client communications are stored in Google Workspace emails. One day it struck me that what if we lost access to our Google Workspace due to some vendor abnormalities (which is not rare).

So I built this open source tool that helps individuals and organizations to archive their whole email inboxes with the ability of search. I think this might be of interest to the DataHoarder sub, so I will share it here.

The tool is called Open Archiver, and it is able to archive and index emails from cloud-based email inboxes, including Google Workspace, Microsoft 365, and all IMAP-enabled email inboxes. You can connect it to your email provider, and it copies every single incoming and outgoing email into a secure archive that you control (Your local storage or S3-compatible storage).

Some features:

  • Initial import (import all existing emails from each email inbox)
  • Back up the whole organization's emails: For Google Workspace and MS 365, Open Archiver can import and sync all individual inboxes' emails
  • Full-text search: All archived emails and attachments are indexed in Meilisearch. You can search all emails and attachments from Open Archiver's web UI
  • Store your archive in local storage or S3-compatible storage providers
  • API access

It's open-source and free to use for personal and business purposes. I'd be happy if you could give it a try and give me some feedback.

You can find the project on GitHub: https://github.com/LogicLabs-OU/OpenArchiver

84
 
 
The original post: /r/datahoarder by /u/ptbeam on 2025-07-31 10:44:25+00:00.

Hi all, 

I recently purchased an internal hard disk (WD Red Pro NAS Hard Drive 10TB, SKU: WD103KFBX) but I have not managed to install it. The idea behind the purchase is to create regular “offline” backup copies of all my photos on this HDD and then hide it in a separate, secure location. 

I tried to connect it directly to the motherboard of my HP Z240 workstation via SATA and then also tried using an external HDD docking station (Tecknet UD02, USB 3.0). Unfortunately, it did not work. The hard disk is detected but when I try to “initialize” it via Disk Management in Windows 11, I get an initialize failed error message.  

Could it be that the HDD is specifically aimed at NAS systems or to be used in RAID and is therefore not suitable for my home PC? Could this be an indication that the HDD is damaged? I bought it directly from WD because I assumed the packaging was going to be great and instead it was placed in a simple cardboard box with very little protection.  

Sorry if the questions are dumb but I am running out of ideas...

Thanks!

85
 
 
The original post: /r/datahoarder by /u/Lartistoooo on 2025-07-31 10:27:20+00:00.

Hello, I need help interpreting a Victoria scan of a new hard drive.

https://preview.redd.it/g6y6mn6ds6gf1.jpg?width=1918&format=pjpg&auto=webp&s=4175c50c0817ef91fdfba45a361bcec3fffa33d3

Model: Seagate Expansion 4TB external hard drive, new.

Hard drive delivered directly in its retail packaging. Two corners of the box are slightly damaged (a few millimeters), and the blister pack is slightly torn, but not serious at first glance.

The drive will be used for occasional dual backups.

This is the first time in my life I've run a scan like this, and after searching online (+ chatgpt), I found conflicting interpretations, namely:

25–100 ms:

Source A: "Slow, keep an eye on it" (even though that's the majority of my points 😄)

Source B: "acceptable for an HDD".

100–250 ms:

Source A: "Too slow for a new drive"

Source B: "Abnormal, but rare (18), but keep an eye out"

250 ms – 1 s:

Source A: "Very slow or future problem, possible unstable sector"

Source B: "Slow, but rare (only 1), not yet serious."

Could you please advise me on the best course of action?

To determine if I can keep the drive and consider it to be in reasonable condition? Functional?

Thank you very much.

86
 
 
The original post: /r/datahoarder by /u/DukeZogzog on 2025-07-31 08:02:08+00:00.

Hello everyone,

I just acquired a Dell EMC DD3300 second-hand and want to reconfigure it from scratch.

The current OS sees the disks as VMware Virtual_disk, and one disk is stuck in Unknown, so the filesystem won’t expand.

The system currently runs Data Domain OS 7.3.0.5, but it behaves like a DDVE install.

I don’t have access to the official Dell ISO (no support contract) and need a clean DDOS image for DD3300 to reinstall it properly.

This is strictly for lab/test use.

If anyone has a clean ISO or clone from a DD3300, would you kindly share a link or DM me?

Thank you a lot in advance!

https://preview.redd.it/rolqakrg26gf1.png?width=1884&format=png&auto=webp&s=443cff0405cbe4b037397c3de35a1376b84ef204

87
 
 
The original post: /r/datahoarder by /u/WelderHorror4353 on 2025-07-31 07:28:39+00:00.

Some academic courses host their videos on private Vimeo accounts, making it impossible to download using conventional and unconventional methods.

I've tried using ffmpeg, yt-dlp, and other programs but none have worked since Vimeo's last update regarding privacy.

However, the solution is simpler than it seems; you just need to use a browser extension that adds the ability to download the video from within the academic page.

https://preview.redd.it/rji7v6h8w5gf1.png?width=1012&format=png&auto=webp&s=fbec1217d0ce9904c0730f6271c01fd9c8439fce

The following extension in Google Chrome has worked for me: https://chromewebstore.google.com/detail/descargar-videos-de-vimeo/mnngggofppeppickpphoggglkpnkgkjg

88
 
 
The original post: /r/datahoarder by /u/darrenpauli on 2025-07-31 16:09:51+00:00.

Hi folks,

I'm not the sharpest tool in the shed - but it's a serene life in its own way - and it seems all the guides and Synology disk calculators in the seven corners of the net can't help me. AIs even less since they appear as ignorant as me but with more conviction.

So it's with much reluctance I bother you with my peasant's setup. Who knows, maybe it'll bring fond memories of your entry into datahoarding. That or PTSD.

I'm after recommendations to maximise space on my mixed drive Synology 5 bay NAS.

I'm prepared to:

Consider all the data on my nas (which may over the long term consume all my potential available space) as expendable, and back up small amounts of config docker data and valuable errata to cloud and local / offline. I'm prepared to wipe the drives now and have backed up everything I need.

But I'd much prefer:

To sacrifice a small portion for SHR redundancy (unless this is stupid {it's stupid, isn't it?}) and maximise usable space.

Because research is for other people:

I recently bought a 16tb drive rather than 2x 8tb and now can't shell out for a new drive, at least anything more than about AUD$100ish/$US70ish which at current market prices means I'm stuck with what I have for a while. A long forever while.

What I have is:

A 5 bay Synology 1019+ NAS running largely as a media server, but will house Home Assistant. All apps run in docker via docker compose and configs, with it all backed up.

HDDs in SHR btrfs:

16tb refurb'd WD Ultrastar (2021)

2x 3tb WD red (2015 but active in the Nas with low use for say 2 years tops)

2 X 1tb WD green (2015, same usage as the red) (I tried to WDIDLE3 it years back but couldn't).

500gb Dell enterprise from 2011 I probably found in a bin.

For a few years I ran the setup minus the 16tb without issue. I've not run the kind of disk checks you'd all recommend to ascertain health, and can only say here and now that Synology's storage manager GUI gives me an over confident 'healthy' signal.

I've in many years past had to rescue data (a freezer was involved if memory serves) I'd brazenly shoved into new disks before I learnt about failure rates, so I take Synology's 'healthy' with a grain of salt.

But let's for arguments sake pretend they are all ok, great, in fact, or at least ok enough for a peasant like myself.

This week in a bid to avoid asking you folks I listened to all the AIs tell me to replace a 1tb with the 16tb which would maximise space. They said choose repair, not replace, after swapping.

So right now I have (in disk order):

500gb 3tb 1tb 3tb 16tb Still in SHR.

My total capacity according to Synology is 6.8tb.

I'm doing great, aren't I. Between following the advice of hallucinating Markov chains to inserting mismatched eco, red, and rubbish bin drives in random order, I think I've made my case to be a mod here rather confidently.

I kinda feel like I'd wear JBOD like an expensive tailored suit at this point with SHR not wanting to go anywhere near me and my dusty (did I mention the dust?) disks.

But hey, Gemini says I did a good job and all I need to do is wipe the drives and I'll get almost all the available space. What could possibly go wrong?

Yours in perplexed serenity,

Darren

89
 
 
The original post: /r/datahoarder by /u/disastorm on 2025-07-31 14:56:24+00:00.

I don't know much about the different types of drive setups and whatnot, but what would the best solution to a relatively quiet drive be other than SSD which would obviously be the quietest.

I currently have a 3TB Seagate Barracuda from 2019 as my general storage in my pc, if i wanted to replace it with like a 8-12TB drive, what is the best option if i want it to be no louder than my existing Barracuda? It sounds like the enterprise drives tend to be louder?

Is WD Red maybe the best solution for a quiet large HDD? Or what about Blue?

Or perhaps is just using a NAS with an enterprise drive stored somewhere where the noise doesn't really matter a good solution?

Are there any other solutions? I know windows can kind of turn off drives when they aren't in use, but they still randomly spin up so I usually don't rely on that.

Also in terms of usage, it will basically only be used for storage of files and media, and perhaps streaming back the media such as videos. It won't be actively running any games or applications.

90
 
 
The original post: /r/datahoarder by /u/Legal_Ad_1096 on 2025-07-31 14:09:59+00:00.

Hello,

I have a lot of family and childhood pictures contained in various old devices (computers/phones). I would like to extract them and take advantage of this opportunity to create a centralized and easily maintainable digital photo library. Until then I didn't have any centralized way to store my pictures. My goal is really to create a digital photo library that will last on the very long term (my life basically, I am 25) and that I will continue to fill with new pictures. I precise that I am not talking about professional pictures taken with high quality cameras, I am talking about family pictures, events pictures, taken mostly with a phone and that don't need any editing.

What I plan to do is to store all my pictures in folders. I don't want to rely on any photo library software and data base because software can be discontinued and add to much complexity. I don't think it is future proof enough.

I precise that I want my photo library to be OS independent so I think using only simple folders is perfect for this.

I don't think that the "date created" and "date modified" of the pictures is a reliable way to remember when the pictures where taken because often when you move the files or switch between OS these info get overridden. So, I have two choices here: either I do a file structure /YYYY/MM or even /YYYY/MM/DD; or I put all the photos in a same folder but rename them with the date taken (with a script): YYYY_MM_DD_HH_SS.jpeg. For this I would need your input, what do you think is the best practice?

Regarding ways to say which pictures are associated to an event (wedding, birthdays...), I plan to keep info.txt files in the files structure to provide descriptions to group of pictures.

According to you is this a good way to organize my photo library in a robust and future proof way? Or am I missing something?

I precise that this post is not about how to backup my photo library and on which medium I should store it. It is about which file structure I should use or which tools I should use to make the photo library. Regarding the backup I will save the library on the cloud and hard drives.

Thank you!

91
 
 
The original post: /r/datahoarder by /u/Undecided79 on 2025-07-31 13:23:31+00:00.

Books, newspapers, film, even rock inscriptions. All should be done simultaneously

92
 
 
The original post: /r/datahoarder by /u/PsychoticBinary on 2025-07-31 12:54:55+00:00.

As the title says, I have a lot of short videos, mostly from vacations or product videos. I don't really need them as shorts but I don't want to loose the media as well. I tried to collate a couple of them into one long video (aprox 3h) but from a total of 30ish gb, the new generated video is 47gb (using wondershare filmora). Is there a way to collate them without loosing much when it comes to quality?(most of them are 1080p). As I said, I don't mind cutting the new video if I will need some part in the future, but as they are now, a lot of space is wasted.

93
 
 
The original post: /r/datahoarder by /u/DisneyVader on 2025-07-31 11:24:08+00:00.

im new to a lot of this so when i got my Unraid shares and my Libredrive working i just started ripping my entire collection...

i now realize this was a mistake... most of my media files are just in one giant folder... when i learned Makemkv could create new folders based on the name of the disc i started doing that

but now im working on getting Plex / Jellyfin and possibly an Arr stack running and these services expect the files in individual folders with name and year... and files with similar naming scheme...

so my question is... is there a recommended way to automate this process or do i need to manually work through 22TB worth of media? :(

AI clients tell me to just use Radarr but that doesnt seem to be working or im just doing it wrong... any help is much appreciated

94
 
 
The original post: /r/datahoarder by /u/didyousayboop on 2025-07-31 08:19:30+00:00.

If you’re a frequent user of this subreddit, you will probably not find this guide useful for yourself, but you might find it useful for sending to friends or family members who don’t know the first thing about backing their files up.

I debated adding a section on end-to-end encryption and Proton Drive, but I wanted to keep the guide as short as possible. Perhaps more importantly, I would not encourage beginners to use Proton Drive because end-to-end encryption limits your account recovery/data recovery options and increases your risk of data loss.

95
 
 
The original post: /r/datahoarder by /u/bitesized314 on 2025-07-31 07:59:36+00:00.

Hey guys I'm recovering from a data failure, I had a drive going out and I moved most of the content, the drive came back I made another copy because some files were corrupted. I have 3 or even 4 copies of some files, because I decided my way to goi through thousands of pictures and videos was to move them to one folder sort by largest and zoom in to the the previews. Unfortunately, this hasn't made much of a dent. I have some Only fans content with watermarks I want to be able to find that type of content and move it into a specific area or delete them. Any suggestions?

Sorry if this is the wrong sub. I'vw tried some duplicate file checkers , but they always have issues thinking two files must be the same if they are the same size or if they erroneously have the same file name.

96
 
 
The original post: /r/datahoarder by /u/Nerdy_Metalhead on 2025-07-31 07:18:29+00:00.

Hello everyone. I used to put all my college files and open files on an external HDD. one day it just stopped working, when I connect it my computer didn't recognize it (I switched computer, changed the cable still nothing) i went to a tech store and asked them to fix it. They said it's over there's no fixing it..... there's a hardware issue with it, and if I want to retrieve files they will retrieve items 1 magebyte at a time and it will cost me a lot. So I lose all those files 😢 question is: I want to achieve my current work and SSDs are expensive and im sacred to gamble with HDDs in case I lose my work AGAIN. What can I do???

97
 
 
The original post: /r/datahoarder by /u/marjoriemu on 2025-07-31 06:11:49+00:00.

With so many sites, forums, and niche communities disappearing or getting gutted (looking at you, Reddit API changes, Tumblr purges, and old forums going offline), wouldn't it be great if there were a community-driven project to archive the internet that was? Think GeoCities, early YouTube, Flash games, fanfiction sites, even obscure blogs. A sort of "Dead Internet Archive" that mirrors lost content before it vanishes forever.

Could use tools like ArchiveBox, wget, and IPFS. Maybe even pair it with a tagging system to make stuff browsable. Anyone else interested in something like this?

98
 
 
The original post: /r/datahoarder by /u/ShootNClimb on 2025-07-31 04:19:32+00:00.

I am trying to tie 4 14tb drives in a drive cage to my mini pc using oculink to sata for data and and 4 to 1 sata power cable but unsure how to power the drives. What would the safest most compact way to go about it be?

99
 
 
The original post: /r/datahoarder by /u/AmpleFocusYT on 2025-07-31 03:36:56+00:00.

How reliable are CDs/DVDs as a form of media for data storage?

I have a stack of unused CDs (700MB) I got from my uncle some years back. I’ve only used a few of them for file testing and offline music for the car. Perhaps I can put copies of photos on a few of them? I already have an external hard drive and several loose internal hard drives, all of which have plenty of data already with some room for more. I just kind of want to use these CDs. lol

P.S. I’m a somewhat novice to data hoarding

100
 
 
The original post: /r/datahoarder by /u/wanhanred on 2025-07-31 02:47:34+00:00.

Hi all. I’m looking for 2 bay das enclosure for my 2 hdds that are not too expensive like the ones from yote. I don’t need any raid setup since I am bringing these hdds from place to place. I searched for it online but what I found are 2 bay for nas. Any budget-friendly suggestions? I also prefer type c connection. Thank you.

view more: ‹ prev next ›