It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
26
 
 
The original post: /r/datahoarder by /u/feral_poodles on 2025-07-08 21:10:26.

I backed up all of my external drives onto a single 5 tb external APFS hard drive that is connected to an M1 Macbook pro. I'm wondering what the most efficienct way is to find and remove duplicate files.

27
 
 
The original post: /r/datahoarder by /u/random-factor on 2025-07-08 20:18:46.

I want to upgrade my file server but I'm not sure how to get there with ports/drives etc. I know I can upgrade the pool size by replacing drives one by one but that will not get me to the double parity. If I want that I need to create a new pool but only have 6 sata ports to work with.

The file server uses an n100 board and while it has a pcie slot I understand it to be very slow. Is the best plan to get a pcie sata card for building the new array then move that to the motherboard ports once finished?

Ancillary question is do I really need double parity? This is for a media server and I could conceivably reaquire all the media but it would be a large investment in time and bandwidth. Currently I have 11tb of media and am going to try and upgrade the quality of much of what is saved.

28
 
 
The original post: /r/datahoarder by /u/EagleMajestic8334 on 2025-07-08 19:47:51.

I'm. Looking to get new nvme disk, between 1tb and 2tb (desirable), catching for nas, so endurance is deal breaker.

I been looking for wd sn700 for some time, but those fuckers rised the price just before Prime days. I'm not gonna pay that rise.

Looking for a $200 budget. Gen3 or 4. To be paired with ts-664

Any advise?

Regards and happy hoarding.

29
 
 
The original post: /r/datahoarder by /u/thinvanilla on 2025-07-08 19:30:37.

Found someone selling a used WD100EFAX for £87, that's £8.70 per terabyte which is pretty good in the UK but no warranty obviously.

Actually the seller has a pic of a white label WD101EFAX but says WD100EFAX in the description and they haven't answered whether the pic is the actual drive yet, but they're both basically the same apart from the 101 being air filled and the 100 being helium filled.

I've read up on the drive and it seems kinda old and from the time period where WD wasn't being honest about their specifications?

I don't really need it but I guess I could just use it as a third backup drive and then put it in an array later on when I've got one. Otherwise it just seems like an extra drive for no reason that could fail within a couple months and become an expensive paperweight.

30
 
 
The original post: /r/datahoarder by /u/dunnbass on 2025-07-08 18:51:26.
31
 
 
The original post: /r/datahoarder by /u/-Istvan-5- on 2025-07-08 18:15:00.

Been planning a building a new server the past few weeks but the drives I was looking at went from 280 to 290 2 weeks ago, and now jumped up to 320.

I assumed prices usually trend down over time... Not up.

Are we just seeing a temporary spike?

I'm guessing I will just wait it out and see when they inevitably come down again

32
 
 
The original post: /r/datahoarder by /u/thumbsdrivesmecrazy on 2025-07-08 16:35:34.

The article explains the reasons to switch from using traditional USB flash drives to an M.2 2230 SSD in a compact enclosure.(Satech Mini NVMe SSD enclosure used as an example) and explores key benefits of such SSD enclosure as a reliable and high-performance alternative to traditional USB flash drives for portable storage needs: 5 reasons why an M.2 2230 SSD has replaced all my flash drives

  • Superior Heat Management

M.2 2230 SSDs in enclosures dissipate heat more efficiently than typical flash drives, reducing the risk of overheating and potential data loss.

  • Greater Storage Capacity

These SSDs offer much higher storage capacities compared to most USB flash drives, making them ideal for carrying large files or backups.

  • Upgradeable and Replaceable

Users can easily swap out the SSD in the enclosure, unlike flash drives where the storage is fixed. This flexibility allows for simple upgrades or replacements as needed.

  • Faster Data Transfer Speeds

M.2 2230 SSDs, especially when paired with a USB 3.2 Gen 2 enclosure, deliver significantly faster read/write speeds than conventional USB drives, improving productivity for tasks like transferring large files or running portable applications.

  • Cost-Effectiveness Over Time

Although the initial investment may be higher, the ability to reuse the enclosure with different SSDs and the improved performance make it a cost-effective solution in the long run.

33
 
 
The original post: /r/datahoarder by /u/BobAtStarbucks on 2025-07-08 16:02:42.

I have an ITX build with a Asus ROG Strix B850-I MOBO, and both NVME slots are occupied.

  • 2TB for OS and apps (including Unreal Engine and Visual Studio)
  • 2TB for DATA storage

My work situation has changed to WFH recently, and I'm going to need some extra storage. I want to know if I should get an enclosure for the new WORK NVME 4TB stick and plug it into one of the Thunderbolt port on the back IO, or replace my internal DATA NVME 2TB stick so that it is "on the M2 of the MOBO" - I clearly don't know if this will make a difference to read/write speeds for Unreal.

This WORK NVME will be storing my Unreal projects and any relevant files. Unless it'll somehow be better if I install Unreal and VS studio to compile and run on this stick as well.

I got the idea of using an external NVME with an enclosure from reading up some video editor's workflow, where they store raw footage on the external, and edit with apps installed on the internal NVME.

Also for the Asus ROG Strix B850-I, I have 1X 10Gbps USB-C and 1X 20Gbps USB-C port. Is there one that I should use over the other?

34
 
 
The original post: /r/datahoarder by /u/youreadthiswong on 2025-07-08 15:31:27.

Hi guys, i would like to buy a new hdd that will replace my old 1tb hdd and i will move a lot of my stuff from to this new drive. I would mostly store game installers, games that don't require fast a fast ssd, archives, movies, tv shows music and i'd like to know which type of hdd to get. I know there are mainstream ones like Barracuda which i have 2 of, one 1tb and other is 2tb and also i know there are NAS and Ironwolf ones from Seagate if i'm not mistaken but i have no clue which one would be best fit for my needs. Also should say that i inteded on buying a 8tb drive since i've seen that at the time of checking prices an 8tb Barracuda was cheaper than the 6tb alternative

35
 
 
The original post: /r/datahoarder by /u/MainAdditional1607 on 2025-07-08 14:56:44.

Is your ORICO 6558US3-C showing up as using a using a "jms583gen 2 to pcie gen3x2 bridge" controller in linux? And have you come to the conclusion that this usb 3.0 5 bay external hdd enclosure is not in fact a nvme storage solution?

That's because thanks to a fuck up on the firmware they are shipped with the usb id is 152d:0583 which corresponds to this! https://devicehunt.com/view/type/usb/vendor/152D/device/0583

Naturally you probably attempted to correct this issue and looked for a firmware update on ORICO website only to find you can eat shit cause there isnt one? Well no more here is the solution for you!

  1. Download the firmware update from here because its only on the chinese site

https://www.orico.com.cn/download.html?skeyword=%E5%8D%95%2F%E5%8F%8C%E7%9B%98%E4%BD%8D%E5%BA%95%E5%BA%A7%E7%A1%AC%E7%9B%98%E7%9B%92%E4%BF%AE%E6%94%B9%E4%BC%91%E7%9C%A0%E6%97%B6%E9%97%B4 2. Open the zip and copy "JMS567_578_╔Φ╓├╨▌├▀.zip" from folder "╡Ñ┼╠╬╗-╦½┼╠╬╗║╨╕─╨▌├▀╩▒╝Σ" 3. copy "JMMassProd_Tool" to your desktop IMPORTANT THE SOFTWARE WONT WORK IF YOU HAVE INVALID CHARACTERS IN YOUR PATH 4. Next copy 567B Orico PM v100.5.2.0.BIN from "【只改休眠时间不用管】需要出厂bin固件可以打开这个文件" to your desktop 5. COnnect your bay and run JMMassProd2_v1_16_14_25.exe 6. click "RD Verison" and enter "jmicron" as the password 7. Click "Firmware Update" and then "Load F/W File" and open "567B Orico PM v100.5.2.0.BIN" 8. In the top right set "Standby Time" to 0 9. Under "Execution Settings" make sure "EEPROM Update" is selected 10. On the bottom left side select the corresponding port for your enclosure 11. Select the eclosure in the bottom table and click "START" 12. Finally after it says "PASS" unplug the enclosure from both USB and Power for 10 seconds. 13. Reconnect to your computer and it should now show firmware "100.5.2.0" 14. Connect to Linux and run lsusb it should now identify as "ID 125f:a578 A-DATA Technology Co., Ltd. ORICO USB Device"

Big thanks to https://winraid.level1techs.com/t/jms578-usb-to-sata-firmware-update-remove-uasp-and-enables-trim/98621 for the final step to unplug afterwards

36
 
 
The original post: /r/datahoarder by /u/johnnydotexe on 2025-07-08 14:48:25.

Currently looking at options (and learning) to get a 4bay NAS, which will be used solely as an SMB destination for data and image backups (both scheduled and manual).

For years I've just used Buffalo single-disk NAS devices, but they're not that great and seem to have issues or fail entirely after only a few years so I'm on #4 and it's starting to have issues. Not to mention the obvious downside of there only being 1 disk, so no failure tolerance.

What I'd like is a 4bay NAS, that I can throw 2.5" or m2 SSDs in, that I can set on a shelf by my desk (network/power available)...so this means it has to be a traditional desktop NAS enclosure, no re-using an old computer or a decommissioned rackmount server.

On to my questions...

  1. It would seem the $500~ is pretty much the entry price for a 4bay diskless NAS enclosure. Is this accurate?
  2. Given my use case...no containers, no plex/media, etc...what brands or devices should I be looking at?
37
 
 
The original post: /r/datahoarder by /u/YankeeMoose on 2025-07-08 13:54:27.

Greetings fellow data hoarders;

This might be an extremely stupid question, and I apologize in advance, but I'm looking for legitimate advice.

With the Stop Killing Games initiative going around, and the news I saw about EULA's stating to destroy copies of games once service ends.

( https://www.notebookcheck.net/Ubisoft-EULA-demanding-consumers-destroy-delisted-games-adds-fuel-to-Stop-Killing-Games-movement.1053106.0.html )

It got me thinking, would it be viable to get a large enough external storage solution to mass download all of the games across the various storefronts we use at our house? Between my partner and I, we've collected about 1500 games and I would really prefer not to lose access.

I'll take any suggestions or advice y'all might have, and thanks in advance.

38
 
 
The original post: /r/datahoarder by /u/sabotsalvageur on 2025-07-08 12:29:17.

I have been presented with a challenge. I was given an old drive to attempt to recover pictures from it; it's a FAT32-formatted hard disk from an old Windows 7 system that crashed way back in the day; I have a .iso of the disk, tried using Autopsy to recover what files I could, only got some text content out of it. Does software exist that would assume a block of memory addresses in a moveable window is image data, then attempt to parse that data as pixel values in a trial-and-error basis? So far I've gotten about 100kB of email addresses from a disk image that occupies 16GB, and the pictures are the real prize

39
 
 
The original post: /r/datahoarder by /u/ThePeoplessChamp on 2025-07-08 06:35:34.

Hello data hoarders,

I'm currently copying important VHS tapes to me PC. I will be copying them to new HDDs every 5-10 years or so. In addition to that, I'd like to burn them to DVDs as I'm under the impression discs are better for long term storage. Are there particular DVDs that are better suited for long term storage? Can you highlight the specs look out for and perhaps some real world examples as guidance?

Thanks

40
 
 
The original post: /r/datahoarder by /u/arch017 on 2025-07-07 20:01:44.

I have tons and tons of photos. Adobe sucks and is expensive. Like a good gallery app or file app for when viewing photos from hundreds of folders, something with a "favorite" options. Like when you have to find that embarrassing photo to embarasse your kids and family. Something that's also built with privacy in mind.

41
 
 
The original post: /r/datahoarder by /u/bAN0NYM0US on 2025-07-07 19:31:42.

I bought some Seagate Exos X16 drives from the official Seagate store on Amazon.ca back in 2022. One of the drives failed and my warranty is still valid until 2027 but when trying to submit a claim for a replacement drive. It's telling me to contact support.

I contacted support and they're telling me that this "new" drive was actually registered in Asia on June 11th and my purchase was on June 27th. So these were open box drives being sold as new, and being sold with the warranty issued in Asia and they can't give me a replacement drive because I'm in Canada.

I just got totally scammed by Seagate and they won't give me a replacement drive even though I still have almost 2 years of warranty remaining because they were registered in Asia before being shipped.

Just a warning to anyone out there about to buy Seagate drives off of Amazon. It's a scam, you don't get the 5 year warranty they advertise with them because they register them out of region so they don't have to give it to you and it's obviously well past the Amazon warranty period to do anything about it so I just got totally fucked on this.

Buyer beware.

42
 
 
The original post: /r/datahoarder by /u/BookShelfRandom on 2025-07-07 19:19:44.
43
 
 
The original post: /r/datahoarder by /u/surelyunsure_ on 2025-07-07 14:38:27.
44
 
 
The original post: /r/datahoarder by /u/xyz941823 on 2025-07-07 04:10:30.

When collecting large amounts of data, I found that managing proxies can get expensive and complicated. Recently, I tried evomi.com, which offers rotating residential proxies with no subscriptions and a straightforward pay as you go pricing of $0.49 per GB.

The proxies rotate automatically and come from real devices, which helped me avoid blocks during scraping. The dashboard is pretty minimal but gets the job done. It might be a good option if you’re looking for a flexible and cost-effective way to manage IPs for big data projects.

45
 
 
The original post: /r/datahoarder by /u/Astranauts on 2025-07-07 04:03:05.

I love MyRetroTVs (https://80s.myretrotvs.com/). I specially put these videos before I go to sleep.

Someone should download and store all of them, there's very valuable content there too.

46
 
 
The original post: /r/datahoarder by /u/rangoMangoTangoNamo on 2025-07-07 03:43:56.

Seems like plex keeps adding more and more feees. I was trying to share my plex movie library with my friends but apparently plex is trying to make them pay a subscription to access my content.

Does anyone have any recommendations how to get around this? Or do you recommend something like jellyfin?

47
 
 
The original post: /r/datahoarder by /u/matthew_levi12 on 2025-07-07 03:36:48.

Disclaimer: I'm a newbie to the subject. Trying to learn from the experts.

Let's say I have a server running ecommerce with millions of customer's sensitive data, hosted somewhere else far away from me. It's fully disk-encrypted with LUKS. So, nobody can see the files decrypted if they stole the disk.

But, I have heard that once the server is unlocked with LUKS passphrase, the key resides in RAM. Somebody with physical access to the server could just dump RAM and extract LUKS keys.

How could I protect my server from having LUKS keys stolen from RAM as well? Like a cold boot attack, for example?

Thank you so much for your help!

48
 
 
The original post: /r/datahoarder by /u/Kyxstrez on 2025-07-07 03:28:54.

I need to replace these 2 drives and I'm currently considering a few options:

  • WD Elements 22TB (400€)
  • Seagate Exos 24TB (400€)
  • Seagate Expansion 22TB (350€)
  • Toshiba MG10AFA22TE 22TB (350€)

The drive will be placed on my main desktop rig next to my desk, so it needs to be quiet.

49
 
 
The original post: /r/datahoarder by /u/King-of-Plebss on 2025-07-07 02:33:26.
50
 
 
The original post: /r/datahoarder by /u/ZanyDroid on 2025-07-07 01:45:59.

Looking for a DAS array that exposes LUNs over Thunderbolt. This is exploratory, looking for budget <$1000.

LUN would abstract a device that has mirrored SSD write cache over some "parity" (IE not mirrored) coded HDD devices underneath.

The reason for this is that I want to move from Storage Spaces to something better, but still retain it as a local device from the POV of Backblaze Personal.

I also theorycrafted whether iSCSI would work, but have seen mixed signals about whether this works and how wise it is. But Thunderbolt is officially on the Backblaze supported list.

view more: ‹ prev next ›