It's A Digital Disease!

23 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
901
 
 
The original post: /r/datahoarder by /u/riponmohammadrp on 2025-06-13 10:02:09.

As the Title says, are these 2 a good combo for day-to-day use, data transfer, data storage and for video recording directly to the SSD from my iPhone 15 Pro and S25 Ultra?

I'm wondering if there are any other options for a good enclosure, and is the 990 pro overkill for me? Should I stick to 990 EVO?

Appreciate any suggestions 🙏

Here are the product links as well.

UGREEN Magnetic M.2 NVMe SSD Enclosure with

https://amzn.eu/d/38ZwJNQ

&

SAMSUNG 990 PRO M.2 Internal SSD - 2 TB https://amzn.eu/d/bHICCwi

902
 
 
The original post: /r/datahoarder by /u/DaUltimatePotato on 2025-06-13 08:47:01.

I have a folder that's synced to the cloud, but how do I recover its contents if the folder or files within it get corrupted? I know you can backup individual files, but this would be very time consuming if I had to reassemble the entire folder and all of their binaries by hand. I thought about using a script that compresses a folder as a potential workaround, but I'm not sure if Google Drive saves version history for that.

903
 
 
The original post: /r/datahoarder by /u/Kelevra_Slevin on 2025-06-13 07:12:51.

I'm running mergerFS + snapRAID for the first time. I have 12 drives running on an LSI 9305 16i HBA. 10 are data drives (a mix of 4TB and 5TB drives) in a mergerFS union, and 2 are parity drives. I'm running proxmox & a VM (ubuntu server) that handles mergerFS and snapRAID.

I just transferred about 31TB from my old NAS to this new server. Transfer went fine. But now I'm trying to run snapraid sync, and as soon as the process starts, I see ~150MB/s, ~58 stripes/s, CPU 2%, ~67:00 ETA.

But after about 5 minutes of normal progress the speed starts to fall steadily. After a couple more minutes, it's down to 30MB/s.

The final chart (after I terminate it) always says it's waiting on my parity 1 disk, but I don't really know how to troubleshoot it from here.

NOTE: I actually just noticed that it seems to be exactly when it crosses the threshold of 60000 MB. I've run 2 repeat tests now, and the speed drops *exactly* when it hits that number. What could that possibly indicate?

Any help would be appreciated. I dumped a bunch of time and money into this new server, so if my wife doesn't see notable improvements in plex pretty soon, I'm dead...

904
 
 
The original post: /r/datahoarder by /u/EchoGecko795 on 2025-06-13 05:53:24.
905
 
 
The original post: /r/datahoarder by /u/cheater00 on 2025-06-13 05:36:53.

I've been looking for a simple way to create a NAS to share a bunch of drives on the network, and I couldn't find anything, so I made it myself. All you have to do is install Ubuntu, run the install script from here, and that's it. All connected hard drives are now shared on the network. All drives you connect in the future will also be shared. The OS drive is not shared, but otherwise, there's zero security. It's for people who are on a secure network and just want to get at their files.

Wonder what everyone thinks and if there are any suggestions on how to do things better. I hope this helps someone.

906
 
 
The original post: /r/datahoarder by /u/loorana22 on 2025-06-13 05:36:45.

Is bit rot a real concern for data stored on 24/7 spinning hard drives, as well as for data on external hard drives kept on shelves for years?

907
 
 
The original post: /r/datahoarder by /u/samontab on 2025-06-13 05:29:39.
908
 
 
The original post: /r/datahoarder by /u/TheMostQuailed on 2025-06-13 05:18:16.

Hey, guys.

I’ve been using Dropbox for nearly a decade now, and I’ve accumulated a large number of files on it (somewhere just under 2TB). As of recently, Google Drive has been looking more attractive to me as a solution for my cloud storage needs, especially now that it comes with Gemini Advanced included with the subscription.

I’m looking for a way to migrate my entire Dropbox over to Google Drive. Many of the services I’ve checked out cost exorbitant amounts of money to make the migration happen. I’ve heard about rclone, and I’m leaning towards this option because it’s free, but I understand it could take nearly forever, especially since I don’t have the fastest internet (around 150 Mbps).

Could you guys tell me some of your recommendations regarding this matter? I’m really just trying to save as much money as possible, if anything, I’d rather sacrifice the time and use rclone, but I’m just exploring my options.

909
 
 
The original post: /r/datahoarder by /u/cotonheadedninymugns on 2025-06-13 04:41:03.
910
 
 
The original post: /r/datahoarder by /u/speedsk8tr71 on 2025-06-13 04:06:51.

I have a lot of portrait videos on stash and when I display it as a wall there's a bunch of these black bars between videos, is there anyway to get rid of them or change the orientation to portrait to get everything to fit nicely?

911
 
 
The original post: /r/datahoarder by /u/delrvich on 2025-06-13 04:04:30.

Using an android phone: Is there an easy way after having downloaded hundreds of photos in a zip to only unzip 50 pics at a time into several folders (to resize, edit, sorting, etc ...)? Maybe an app? Manually separating them 50 each into seperate folders on android is tedious. I wish to store the photos on Fb, etc ... and can only upload 50 at a time.

912
 
 
The original post: /r/datahoarder by /u/VicarBook on 2025-06-13 03:16:06.

Hello, I know this is the 11th hour and all, but a forum that I followed for years is sunsetting tomorrow. The forum is https://villainsandvigilantesforum.com/heroictales/blog/ and it has 49k posts (yes it hasn't been that active for a while). I hate to see 16 years disappear. I am appealing for help here in preservation of this history.

913
 
 
The original post: /r/datahoarder by /u/xenobitex on 2025-06-13 02:45:59.

Hi - Asking for the purpose of making more compact back-ups... I'm keeping the source of course! For normal video editing I've been keeping to mod-8. But recently, for DVD archiving I moved to mod-16 (it seemed a "safer" choice"...). So I crop pointless black / cover noisy edges leaving up to 6/8 pixel borders at edges.

However... I recently discovered x264 blurs edges if there are black bars + picture contained within a 16x16 macroblock... the black borders I retained or added.

(...apparently x264 assigns a higher quantizer to the whole macroblock due to the static black, so the valid picture content gets encoded with a lower quality and becomes slightly blurred within those 16 edge pixels. This is more noticeable when the picture at the edges has a uniform color/texture etc).

So... asking some pros... what are the actual benefits of cropping black/noise to anything above mod-2 (in 2025)?

I'm aware encoding just pads "invisible" pixels to make any video back up to mod-16 - at some expense to efficiency - but is it worth just going a mod-2 route while cropping, if genuine quality is lost by cropping noise and adding borders to keep mod-8/16 instead?

(How does this padding work with the macroblocks? Any downsides at all?)

* What I'm cropping varies between huge black 4:3 letterboxing, VHS capture noise, to just MPEG-2 DCT edge blurring on high quality pro DVDs. But it seems doing so adds its own edge issues.

Thanks in advance!

914
 
 
The original post: /r/datahoarder by /u/Draculaaaaaaaaa on 2025-06-13 01:39:47.

I'm curious as to if anyone is familiar enough to comment on the state of the options available to us in terms of readers/managers such as Kavita, Komga, Mango, Tachidesk, or any others alongside other programs which can help with the actual downloading of chapters or metadata.

(free and open source software only, although feel free to discuss non-FOSS options in the comments if you think they are better for you 🙂)

This is primarily for the collection and reading of Manga and some Korean webtoons, I do not currently have a strong interest in collecting western comics or non-graphic novels. Perhaps I might in the future, but I don't want that to affect my choice of tool for this goal.

I've only recently started looking into this and here are my goals and potential solutions:

  • Be able to select a series with a Sonarr inspired program and download all of the chapters that are currently available, as well as be able to download new chapters as they come out.

    • Kaizoku is able to do this, but it is very feature incomplete and has a few bugs compared to Sonarr. Still, good enough for what I need (which is to download high image quality chapters of manga, preferably not in volumes).
    • Anybody know how Tranga stacks up? I mainly try to source downloads from Mangasee with Mangadex as a backup.
  • View my downloaded series in a Jellyfin alternative.

    • Komga and Kavita seem to be the best options, and although I've installed both, my Komga library scan has been going on for days so I can't comment as to how effective either of them is yet for a full sized library (perhaps someone else can chime in if they've tried both recently). I don't know how other options like Mango fit in.
    • Also: it is important that there are options for reading webtoons/vertical layout comics.
  • Have Tachiyomi support (critical).

    • I need the server to be able to support reading on Tachiyomi as an extension. Progress sync with it is a nice to have but not vital.
    • Both Kavita and Komga have this, which is why I'm trying those out first.
    • Note: just because I need strong Tachiyomi support, doesn't mean that I don't also want a good WebUI. It's less important to me personally, but half the fun of software like Jellyfin is sharing your media library with friends and family. Many of them are not on Android or are not invested enough to download Tachiyomi. I have friends who go on ad ridden, malware filled websites to read manga on their computers in 2023!
  • Optional (but desirable): native AniList syncing support.

    • I'll read from Tachiyomi, like, 85% of the time, but there are some series I prefer to read on desktop so this feature would be really nice to have.
    • As far as I know Kavita has this feature, but it's locked behind a subscription fee.
    • Komga does NOT support this natively, but apparently, it has integration with MALSync which might work well (although I'm not sure how this would work, in terms of UI). I don't necessarily want 100% parity between my library and AniList, I like the Tachiyomi approach where I can choose to track a specific series.
  • M E T A D A T A

    • This has been the most frustrating part of all this. Manga databases are nowhere near as robust as those that exist for TV and Movies.
    • AniList is great for series name/title/description/genres, but not much beyond that. You can basically forget about stuff like individual chapter information.
    • The one bane of my collection so far is that I would like to include volume information. I strongly prefer reading in chapters (due to years of Tachiyomi, MangaRock, and similar app usage) so I actively avoid getting full volumes when I can, although that doesn't mean I don't want that information. Ideally I would have both and I've been trying to find a way. If someone has any good way to do this PLEASE let me know (aside from MangaDex, their site doesn't have complete collections for many of the series I like)! I think I have answers for mostly everything else aside from this.
    • Good sources for either English or text-free covers would be nice. I don't hate Japanese covers (quite the opposite) but I prefer my English translated library to have covers in my language. Also - I'm not sure if Kavita has this, but Komga doesn't have the ability to directly search for alternate images like in Jellyfin. It would be nice if you could directly select from images sourced from sites like AniList, Kitsu, MAL, MangaDex, etc.
    • I've tried Manga Manager but it doesn't seem to be fully working or as effective as I'd like (+ the documentation is out of date).

The good news is that most of these problems are already solved or solvable with little effort (aside from the volume information 😞).

Please let me know if you have any suggestions or if there are any great tools that may do what I'm looking for better than what I'm currently using (Tranga is one which I discovered only while writing this post, so I can't comment on how it compares to Kaizoku yet...).

TL;DR:

Would like some advice. I'm trying to make a Sonarr/Radarr/Jellyfin stack but for Manga. Goals include new release automation and complete metadata retrieval. Ideally fully automated, featuring a webreader, Tachiyomi integration, and 3rd party progress tracker support.

What I'm using right now: Kaizoku for automated downloads like Sonarr, and Kavita/Komga (trying both for now) as my Jellyfin equivalents. Still haven't fully played around with them but neither is perfect for my use case.

915
 
 
The original post: /r/datahoarder by /u/ilovecows4 on 2025-06-13 01:31:55.

Sorry if this isn’t the right place to ask this I’m just supper lost. I have 90gb worth of photos on my phone and I need a place to put them so I can delete them off my phone to have storage lol. I bought a flash drive but then found out they’re not very reliable so I’m kind of lost. Should I put it on a CD or what should I buy to transfer them?

916
 
 
The original post: /r/datahoarder by /u/unlimitedcode99 on 2025-06-13 00:41:26.

Does anyone have a picture of the PCB for this particular SATA SSD config as other sources links to smaller capacity SATA SSDs of the same series. I particularly need a half length SATA SSD PCB to fit my weird laptop config, where my current 1TB Sandisk SATA SSD is without a case and wrapped with insulating film from another laptop's SATA mounting kit and hot glued in place.

I plan to buy either this for unified SSD maintenance program or a Samsung 4TB EVO SATA SSD which has pictures of it having half length PCB.

917
 
 
The original post: /r/datahoarder by /u/DieingFetus on 2025-06-13 00:05:07.

I've been hoarding since 2004. I originally had multiple PCs with every sata slot filled before I got a used dell server. I immediately fell in love with sas drives. My current build is 80TB with 61TB stored.

I'm needing to drastically reduce my footprint and power consumption. I'm making a truenas build on a b550 and ryzen 7 5700. I think I can continue with my sas drives with a PCI HBA. That's where I'm stuck.

Im thinking all I need is a PCI HBA in IT mode, an enclosure, and some cables that connect the sas to the HBA.

Any tips? Im trying not to go back to sata just for the cost of drives

918
 
 
The original post: /r/datahoarder by /u/swanson_stash on 2025-06-12 23:07:36.
919
 
 
The original post: /r/datahoarder by /u/zinbwoy on 2025-06-12 21:58:12.

I'm so bummed, I work as a music archivist and this is devastating :(

920
 
 
The original post: /r/datahoarder by /u/AggressiveEmuSlut on 2025-06-12 21:33:20.
921
 
 
The original post: /r/datahoarder by /u/Zer0CoolXI on 2025-06-12 21:26:10.

Amazon has recert Seagate Exos X 28TB hard drives for about $340.

Wondering if anyone has tried these? I’m a bit weary considering they only come with 90 day warranty and I can’t find the same model/size new.

On the other hand these are about $100 less per drive than new 24TB new Ironwolf Pros or Exos.

922
 
 
The original post: /r/datahoarder by /u/John-333 on 2025-06-12 20:06:06.
923
 
 
The original post: /r/datahoarder by /u/Mattieboy2011 on 2025-06-12 19:15:28.

Hey everyone,

I’m really interested in getting into data hoarding, but I have a few questions and would really appreciate some help from people who know more about it.

  1. Why do people data hoard? What are the main reasons or benefits?
  2. Where do you usually find data to hoard? Any good sources or tips?
  3. What’s some good beginner gear for someone on a budget? I don’t need anything crazy, just something to get started.

I’m completely new to all this, so simple explanations would be super helpful. Thanks in advance!

924
 
 
The original post: /r/datahoarder by /u/wow-signal on 2025-06-12 18:44:33.
925
 
 
The original post: /r/datahoarder by /u/TnNpeHR5Zm91cg on 2025-06-12 18:28:16.
view more: ‹ prev next ›