Data Hoarder

267 readers
1 users here now

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time (tm) ). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

founded 2 years ago
MODERATORS
1
 
 

The Linear Tape Open (LTO) consortium has reacted to higher capacity disk drives and SSDs with a 33 percent LTO-10 raw capacity upgrade to 40 TB and a target downgrade for the LTO-14 generation of 365 TB from the prior 576 TB.

LTO tape is used for archiving and the consortium of HPE, IBM, and Quantum is responsible for the LTO generational roadmap. The current generation is LTO-10 and it was originally specified to have a 36 TB raw capacity. In the event, sole LTO tape drive supplier IBM and tape-ribbon manufacturers Fujifilm and Sony were only able to achieve 30 TB. As disk drive capacity has passed 32 TB and SSD capacity is now at the 120 TB-plus level, tape cartridge capacity has been lagging behind.

2
3
4
5
6
7
 
 

If you're archiving a scriptbin.works script url(or a user profile url) to the wbm or elsewhere, append ?__termsofaccessagree=y to it. This skips directly to the actual script, so the actual script is captured.
Important: The creator of scriptbin also told me to NOT use that suffix when "normally" sharing script urls, as that will be problematic for scriptbin.
In other words, ONLY use ?__termsofaccessagree=y suffix for archiving purposes.
Now that you know this, if someone else asks you about it, DON'T just comment "Append ?__termsofaccessagree=y " and walk away.
Be a good steward of the internet and also mention the aforementioned warning along with your comment.
To reiterate the warning, DO NOT use that suffix for regular normal sharing of scriptbin urls. That suffix is only for archiving purposes.

Have fun archiving.
Cheers!

OC by @rpollost@lemmy.ml

8
9
 
 

MESA, AZ—Gleefully describing the inevitable day when society would collapse and digital files would become unusable, local physical media collector David Campbell confirmed Wednesday he was “absolutely pumped” for the downfall of humanity. “When it all goes down, there’s only going to be one place to watch the Tomb Raider movies in their entirety with all the deleted scenes, and that’s going to be my bunker,” said Campbell, his eyes reportedly shining as he described how the end of organized society and the dissolution of government would make his cherished stockpile of Blu-rays even more valuable.

“No one will be mocking the CDs I’m still holding onto when the internet goes dark forever and the only way to listen to music is through boom boxes we trade canned goods for. And I’m definitely one of the only people who has a region-free DVD player and all three seasons of Father Ted plus the Christmas special, so I’ll essentially be a king. I can’t wait.” At press time, Campbell was grinning as he purchased the 50th anniversary edition of Jaws in 4k, which he anticipated would give him full control over the drinking water supply in the event of a nuclear winter situation.

10
11
 
 

The websites of blablacar, flixbus, and various trains sites are hostile toward the idea of travelers getting all the data they need to plan a trip.

E.g. Flixbus is tor-hostile, but even when access is granted you cannot just ask for the cheapest trip from A to B over a range of days. The motherfuckers force us to search one day at a time and just one destination at a time.

Fuck that. How can we get the data? I know these sites have bot-hostility so scraping it seems like a huge effort.

Some countries have “open data” laws that requires sharing the data, but that only works if the gov gets the data to begin with. If the gov does not get the Flixbus data, then there is no legal requirement to share it.

12
 
 
13
 
 

I'm wondering if anyone who uses Drivepool with Snapraid can help with a question I have. I've searched all over and can't find an answer.

I have a Drivepool set up with some aging drives, mainly for Emby as well as photos etc. My essential files are duplicated as well as backed up on Backblaze but the media files are just freeballing.

I would like to set up a parity drive using Snapraid for the media files since it would be a PIA to figure out whats missing and then replace it in the event of a drive failure. Snapraid would just be for these media files which are static and don't get modified.

I understand automatic rebalancing should be turned off so files do not get moved around too much for Snapraid.

My question is I also have Stablebit Scanner and one of the options is automatic evacuation if it detects a drive failure.

Am I right to assume I should disable this since it would try to remove files off the dying drive to the remaining drives as it would screw up the parity?

Typing it out I think I know the answer but just want confirmation as I've never used a RAID config before.

14
 
 

Hello! If this is the wrong place to ask this question, please let me know and kindly push me into the right direction :)

So, I am looking for a USB Flash Drive. I do not care about form factor, storage capacity or speed, since the file on there will only be a few bytes.

BUT, I need it to be reliable. I've had many USBs not working / breaking out of nowhere, without any impact from outside. They just simply stopped working.

So, what are your recommendations for a really reliable USB flash drive?

15
 
 

I am looking for sata to usb enclosures that has USAP and TRIM support. And if more features like smart reporting work well then thats a plus. I will be using it with WD Blue SSD.

So far I looked at https://www.amazon.in/ORICO-External-Enclosure-Supported-25PW1-U3/dp/B0B936X2XH. It uses JMS578 and the firmware can be flashed to support trim.

I found some other enclosures but I don't know how to find the chipset used in them.

Which are some good enclosures that work without any issues in linux/bsd ?

16
 
 

I still use google photos and I maybe intend on getting a nas in the future to deal with my 400gb and growing of personal photos and videos but I want to start doing some backups for example one to an hdd and another to a cold storage cloud thingy, the one I heard most about is backblaze but I also heard about Idrive which seems way cheaper, is that one good? Also any ideas on how to handle the camera roll backups easily? it should be something like Android -> Main PC -> Cloud/HDD or for the backblaze / idrive thing can I go Cameral Roll/ Android -> Cloud? Ty!

17
 
 

Am looking at ServerPartDeals for 18TB HDDs and its amazing but they're USA based so I am worried about international shipping complications or damages

I tried finding alternative places in Australia but all the ones i found have like max 300gb HDDs

Am I being too paranoid about international shipping?

18
 
 

Couldnt think of an eye catching title to summarize the issue but here's what's been going on cause I'm losing my mind.

- Originally was transferring a video on my external HDD (Western Digital 4TB). All of a sudden the last 2 videos I was tranferring aren't transferring. They're moving at a very slow pace. KBs per minute almost. So I was confused but thought it was the video length.

- I cancel video transfer, but notice the music off my hdd is taking forever to buffer but it loads up slowly. I try to unmount my hdd (but am told the HDD is in use and cannot be unmounted? Never seen this before) so I restart mac. I try to use disk utility and its failing cause it can't unmount. I unplug the hdd (also was using HDD with a standard usb to usb c adapter cause apple). One thing to mention the HDD when it gets unplugged makes a click sound.

- I try plugging HDD back in but now the mac won't read it. However disk utility does, it mounts and unmounts it and says repair successful, but since then the hdd won't even show up in my disk utlity or mac. However the HDD is running, the blue light is blinking and there isn't any clicking. I try changing cables nothing.

- My sister has the standard usb port so I plug the hdd into it. At first same issue, HDD isn't being read by mac but disk utility does read it and then it shows back up on my mac. So I figure best way of approach let me drag and drop the files. It takes foreverrrrrr to prepare the files (because of these weird slow speeds) and then it says its going to take multiple days (okay fine lets see) and it does copy some for a bit eventually failing after several hours to due "error -36" on the mac and then it cancels the entire copy and paste process. And sometimes the HDD randomly disconnects and reconnects. I can try to copy and paste the folders one by one but this is going to take months and if the HDD is failing, its risky to wait. On back ups, had a backup drive but that also failed.

- Any time I try to unmount on the Mac, it gives the error the HDD is in use. Always that only disk utility can sometimes unmount it or pulling out the cable. I tried to see if I can change the enclosure maybe that's the is the issue but stupid western digital apparently has the port attached to their HDDs smfh and idk if there is even an alternative.

Been searching all over for answers on this but can't really get a proper answer, hoping someone knows what's going on here?

19
 
 

Hey I've been mostly WD Rust spinner since days of IDE, yeah IDE not EIDE LOL. But prices on spinning rust don't seem to be coming down much lately and I am in need of expansion. I have seen people say I have a misguided trust in and just lottery luck of my 30 years of WD. Also ran some Maxtors back then too with success.

That being said, review sites don't seem to be what they used to be with HDDs even SSDs for that matter. Youtubers seems to be sponsored by /via free hardware. So what is the popular opinion around here about current Seagate Quality? Because have almost exclusively been WD, and the only Seagate I owned guess 20 years also died on me sometime within the few years of owning it.

Seagate Exos 7E10 ST10000NM017B 10TB 7200 RPM 256MB Cache SATA is what I am looking at.

20
 
 

I'm a data hoarder for sure. Have many SCSI Hard Drives in my closet to prove it... I sure miss the olden days when it comes to downloading (and not necessarily pirating). Anyone remember Hotline and/or Carracho? People would set up little servers and take pride in building little communities around specific content. English Dubbed Anime, Web UI resources and files, porn of course, Freeware, foriegn movies, even FONT servers were always fun... It was not just straight forward (you could even chat or email an admin and get a response fairly fast) but it was fun and you could meet like minded people.

I guess I'm just venting because my mom got sick and I haven't logged into any of my trackers in a year and now I'm back to square one with invites. Uhhhg.

21
 
 

I have an old qnap 569 pro that I am thinking about replacing with a custom-built NAS. I was wondering if there was an easy way to keep the data when moving the hard drives without having to format them at all. Of course, I would then install a new os on the custom built, but i would prefer not to have to move all my data before doing this.

22
 
 

I might have messed up... I recently bought a 4TB SSD, Samsung 870 EVO, for the purposes of moving all my data from fragmented external Hard drives to one SSD that I can have SATA'd on my desktop.

Then I realized I've always wanted a RAID setup and the peace of mind that comes from the array. The first thing that comes to mind is a NAS setup, but for me to buy that and another two disks is about $400 and I've already spent $220 on the 4TB mentioned above, which I'd probably like to keep anyway, because like yourselves, I'm a Data hoarder.

Doing some searches online, others seemed to imply a NAS and RAID are nice but my original idea of moving everything to an SSD is also sound, even without RAID array protection.

Now I'm paralyzed with indecision and really want to move all my data from the external hard drives I have to a single source, and because I manage my Family's pictures and videos, it has a lot of sensitive data I never want to lose.

Am I over thinking it, should I just move everything to the Samsung 4Tb attached to my home desktop? I also start to worry about malware risk of keeping it on my workstation, which is why I bought smaller external hard drives over the years, to begin with.

You guys are the kings here, what would the community recommend? Is buying a NAS really the next natural step? Maybe just buy another really large external hard drive which is cheaper? $100 would get me a nice 4TB one, and I could move everything to that, again it wouldn't be in a RAID though.

The cost of the NAS is what is what is making this decision hard for me, and the fact that I just got this nice Samsung SSD.

23
 
 

Hey guys. This might be a long shot, but I thought I might as well ask.

Is there any way to find a deleted YouTube channel to watch the videos? I was listening to the Stormlight Archives Graphic Audio on YouTube and found that all the videos are gone as of a few days ago. In my YT history I have the URLs for the videos I’ve already watched, but I can’t remember the name of the channel. Is there a way to recover the videos on this channel so I can continue listening? I doubt it since it’s not my channel 😂 but any help is appreciated, cheers

24
 
 

The listing here is a CMR drive for 30 dollars. I want a drive for my jellyfin media server with the only requirement being the higher sequential access speed than the bitrate of my media which is around 6390 kbps. Will this drive work?

25
 
 

EDIT: 7 Seagate Backup Hub 8TB and 1 WD Elements external drive (the target drive).

Computer is a Dell Vostro 260 with i5-2400, 8GB RAM, 2TB Patriot P210 SSD boot drive, and 8 Seagate Backup Hub 8TB external hard drives connected to two PCI-E USB 3.0 cards with 5 USB 3.0 ports each. The computer is set to Never for when the screen and computer will shut down and the power profile is Performance.

Been trying since Monday to transfer a little over 6TB of data. Before the data transfer I checked for updates and the computer downloaded all the available updates and installed some and required a restart for another. After the restart I checked for updates again and nothing showed up so I began the transfer before going to bed. I think the estimated time was 15 or 16 hours. I turned off the monitor and went to bed. The open windows were task manager, two file explorer windows showing drives :K (source drive) and drive :L (target drive), and the little file transfer window showing about 130 MB/s.

The next morning I turned on the monitor and it was just the desktop and no windows open. I opened file explorer and only about 1TB transferred over. Usually if I restart the computer with task manager still open the computer will restart and have task manager open.

I went to settings to check for updates and none were found. I paused updates for 7 days and retried the transfer again before going to work. I turned off the monitor. Came home from work and turned on the monitor and again it was just the desktop. I opened file explorer and about 3TB total transferred, including the 1TB from the original attempt.

I went to Device Manager and have three instances of "USB Mass Storage." I went to properties and then Power Management tab and unchecked, "Allow the computer to turn off device to save power" for all three. I then retried the file transfer. The next morning I turn on the monitor to just the desktop. I turned off the computer and went to work. Got home and before bed I retried the transfer. Of course I wake up and turn on the monitor to nothing but the desktop.

Any other settings I need to check and change? It's annoying not being able to transfer all that data in one go.

view more: next ›