this post was submitted on 08 Sep 2023
202 points (95.9% liked)

datahoarder

6724 readers
1 users here now

Who are we?

We are digital librarians. Among us are represented the various reasons to keep data -- legal requirements, competitive requirements, uncertainty of permanence of cloud services, distaste for transmitting your data externally (e.g. government or corporate espionage), cultural and familial archivists, internet collapse preppers, and people who do it themselves so they're sure it's done right. Everyone has their reasons for curating the data they have decided to keep (either forever or For A Damn Long Time). Along the way we have sought out like-minded individuals to exchange strategies, war stories, and cautionary tales of failures.

We are one. We are legion. And we're trying really hard not to forget.

-- 5-4-3-2-1-bang from this thread

founded 5 years ago
MODERATORS
 

a TorrentFreak article got me spooked so I fired up the ol' yt-dlp. Got the entire channel, including comments, description metadata, and thumbnail images.

A significant number of videos were actually unavailable because of an odd YouTube bug where 15+ year old videos were listed as "currently being processed". I may re-run this later (since I ran it in archive file mode) to get the missing videos, as it seems there may be about 300 out of 4911 videos missing.

all 29 comments
sorted by: hot top controversial new old
[–] MossyFeathers@pawb.social 15 points 2 years ago (1 children)

Nice! What're you gonna do with them? Are you gonna upload them somewhere, or just hold onto them?

[–] empireOfLove@lemmy.one 15 points 2 years ago (1 children)

They still happily exist on YouTube- for now. So no point in re-hosting, they'll get squirreled away into the Giant Hard Drive of Doom.

If something happens to the actual archive project in the near future, I'll likely section them up into 20gb pieces and post them out on a torrent someplace.

[–] Appoxo@lemmy.dbzer0.com 4 points 2 years ago (2 children)

Just upload it to archive.org before your backup dies. No need to hoard it for yourself.

[–] raoulraoul@lemmy.world 12 points 2 years ago

As if they're not having enough trouble with hosting "questionable" content! You obviously didn't read the torrentfreak article making the rounds.

Internet Archive != the Pirate Bay.

For now, DON'T contaminate the IA with the Classic Chicago Television channel.

[–] empireOfLove@lemmy.one 5 points 2 years ago

Nah. IA doesn't need to deal with this volume of shit and they already have enough of a hard time dealing with copyright trolls.

If this channel is impacted in the future, I'll probably put out a few torrents with the videos and post them here.

[–] mtcerio@lemmy.world 12 points 2 years ago (3 children)

Gives an idea of the amount of data YouTube is storing, if only this one channel is 250GB!

[–] people_are_cute@lemmy.sdf.org 3 points 2 years ago* (last edited 2 years ago)

And that 250GB is probably just the downloaded and HEVC-compressed files. YouTube actually promotes uploading in raw formats for best quality, just 3-4 full-length movies would be enough to fill 250GB for them

[–] empireOfLove@lemmy.one 3 points 2 years ago* (last edited 2 years ago)

And mind you, they have a high number of videos but most are short clips and all of them are low res, 360p or 480p max. Any other channel uploading HD or 4k content will be orders of magnitudes larger for fewer videos.

[–] socks@kbin.social 1 points 2 years ago

iirc youtube is right now a net loss for google, hence them constantly trying to stuff it with ads, youtube premium, etc.

[–] NikkiNikkiNikki@kbin.social 12 points 2 years ago (1 children)

Plan to do this with a lot of the entertainment videos I watch, considering how ban happy some websites have been with content creators, being able to still see their craft after it is gone is worthwhile.

Just need to buy a fuckton of storage though

[–] empireOfLove@lemmy.one 1 points 2 years ago

Me too. There's a couple channels I've downloaded in their entirety, but they're nothing like the size of this one.

[–] RiderExMachina@lemmy.ml 7 points 2 years ago
[–] Sailing7@lemmy.ml 5 points 2 years ago (1 children)

Nice!

Could you fell us what tool you used to also get the description text and the comments? With dlp i only found the option of downloading the video itself.

[–] totallynotfbi@lemm.ee 8 points 2 years ago (2 children)

yt-dlp does support fetching comments and description text - if you use the --write-info-json and --write-comments options, it will save them as a JSON file alongside other video metadata.

[–] Sailing7@lemmy.ml 1 points 2 years ago

Niiice! Didn't know that this was supported so far.

Thank you mate!

[–] empireOfLove@lemmy.one 1 points 2 years ago (1 children)

Yep. Those two and --write-thumbnail

[–] roofuskit@kbin.social 4 points 2 years ago (1 children)

Let me know when the torrent is up.

[–] skankhunt42@lemmy.ca 2 points 2 years ago

I have room to help seed. Commenting to check back later.

[–] Asimo@lemmy.world 2 points 2 years ago (1 children)

Probably a silly question but where did you even find that?

[–] empireOfLove@lemmy.one 2 points 2 years ago (2 children)

Find what? The channel, or the tool?

[–] Asimo@lemmy.world 2 points 2 years ago (1 children)

Ah found in GitHub. For some reason I never put 2 and 2 together to automate YouTube video downloads. What a noob hah.

[–] empireOfLove@lemmy.one 2 points 2 years ago

Yeah, the yt-dlp fork is still actively maintained and has very nice results, glad you found it.

[–] Asimo@lemmy.world 1 points 2 years ago

Bit of both, the tool would be good to know mainly

[–] MonkderZweite@feddit.ch 1 points 2 years ago (1 children)
[–] empireOfLove@lemmy.one 7 points 2 years ago* (last edited 2 years ago)

What are what for? The downloaded videos?

I just didn't want this cool piece of history to dissappear from the public eye because of corporate retards. probably won't ever watch more than 1% of them.

[–] venusenvy47@reddthat.com 1 points 2 years ago (1 children)
[–] empireOfLove@lemmy.one 1 points 2 years ago

Pretty much. You can either point it at the channel OR use a link to their Videos playlist (the playlist you get when hitting "play all"). I usually use the playlist to be consistent.