I guess I gotta donate more to anna
Technology
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
Dont have the space but love to see this. I hope people seed this for a long time
- Over-focus on the most popular artists. There is a long tail of music which only gets preserved when a single person cares enough to share it. And such files are often poorly seeded.
- We primarily used Spotify’s “popularity” metric to prioritize tracks. View the top 10,000 most popular songs in this HTML file (13.8MB gzipped).
- For popularity>0, we got close to all tracks on the platform. The quality is the original OGG Vorbis at 160kbit/s. Metadata was added without reencoding the audio (and an archive of diff files is available to reconstruct the original files from Spotify, as well as a metadata file with original hashes and checksums).
- For popularity=0, we got files representing about half the number of listens (either original or a copy with the same ISRC). The audio is reencoded to OGG Opus at 75kbit/s — sounding the same to most people, but noticeable to an expert.
Perhaps I'm reading this wrong, but is this not a little backwards? Since unpopular music is poorly preserved, shouldn't the focus be on getting the least popular music first?
If you want that long tail, bandcamp and soundcloud are better sources. The barrier to entry is low with those, and there's a plethora of small, niche artists just doing their own thing.
For a representative snapshot of music though, it's pretty amazing. It shows what a massive percentage of the planet listens to, preserved hopefully across many seeds, and historians will love shit like this in the future.
Unfortunately if you sort by least popular musicon Spotify, you’ll get nothing but spam
It depends on what your goal is: If you want to preserve the music that is important to most people or to the era, you should start with the most popular stuff. And Spotify has a big spam problem. Everybody who thinks he is a DJ wants his music to be on there and there is so much AI music flooding the scene. So it does make sense to backup what people are actually listening and not some AI-generated music spam nobody cares about.
I am pretty sure the major labels are already preserving the most mainstream artists. Msybe it should be sorting by the most popular independent artists
I mean, they say earlier that music is actually well-preserved, but it's disproportionately popular music. If the goal is then to preserve everything, I'd expect them to go for stuff that isn't likely to be in some random audiophile's collection or whatever then.
The politics of preservation is definitely an interesting one. I suppose one argument in favor of preserving more popular music is that there are going to be fewer popular tracks than unpopular tracks - and they're already at 300TB, which is nothing to sneeze at, especially since it's a third the size of their existing library of ebooks.
I agree. I seed torrents/files that took me a long time to finish.
This is by far the largest music metadata database that is publicly available. For comparison, we have 256 million tracks, while others have 50-150 million. Our data is well-annotated: MusicBrainz has 5 million unique ISRCs, while our database has 186 million.
Does this mean the MusicBrainz database will soon go from 5 million to 186 million tracks?
That's exactly what I was wondering too.
Acquiring high quality music is already easy enough in most cases.
What I am interested in is the metadata. Accurate tagging of all my files is of high interest.
If I ran mb, I would be cautious importing the data directly. I'm sure Spotify would consider it trade information and go after anyone directly using it. However if a few million people added the tracks with individual edits then it probably won't take too long.
I thought metadata couldn't be copyrighted though?
It can't, but I'm sure that wouldn't stop Spotify from raising a stink if they see it being bulk imported. I'd imagine this would be similar to OpenStreetMaps and Google Maps; they probably could scrape and bulk import missing info, but they restrict it to licensed sources and user edits to limit liability and enforce quality.
In cartography the expression of the uncopyrightable data is itself copyrighted (e.g. colors used, thickness of ligns) so maybe certain data fields are owned by Spotify (e.g. genre, description, history, song notes)
ligns
that's a fascinating typo.
You know, I thought it didn't look right, but I typed it into Google and it didn't autocorrect so I went with it.
Rhymes with signs, it must be right.
Probably not worth it to store the AI tracks
Asking the real questions here...
I'll strongly suggest to take out all the cheaply AI generated music from this "back up" and save themselves some space.
I'm not sure how they would go about doing that at scale without also getting some false positives and removing human music too
You could cut off your search around the time AI tracks started to appear. Not sure when that was, maybe 2023. You'd miss a lot of recent stuff, but you'd filter out a lot of spam too
I see your point, but as you say, there would still be the tradeoff of missing more recent stuff. That might only involve missing a couple of years' worth of stuff now, but AI isn't going away any time soon, so it would mean that there'd be an increasing amount of human made music not being archived; One of the things I like about Anna's archive is that they seem to look at this problem as a long term, informational infrastructure kind of way, so I imagine they wouldn't be keen on stopping the archive at 2023.
It seems they've opted for a different tradeoff instead: lower popularity songs are archived at a lower bitrate, and even the higher popularity stuff has some compression. Some archives go for quality, and thus prioritise high quality FLACs, so Anna's archive are aiming to fulfill a different niche. I can respect that.
The data they compiled is really cool.
If reading the chart right, the genera with the most artists is opera.
Even if they didn't have the music files, the analysis on the metadata is insane.
Publicly admitting they are the origin of the torrents is definitely ~~a risky~~ an insane move. I don't think they want Sony going after them, but also fuck Sony for locking art behind shitty contracts that forces these kind of projects to exist.
Publicly admitting they are the origin of the torrents is definitely a risky an insane move. I don’t think they want Sony going after them
Let's be honest: Everybody is trying to go after Annas Archive. Every book publisher wants to get them, the US government, too and it really doesn't matter if every music publisher wants them also. I hope that they are based in a country where the western systems can't get them
I hope (also assume since it hasn't been taken down yet) it's more of a decentralised deal with servers in many places and backups in every nation under the sun
The 3 major labels are equally predatory not only Sony
There's definitely gonna be some crazy guy who will put this on their server and stream it to their phones lol
I stream mine through Plexamp. Up to almost 400k tracks.
If I had an extra 300 tb I'd do it.
Tagging /datahoarded
Hi it's me