this post was submitted on 29 Aug 2026
5 points (85.7% liked)

Ask Experienced Devs

1509 readers
1 users here now

Icon base by Delapouite under CC BY 3.0 with modifications to add a gradient

founded 3 years ago
MODERATORS
 

I’m using university journal portal OAI endpoints for the third time in a row to fix a typo and handle DOI lookups.

Does anyone know how disrespectful or intrusive this is considered to be?

A few years ago, I scraped arXiv and they blocked my IP almost immediately; perhaps if I had used arXiv’s OAI interface, they wouldn't have blocked me.

But I really have no idea just how disrespectful or intrusive this is!

you are viewing a single comment's thread
view the rest of the comments
[–] obbeel@kbin.earth 1 points 4 days ago

OAI are API endpoints for metadata access of articles. I imagine API access is more respectful in terms of bandwidth since it's organized specifically for access by the universities?