PieFed Meta

686 readers

1 users here now

Discuss PieFed project direction, provide feedback, ask questions, suggest improvements, and engage in conversations related to the platform organization, policies, features, and community dynamics.

Wiki

founded 1 year ago

MODERATORS

rimu@piefed.social

Tired of your instance getting pounded by bots and scrapers? Solved. (infosec.pub)

submitted 2 weeks ago* (last edited 2 weeks ago) by rimu@piefed.social to c/piefed_meta@piefed.social

11 comments fedilink hide all child comments

Instances that are not trying to attract a new audience might want to turn on the new Private Instance setting, which makes everything private. The home page, posts, communities, etc will all require a login to view. Bots and scrapers won't be able to get anything useful from your instance and will stop trying.

Also if a single-user instance is subscribed to mostly NSFW communities, maybe they don't want everyone to be able to see which communities are listed at /communities.

Or it could be used temporarily when a biiig flood of scrapers turn up, then turn it back off when they go away.

Edit: Federation is unaffected by this. For logged-in users everything continues as before.

top 11 comments

sorted by: hot top controversial new old

[–] Ulrich@feddit.org 14 points 2 weeks ago* (last edited 2 weeks ago) (1 children)

Fucking AI has destroyed the free internet. And for what? All to grift a bunch of investors.

[–] notabot@lemm.ee 7 points 2 weeks ago

Scrapers have been a problem for a lot longer than LLMs have been an issue. Fighting them has always been a pain in the proverbials, but theres been some entertaining work recently on deliberately getting them lost in a maze of made up pages. The problem is that they never stop or go away. They'll just keep trying, and new ones keep springing up.

[–] admiralpatrick@lemmy.world 8 points 2 weeks ago (2 children)

Nice!

Does it still federate with that enabled? Last I checked, enabling private instance in Lemmy also disabled federation.

[–] rimu@piefed.social 11 points 2 weeks ago* (last edited 2 weeks ago)

It still federates, yes.

[–] abff08f4813c@j4vcdedmiokf56h3ho4t62mlku.srv.us 3 points 2 weeks ago (1 children)

I had coded up something similar (but less configurable) on my own single-user pyfedi instance. But this is really nice. In particular it's surprising that we can now do something that lemmy can't (yet).

I wonder what's next on the radar. Implementing https://github.com/LemmyNet/lemmy/issues/5578 maybe? (Thought I wouldn't be surprised if this was also already implemented...)

[–] rimu@piefed.social 1 points 2 weeks ago

Yes, that's done. When you block an instance it is the equivalent of a user-level defederation.

[–] OpenStars@piefed.social 3 points 2 weeks ago

This sounds fantastic, PieFed is growing so much so quickly!:-)

[–] rosahaj@lemmy.blahaj.zone 3 points 2 weeks ago (1 children)

I really need to make a piefed instance one of these days. Just not so sure I have the hosting experience necessary.

[–] rosahaj@lemmy.blahaj.zone 3 points 2 weeks ago (1 children)

Or in other words, I keep seeing you come out with fantastic features, and can hardly contain myself from biting the bullet and going all in, excellent work. :)

[–] rimu@piefed.social 3 points 2 weeks ago

Good to hear that, cheers 👍

[–] mesamunefire@piefed.social 2 points 2 weeks ago

Nice this is great! Now openai can stop endlessly pulling from my server.