Is this site just going to use the results to train AI to generate better fake imagery?
this post was submitted on 23 Sep 2025
143 points (96.1% liked)
Technology
685 readers
22 users here now
Share interesting Technology news and links.
Rules:
- No paywalled sites at all.
- News articles has to be recent, not older than 2 weeks (14 days).
- No external video links, only native(.mp4,...etc) links under 5 mins.
- Post only direct links.
To encourage more original sources and keep this space commercial free as much as I could, the following websites are Blacklisted:
- Al Jazeera;
- NBC;
- CNBC;
- Substack;
- Tom's Hardware;
- ZDNet;
- TechSpot;
- Ars Technica;
- Vox Media outlets(including Axios, due to new changes related to trackers on their website);
- Engadget;
- TechCrunch;
- Gizmodo;
- Futurism;
- PCWorld;
- ComputerWorld;
- Mashable;
- Hackaday;
- WCCFTECH;
- Neowin;
- Jacobin;
- Yahoo;
- Freethink;
- Big Think;
- Newsweek.
More sites will be added to the blacklist as needed.
Encouraged:
- Archive links in the body of the post.
- Linking to the direct source, instead of linking to an article talking about the source.
Misc:
Relevant Lemmy Communities:
founded 5 months ago
MODERATORS
I don't think much training can be done on 20 pictures
This is literally us giving them training data for AI to identify what pictures look like AI...
load more comments
(1 replies)
I didn't zoom in or anything like that, but I also feel like I was playing against "Dev traps" instead of unbiased pairs if that makes sense.
🤖 Reality Check #1 15/20 🔥 Perfect Streak: 9
I can spot AI images 75% of the time. 🧠 Can you beat me? realitycheckk.com
70%. I noticed that the more I tried to dissect it, the worse I was. I was far more accurate taking a quick glance at both and making a decision after like 5 seconds.
load more comments
(2 replies)
🤖 Reality Check #1 20/20 🔥 Perfect Streak: 20
I can spot AI images 100% of the time. 🧠
Most of the AI generated images looked too clean and smooth. It made me appreciate the real images more.
Yeah, the quickest way to tell was to look for things that AI wouldn't include, like brown tips on flower petals or broken sticks that have the right fracture pattern and don't just fade away. AI tends to generate things that are very averaged/ideal looking. The textures of ai images also look wavy with like a 10-20pixel periodicity when zoomed in. The noise from real cameras is much more speckly.
I also got 20/20, but only because it was an A/B comparison. If asked AI or real on each image indlividually, I'm not sure I would get much above 65%.
Reality Check #1 19/20
This thing messed me up:
They both looked like they could be AI - but to me it looks like that one has an AI artifact
Meh, the block just got pushed vertical, but it is weird, agreed. The one on the left doesn't strike me as natural. Ice neither forms nor breaks up like it's been put through a blender.
Here's the thing: you should expect some things that aren't average in reality. Sure, most ice won't do what you're looking at, but some will. The left image all looks the same across the image. There's nothing that is non-average looking.
load more comments
(2 replies)
So the hardest part was that a lot of the pairings both looked like AI and every 50/50 guess I made was wrong. Many real images that I got wrong looked like staged professional shots with a ton of digital manipulation afterward.
Final Accuracy: 60%
AI image generation is in this weird place between professional staged shots and amateur photography and is probably there because the training set includes both.
Same, I was looking for inconsistencies in lighting, black/white points, etc, and I think in several cases I picked an image as AI based on details that were a result of photo manipulation and not "real". I got the same score as you in the end here.
Kinda interesting, somewhat invalidated what I thought this was testing, but it's an interesting test nonetheless. I may retake this in a few days now that I know it's comparing AI to photoshop and not "reality". Would certainly need a different strategy.
🤖 Reality Check #1 16/20
🔥 Perfect Streak: 12
I can spot AI images 80% of the time. 🧠
It's almost always, "this looks too clean/perfect."
Those images are very AI-easy IMO. No crowds or complex images.
85% ... and a lot of these pictures were just landscapes. If there we more pictures with people, animals or other objects, this would be even easier.
fuck that UI. tapping to select and zoom below is odd. I messed up a few and exited.
load more comments
(2 replies)
🤖 Reality Check #1 19/20 🔥 Perfect Streak: 18
I can spot AI images 95% of the time. 🧠 Can you beat me? realitycheckk.com
The one pic with the pink flower and water bubbles under water really put me off
Yep that got me too. Those lily pads looked very unlikely
🤖 Reality Check #1 18/20 🔥 Perfect Streak: 7
I can spot AI images 90% of the time. 🧠 Can you beat me? realitycheckk.com
The two I got wrong were both very artsy and abstract. Anytime there is anything with detail in the image either check it's super fuzzy and dreamlike or it's way too sharp. I looked at each image for no more than a few secs, I feel with say a minute per image you could easily get close to 100%.
🤖 Reality Check #1 18/20 🔥 Perfect Streak: 10
I can spot AI images 90% of the time. 🧠 Can you beat me? realitycheckk.com
FUCK AI
Plot twist: they were all AI generated.
That's what I would do if I would create such a test. But I would add the option "can not decide" to keep it a bit more fair.
🤖 Reality Check #1 16/20
🔥 Perfect Streak: 7
I can spot AI images 80% of the time. 🧠
Can you beat me? realitycheckk.com
Quite interesting
85%! I've gotten pretty good at this.
🤖 Reality Check #1 17/20
🔥 Perfect Streak: 8
🤖 Reality Check #1 19/20
🔥 Perfect Streak: 14
Damn, so close
80%
We are cooked.
I got 70%, Which is not that much better than random chance (50%) Scary stuff
I only ot 50% lol
75%
At first I was analyzing both and picking the wrong one (one of the human ones had a tree that looked like early AI lmao), eventually I just went off on instinct and ended up being right on 90% of them. I guess the details were fine-tuned, but there's still something off about them.
The problem with this is that it's mostly nature scenes. Once images of people are used, it's much easier to detect slop.
I got 14/20. Once I stopped over thinking it it was easier. Sometimes I found myself picking the ones I thought looked "more realistic" because I kept getting them wrong and if worked better. Something something hyperreal.
I got 90% and most of my guesses we against the pic that looked too perfect. Hyperreal indeed!
80%, better than I expected for myself. It does help that they are showing similar images side by side.
The problem with this test is that it all depends on the model for the AI pictures. There are models now that specifically aim to have imperfections to emulate real pictures, unlike these
- Reality Check #1 18/20
- Perfect Streak: 13
I can spot AI images 90% of the time.
Am dumb?
🤖 12/20 🔥 Perfect Streak: 4
I can spot AI images 60% of the time. 🧠
Got up to 11 myself before I lost it.
20/20.
The nature shots were harder than shit that had man-made things or people in them. But also, the resolution of each pairing being dramatically different kinda gave a pattern to which one would be which.
🤖 Reality Check #1 20/20 🔥 Perfect Streak: 20
...some of those looked much more impressive than I expected, though.
🤖 Reality Check #1 18/20 🔥 Perfect Streak: 9
I can spot AI images 90% of the time. 🧠 Can you beat me? realitycheckk.com
Granted I accidentally refreshed half way through so maybe my score should be 17/20
The images are pretty good but a lot of them still have the "too polished" look.
Also wish the text to copy doesn't look so AI itself lol
Just me not reading any directions till 3 in, I thought I was picking the real one at first
I miss clicked once by mistake but otherwise this is my score. Pretty interesting. Though if I wasn't given a side by side to pick just one I'm not sure I would have guessed as many of them. When it's just two it's pretty easy to get lucky. I'd like to see something like this with more than two at once and told X amount are AI and see how well we do. My bet is we do worse.
🤖 Reality Check #1 16/20 🔥 Perfect Streak: 12
I can spot AI images 80% of the time. 🧠 Can you beat me? realitycheckk.com
You could also do one at a time and have to guess on it's own
Oh great point! I'm sure I would have done worse that way as well. Particularly if it didn't give me feedback until the end.
78%, not bad. Anything with no people or animals are always harder to spot, especially with how small the pictures are. I want to try one with with bigger pictures and people prominently featured.
🤖 Reality Check #1 16/20 🔥 Perfect Streak: 7
I can spot AI images 80% of the time. 🧠 Can you beat me? realitycheckk.com
Someone should make a study about this.
🤖 Reality Check #1 18/20 🔥 Perfect Streak: 9
I can spot AI images 90% of the time. 🧠 Can you beat me? realitycheckk.com
view more: next ›