this post was submitted on 25 Jul 2023
9 points (100.0% liked)

TeCHnology

519 readers
1 users here now

Technology discussion for Switzerland. This community shall discuss various topics of technology in and around Switzerland.

founded 2 years ago
MODERATORS
 

OpenAI shuts down a tool meant to detect AI-written text due to low accuracy.

OpenAI shuttered a tool that was supposed to tell human writing from AI due to a low accuracy rate. In an (updated) blog, OpenAI said it decided to end its AI classifier as of July 20th. “We are working to incorporate feedback and are currently researching more effective provenance techniques for text,” the company said.

As it shuts down the tool to catch AI-generated writing, OpenAI said it plans to “develop and deploy mechanisms that enable users to understand if audio or visual content is AI-generated.” There’s no word yet on what those mechanisms might be, though.

OpenAI fully admitted the classifier was never very good at catching AI-generated text and warned that it could spit out false positives, aka human-written text tagged as AI-generated. OpenAI, before it added its update shutting down the tool, said the classifier could get better with more data.

top 1 comments
sorted by: hot top controversial new old
[–] Iunnrais@lemm.ee 2 points 2 years ago* (last edited 2 years ago)

My understanding is that for image generating AI, the way the models work is that a detector has to develop alongside the generator, as distinguishing AI images is how it makes the images in the first place. No matter how good the image gen is, you will necessarily also get a detector as a byproduct.

LLMs don’t work that way. There is nothing to say it is even theoretically possible to make a detector for a given sophistication of LLM. The best you can really do is have a system say whether its LLM could have generated the text in question… but if the LLM is good enough, then it should be able to generate most human written texts, so… that’s pretty useless.

load more comments
view more: next ›