What’s over? Except for my head
this post was submitted on 11 Jul 2023
18 points (95.0% liked)
ChatGPT
9671 readers
1 users here now
Unofficial ChatGPT community to discuss anything ChatGPT
founded 2 years ago
MODERATORS
"Half of those additions are censors and more creative ways to say 'sorry, I can't do that for you Jim.'" Lol, I'm just kidding, 1.8t parameters is incredible.
I just really hope that it's not as censored as it currently is. ;_;
The interesting part to me:
The missing dataset it a custom dataset of college textbooks collected by hand for as much courses as possible.
This is very easy to convert to txt file and than with self-instruct into instruction form. This creates the "illusion" that GPT-4 "is smart" no matter who use it.
Computer scientist? sure! it can help you with your questions about P!=NP Philosophy major? It can totally talk to you about epistemology.
Don't you see? It was trained on the textbooks. It is so obvious.
This could explain some (but not all) of the 'magic' I have seen with GPT4 vs GPT3.
If you put a bunch of textbooks into Google, it still couldn't help me build a video game engine
Thread reader link is down (Twitter API limits I guess). Is there any backups?
its just a bit of a rant based on this, source article is still here and kicking. https://lemmy.intai.tech/post/72922
also check out the recent Gerorge Hotz, Freidman podcast.
its been kind of an open secret for weeks now, people are digging to try and prove it out.
Oh I see. Thanks, it's interesting stuff
People who shit on AI "hallucinations" are the same kind of people who called the Wright Brother's Flyer, jank.
Wasn't there some newspapers that said that it would take one million years before humans could fly about two weeks before the Flyer?
Hell, we have gone from hunter gatherers to a technologically advanced society in less time than that. The moral of the story being journalists are idiots and should be ignored.
I doubt it. They’d be pretty old, if so
Yeah but the original Wright Flyer was extremely janky. It took decades before planes were safe enough for the general public to fly on them. I doubt it’s going to take decades for LLM’s to get really good, but it’s undeniable that the current generation of these systems are somewhat lacking in quality
Yeah, I agree. Just because it's bad now, doesn't mean it won't be good later. The only way to fix the problems something has is by recognizing them, and working on them. Imagine if people didn't point out the AI hallucinations? We'd never get anywhere with LLMs. Not shitting on the first guy, I get where he's coming from it's a damn cool time to be alive, LLMs are incredible and can only get better from here(that is of course if they don't keep slapping F*****g censors on it!). but it's important for us to recognise the flaws in the system so it and we can grow.
Yawn
view more: next ›