No Stupid Questions
No such thing. Ask away!
!nostupidquestions is a community dedicated to being helpful and answering each others' questions on various topics.
The rules for posting and commenting, besides the rules defined here for lemmy.world, are as follows:
Rules (interactive)
Rule 1- All posts must be legitimate questions. All post titles must include a question.
All posts must be legitimate questions, and all post titles must include a question. Questions that are joke or trolling questions, memes, song lyrics as title, etc. are not allowed here. See Rule 6 for all exceptions.
Rule 2- Your question subject cannot be illegal or NSFW material.
Your question subject cannot be illegal or NSFW material. You will be warned first, banned second.
Rule 3- Do not seek mental, medical and professional help here.
Do not seek mental, medical and professional help here. Breaking this rule will not get you or your post removed, but it will put you at risk, and possibly in danger.
Rule 4- No self promotion or upvote-farming of any kind.
That's it.
Rule 5- No baiting or sealioning or promoting an agenda.
Questions which, instead of being of an innocuous nature, are specifically intended (based on reports and in the opinion of our crack moderation team) to bait users into ideological wars on charged political topics will be removed and the authors warned - or banned - depending on severity.
Rule 6- Regarding META posts and joke questions.
Provided it is about the community itself, you may post non-question posts using the [META] tag on your post title.
On fridays, you are allowed to post meme and troll questions, on the condition that it's in text format only, and conforms with our other rules. These posts MUST include the [NSQ Friday] tag in their title.
If you post a serious question on friday and are looking only for legitimate answers, then please include the [Serious] tag on your post. Irrelevant replies will then be removed by moderators.
Rule 7- You can't intentionally annoy, mock, or harass other members.
If you intentionally annoy, mock, harass, or discriminate against any individual member, you will be removed.
Likewise, if you are a member, sympathiser or a resemblant of a movement that is known to largely hate, mock, discriminate against, and/or want to take lives of a group of people, and you were provably vocal about your hate, then you will be banned on sight.
Rule 8- All comments should try to stay relevant to their parent content.
Rule 9- Reposts from other platforms are not allowed.
Let everyone have their own content.
Rule 10- Majority of bots aren't allowed to participate here. This includes using AI responses and summaries.
Credits
Our breathtaking icon was bestowed upon us by @Cevilia!
The greatest banner of all time: by @TheOneWithTheHair!
Succint
AI is a vast field. LLMs and neural networks are a small part of it.
LLMs are very expensive to run and a lot more complex than the markov chains often used for predictive text.
Predictive text just chooses a likely word based on what's typed. This may be as simple as looking for words that start with what you've typed.
LLMs vectorise words and understand the complex relationship between vectors using many data points. So it would spot the word "two" and realise that plurals are used with it.
Predictive text also can vectorize words, but the number of vectors per word are much, much simpler.
Now guess how it feels to type German with predictive text. Most of our words can have more than a dozen different word endings depending on time and how the word is used. And that's not taking into account that we use compound words, which word prediction pretty much cannot predict and often doesn't even know. So spell check will mark a legal compound word as misspelled, because it doesn't understand the concept of compound words and doesn't know this specific word combination.
To show what I mean, the term "Danube steam boat captain's hat" becomes "DonauDampfSchiffKapitänsMütze" (I added capital letters which shouldn't be there to show where the next word in the compound word begins).
While this is an extreme example, it's pretty common for compound words to consist of 4-5 words.
And for some reason, some cases seem to be missing completely on my Android default keyboard. "untersuchst", just like a bunch of second person cases for slightly unusual words is non existent.
Yeah, noticed that too. This is really annoying.
My favourite: 'geröntgt' which is the second participle of 'röntgen' to x-ray someone. Never heard it pronounced correctly by a native speaker.
Dutch also has the issue with the compound words. Autocorrect will often put a space in there, which is grammatically incorrect (and ugly). I feel like it’s at a point now where the incorrect space usage has become mainstream and might change the language rules. Oh well.
LLMs are orders of magnitude more sophisticated and expensive to run. But don't worry, I'm sure not so far in the future we will see smaller LLMs being run on device to be used as autocorrect.
It would have to be pretty specific and small to work on a phone and I think a side effect would be everyone's conversations start to sound a lot more homogeneous.
you're not wrong. Google just announced Gemini Nano that will run directly on the Pixel 8. Of course, it's the first of it's kind and will probably be slow and it's not used as autocorrect yet. But just give it one year or two and it will probably be more common.
Even give years ago, Google had a keyboard that skimmed your emails and texts to start a bank of words you use to supplement it's dictionary for autocorrect. Like if you are a chemist and send an email that includes the word "tetrahydrafuran" every couple month, it would be nice for your phone keyboard to just have it in the dictionary.
SwiftKey does that if you give it access to your emails.
Can we have Scottish ones that know what a bawbag is, and when to put an "e" on the end of "shit"?
Thanks!
Think of it from the LLM's perspective - in the general pool you have common English, you have less common variations such as this, and then you have whatever the heck people like Kid Rock are doing...
Bawitdaba, da bang, da dang diggy diggy
Diggy, said the boogie, said up jump the boogie
Because they're using different tech. That's like asking why do phone calls sound bad compared to voip calls. They're just using different tech.
Lawnmowers can't keep up with Ferraris either, despite both being vehicles.
edit for wording
You're in the No Stupid Questions community. Think about rule 7 in particular.
Ah, thank you. I'll edit.
LLMs like chatgpt take a wild amount of resources to run.
If you want something as smart as gpt3 and you want it to run at typing speeds, you’ll need a gaming PC running it.
People just recently managed to run gpt3 strength models at all on ordinary laptop hardware (slowly).
There is currently no way to run something gpt4 strength on ordinary consumer hardware (I’m just guessing but I think it takes a few hundred gb of VRAM to run)
@Mr_Blott@lemmy.world autocorrect doesn’t use LLMs, at least not yet generally. I suspect it is some kind of markov model or maybe?
What the duck are you talking about?