I think we're at a point were the hardware right now does not fit with the algorithm being used. Since they take so much power due to our computers being digital. Having a transistor only capable of holding 1 state (0V or 5V usually) is inefficient. The heat add up as you multiply especially with LLMs. There seems to be a potential for analog where a transistor acts more on a range 0 - 5v. Which in theory could store more information or directly represent what LLM runs on (floating point). For more context 1 float tends to be 32bits. 1 bit is 1 transistor so 1 float = 32 transistor. While an analog transistor could be 1 float = 1 analog transistor.
Lemmy Shitpost
Welcome to Lemmy Shitpost. Here you can shitpost to your hearts content.
Anything and everything goes. Memes, Jokes, Vents and Banter. Though we still have to comply with lemmy.world instance rules. So behave!
Rules:
1. Be Respectful
Refrain from using harmful language pertaining to a protected characteristic: e.g. race, gender, sexuality, disability or religion.
Refrain from being argumentative when responding or commenting to posts/replies. Personal attacks are not welcome here.
...
2. No Illegal Content
Content that violates the law. Any post/comment found to be in breach of common law will be removed and given to the authorities if required.
That means:
-No promoting violence/threats against any individuals
-No CSA content or Revenge Porn
-No sharing private/personal information (Doxxing)
...
3. No Spam
Posting the same post, no matter the intent is against the rules.
-If you have posted content, please refrain from re-posting said content within this community.
-Do not spam posts with intent to harass, annoy, bully, advertise, scam or harm this community.
-No posting Scams/Advertisements/Phishing Links/IP Grabbers
-No Bots, Bots will be banned from the community.
...
4. No Porn/Explicit
Content
-Do not post explicit content. Lemmy.World is not the instance for NSFW content.
-Do not post Gore or Shock Content.
...
5. No Enciting Harassment,
Brigading, Doxxing or Witch Hunts
-Do not Brigade other Communities
-No calls to action against other communities/users within Lemmy or outside of Lemmy.
-No Witch Hunts against users/communities.
-No content that harasses members within or outside of the community.
...
6. NSFW should be behind NSFW tags.
-Content that is NSFW should be behind NSFW tags.
-Content that might be distressing should be kept behind NSFW tags.
...
If you see content that is a breach of the rules, please flag and report the comment and a moderator will take action where they can.
Also check out:
Partnered Communities:
1.Memes
10.LinuxMemes (Linux themed memes)
Reach out to
All communities included on the sidebar are to be made in compliance with the instance rules. Striker
Do you have a link to any research on a push to analog transistors and their properties? I have been reading up on transistors (and vacuum tubes) but haven’t seen any discussion on this.
Also much lower voltages are typical in modern transistors, from 1-1.5v.
My mistake, I made it look like that's a fact I'll edit that as my opinion. Though here is one I can find.
https://www.nature.com/articles/s43588-024-00753-x
Article also https://spectrum.ieee.org/analog-ai-2669898661
I think the entire idea of ai and the Internet in general taking up power and water needs to be fleshed out and explained to everyone. Even to me it’s a vague notion, I heard about it a few years back but can’t explain it to someone like my parents who would have no idea the Internet requires water to run
It's not too hard. AI requires a LOT of work. Work requires energy. Some energy is wasted during this and the byproduct is heat. The heat has to be removed for many reasons, and water is very good at doing that.
It's like sweating, it cools you down. But you need water to sweat.
Wasn't there an article posted yesterday about a group trying to create a biological computer that was living cells do to their efficiency of use on less power? (They are far from close, they basically took skin cells, ionized them, and had no idea how they were going to get them to stay alive long term yet.
Even that won't be anywhere close to the efficiency of neurons.
And actual neurons are not comparable to transistors at all. For starters the behaviour is completely different, closer to more complex logic gates built from transistors, and they're multi-pathway, AND don't behave as binary as transistors do.
Which is why AI technology needs so much power. We're basically virtualising a badly understood version of our own brains. Think of it like, say, PlayStation 4 emulation - it's kinda working but most details are unknown and therefore don't work well, or at best have a "close enough" approximaion of behaviour, at the cost of more resource usage. And virtualisation will always be costly.
Or, I guess, a better example would be one of the many currently trending translation layers (e.g. SteamOS's Proton or macOS' Rosetta or whatever Microsoft was cooking for Windows for the same purpose, but also kinda FEX and Box86/Box64), versus virtual machines. The latter being an approximation of how AI relates to our brains (and by AI here I mean neural network based AI applications, not just LLMs).
Ya evolution is pretty cool.
And on that note the human physiology sacrifices quite a bit for its intelligence.
For example the reason humans come out as babies is because if they came out with a full sized brains they'd kill the mother!
It's all about the most proficient use of energy.
All it really takes is the Limitless pill. The protagonist in the movie Limitless gets so much done after taking the Limitless pill in the movie Limitless. Limitless is a movie about a man who discovers the Limitless pill to help him accomplish almost limitless amount of things. But he learns that there is a limit that the Limitless pill can do if he takes it for too long. Because the Limitless pill isn’t really limitless.
Limitless = Adderall
It gets somewhat retconned in the TV series though where he's basically just this political genius who secretly runs everything.
The TV show is a lot better than it has any right to be, it's a shame it only got one season.
He learns the hard way that he needs to find a way to limit his dependency on the Limitless pill.
For example of course
Compare 1 human to one LLM session, instead of one human to all LLMs on Earth, and you’ll see that we’re way less efficient
It's an efficient, if somewhat finicky intelligence. It checks out commander.
actual intelligence
You have a lot of faith in me.
At this point, I feel like they actually excel at classifying people by political views and all the red number as covered by spy agencies... call it a conspiracy, but its my shot in the dark