Rez

joined 2 years ago
[–] Rez@sh.itjust.works 2 points 3 months ago (1 children)

Thank you so much for the suggestion! I tried Q8 of the model you mentioned, and I am very impressed with the results! The output itself was exactly what I wanted, the speed was a little on the slower side. Loading my previous conversation with a context of over 15k tokens took about 10 minutes to get the first response, but the later messages were much faster. The web ui loses connection almost every time though, and I just manually copy the response from the terminal window in to the web ui to save it for future context. I am currently downloading the Q6 model, and might experiment with going even lower for faster speeds and more stability, if the quality of the output doesn't degrade too much.

 

Hi, I don't have much experience with running local AIs, but have tried to use ChatGPT for psychoanalysis purposes and the smarter, but limited for free users model is amazing. I don't like giving such personal information to OpenAI though, so I'd like to set something similar up locally, if possible. I am running Fedora Linux, and have had the best results with KoboldCpp, as it was by far the easiest to set up. I have a Ryzen 7600, 32 GB of ram, and a 7800 xt (16 GB vram). The two things I mostly want from this setup is the smartest model possible, as I've tried some and the responses just don't feel as insightful or though provoking as ChatGPT's, and I also really like the way it handles memory. I don't need "real time" conversation speed, if it means I can get the smarter responses that I am looking for. What models/setups would you recommend? Generally, I've been going for newer + takes up more space = better, but I'm kind of disappointed with the results, although the largest models I've tried have only been around 16 GB, is my setup capable of running bigger models? I've been hesitant to try, as I don't have fast internet and downloading a model usually means keeping my pc running overnight.

PS, I am planning to use this mostly as a way to grow/reflect, not dealing with trauma or loneliness. If you are struggling and are considering AI for help, never forget that it can not replace connections with real human beings.

[–] Rez@sh.itjust.works 6 points 9 months ago

I need this on a shirt!

[–] Rez@sh.itjust.works 13 points 10 months ago (1 children)

Finally, POV used correctly in a meme!

[–] Rez@sh.itjust.works -2 points 10 months ago

How about you stop assuming everyone on the internet lives in the USA?

[–] Rez@sh.itjust.works 13 points 10 months ago (1 children)

thinks queer people are the ones who are confused

Not a native English speaker, so I might be completely wrong, but doesn't the word 'queer' litteraly mean 'confused' / 'weird'? Not that it makes a difference in this context, I'm just wondering

[–] Rez@sh.itjust.works 15 points 10 months ago (3 children)

Ha, I was expecting heavy metal

[–] Rez@sh.itjust.works 8 points 10 months ago (6 children)

What hobby/intrest got them to say that?

[–] Rez@sh.itjust.works 1 points 10 months ago

I imagine a kid who's smart enough to use a vpn, downloading a bunch of videos, and then selling usb drives to their friends at school, or sharing them via gdrive

[–] Rez@sh.itjust.works 4 points 10 months ago (1 children)

Yes, it's really good! I do think that it can become a bit repetitive towards the end, but it's worth it for the beginning moments of exploration and discovery. If you haven't played a similar game like Morrowind before, I'd recommend looking for a guide that would explain character creation and skills. I never played the original, so I am no purist and would encourage you to check out some QoL mods and definitely turn on smaller dungeons in the settings, even for a first playtrough. Have fun, if you decide to try it!

[–] Rez@sh.itjust.works 38 points 10 months ago (11 children)

Wouldn't the answer be "10" in that case?

[–] Rez@sh.itjust.works 10 points 11 months ago (1 children)

I bought The Farmer Was Replaced yestarday, so I'll probably be finishing it over the weekend. It's a cute programming incremental game, but if you have 0 experience with writing code the later challenges might get too difficult

[–] Rez@sh.itjust.works 28 points 11 months ago

I was going to say Factorio as well! :D Hollow Knight has a native port and is a fantastic game, but my favorite games are ones like OpenMW or DevilutionX where the entire engine is remade from the ground up and open-source

27
submitted 11 months ago* (last edited 11 months ago) by Rez@sh.itjust.works to c/letstalkaboutgames@feddit.uk
 

In all the games I've played (one exception being Half-Life, but that's different) I really don't like using crossbows and avoid doing so at all costs. I don't really know why that is, but to me they don't seem to fit the setting of games like Elder Scrolls or Gothic. I love using regular bows, however. Maybe crossbows feel too modern for me? I don't really know anything about medieval weapons or when they were invented.

What about you? How do you feel about crossbows in these types of games or do you have a similar weird thing you just don't like and refuse to do in video games?

 

Hello, I've installed Fedora 38 (KDE spin), about the time it came out and need a little help updating it.

I got a system update through Discover when 39 came out, I updated it restarted, and I didn't think much of it. Now that Fedora 40 came out, I did the same thing, but this time, after the update, I checked the system information in the settings, and it says that I am still running Fedora 38!

I have a dual boot system with Windows 10 (ugh, but I need it for work) and I noticed that in grub the option to boot Fedora also says 38. There are also some recovery boot options.

I'm confused and don't know what to do to update to 40? Would really like to avoid doing a fresh install.

I'd say I'm a novice Linux user, but this is the first time in dealing with something like this, so sorry if I missed some crucial information, will provide anything needed to help fix this issue.

Thanks in advance!

 

I have a laptop with a Ryzen 7 5700U, 16 GB ram, running Fedora 38 linux.
I'm looking to run a local uncensored LLM, I'd like to know what would be the best model and software to run it.
I'm currently running KoboldAI and Erebus 2.7b. It's okay in terms of speed, but I'm wondering if there's anything better out there. I guess, I would prefer something that is not web-ui based to lower the overhead, if possible.
I'm not very well versed in all the lingo yet, so please keep it simple.
Thanks!

view more: next ›