themadcodger

The LLM for home assistant, or just HA in general doesn't move the needle? My HA is also pretty low key, but I was considering the idea of running my own small llm to use with HA to get off of OpenAI. My current AI usage is very small, so I wouldn't need too much on the GPU side I'd imagine, but I don't know what's sufficient.

I think I mentioned somewhere, but if not, over the last couple of years I learned a lot about the software side of running my homelab via synology and the vps's, but I still know almost nothing about hardware, so this is all really useful information. Thanks!

So I want to reduce the cooling, CPU (get one with integrated graphics), and motherboard, and not necessary but look into adding ssd and more memory.

I'm okay with spending a bit up front if it'll last a long time, but I also don't want to buy too much and be useless.

Yeah, I posted this assuming I would get a lot of comments about it being more than I needed, and this was already me paring it down. But then I got a lot of comments saying to add more memory, reduce the cooling, and add a ssd but otherwise not much about reducing it.

Then how does Australia get a pass?

Yeah, I'm not sure if I really want to deal with an llm. It would mostly be for home assistant, so nothing too crazy.

Can I make use of two existing 3.5" and 4 2.5" drives with that?

Interesting, why intel?

Someone else mentioned the cooler too, so that's out for sure. To be honest, I never really thought about graphics in the traditional sense, but I do need something for at least Jellyfin transcoding. And maybe a small llm. Would it be better to get a dedicated GPU or CPU with integrated?

Thanks! Wasn't sure about the cooling, so that's good to know. And yeah, I didn't know if I actually wanted graphics or not. Whether integrated or a card. Actually, now that I'm typing this out, I do need something for Jellyfin transcoding at least.

There is a part of me that wanted to run my own small llm to go with home assistant, but I don't think that's really necessary.

Thanks! It has space for two more sticks, but I just assumed 32gb would be overkill for what I'd need and was saving it for the future. Good point on the other two.

Ooh, that's good to know. I believe the Meshify only has two 2.5" which means I'd need to figure out a solution for the other two I have. The "mesh" and airflow is what drew me to that case. How's the Define?

I've had AdGuard Home running in various places, but always struggled with getting it to show which device was making the call while also being protected while away from my local network. Just keeping the house secure wasn't a problem, but routing my traffic while out always seemed to cause problems. Moreso on the synology.

What's your use case look like?