padreug

I am brand new to Pi as of this week, so far my evolution in the past years went from... Visual Studio (oh wow it'd been so long i've forgotten the name 🤣).... then Cursor... then Claude Code. I tried a few neovim integrated AI workflows over a year ago, but they were all too buggy.

I caught wind of Pi I think from the youtuber omerxx and decided to give it a spin cause of its claims to be highly customizable. I haven't had the same time I did in the past to really tinker with my setups, but I figure i'll do it in baby steps over time.

Thanks for the info, it's totally welcomed - I am trying my best to learn by sponge mode 🧽 😄

Yeah, I had not considered using one of those middle grounds and will check them out 🙏

Great, thanks for the info! How do you like hermes, have you tried out pi?

Did you give Qwen3.8-27B-FP8 a try?

I haven't, it seems like I can't do this with my current Vulkan setup, but I'll do some exploration.

I'm also waiting for the nixos support for glm 5.3 flash

Hey! thanks for the reply :) yeah the slowing down part is a big factor.. i'm certainly being a little impatient, so well received 🙏😁
I had also noticed I had a big mismatch in my pi models.json's contextWindow and maxTokens, which I just fixed (shown in another comment) so going to test it out some more.

Hey, thanks for the reply, the speed is actually pretty good!

So it's running on llama.cpp (llama-server) b10408, Vulkan/RADV, behind llama-swap.

Your questions made me realize i also had a mismatch in my pi model config, the contextWindow and maxTokens had drifted apart pretty significantly so I just fixed that now.

/etc/nixos/configuration.nix

  services.llama-swap = {
    enable = true;
    package = pkgs.llama-swap;
    listenAddress = "0.0.0.0";
    port = 8080;
    openFirewall = true;

    settings = {
      # 63 GB off NVMe cold is slow. The default 120s will time out.
      healthCheckTimeout = 600;
      logLevel = "info";

      models = {
        "glm-flash" = {
          # Keep "local" as an alias so existing clients keep working
          # without touching their base URL or model name.
          aliases = [ "local" "fast" ];
          ttl = 1800;
          cmd = ''
            ${lib.getExe' pkgs.llama-cpp-vulkan "llama-server"}
            --port ''${PORT}
            -m /srv/llm/models/GLM-4.7-Flash-Q8_0.gguf
            -ngl 999 --flash-attn on -c 131072 -np 1
            --jinja --no-webui
            --reasoning-format auto --reasoning-preserve
            --temp 1.0 --top-p 0.95 --repeat-penalty 1.0
            --cors-origins "http://optimus.local:8080,http://localhost:8080/"
          '';
        };

        "gpt-oss-120b" = {
          aliases = [ "smart" ];
          ttl = 1800;
          cmd = ''
            ${lib.getExe' pkgs.llama-cpp-vulkan "llama-server"}
            --port ''${PORT}
            -m /srv/llm/models/gpt-oss-120b/gpt-oss-120b-MXFP4.gguf
            -ngl 999 --flash-attn on -c 65536 -np 1
            --jinja --no-webui --reasoning-format auto
            --temp 1.0 --top-p 1.0 --top-k 0 --min-p 0.0
            --cors-origins "http://optimus.local:8080,http://localhost:8080/"
          '';
        };
      };
    };
  };

~/.pi/agent/models.json (fixed)

{
  "providers": {
    "optimus": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "ollama",
      "models": [
        {
          "id": "local",
          "name": "GLM-4.7-Flash Q8_0 (optimus)",
          "aliases": ["fast", "glm-flash"],
          "reasoning": true,
          "contextWindow": 131072,
          "maxTokens": 32768,
          "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 }
        },
        {
          "id": "smart",
          "name": "GPT-OSS-120B (optimus)",
          "aliases": ["gpt-oss-120b", "oss"],
          "reasoning": true,
          "contextWindow": 65536,
          "maxTokens": 16384,
          "cost": { "input": 0, "output": 0, "cacheRead": 0, "cacheWrite": 0 }
        }
      ]
    }
  }
}

ah thanks :)

additionally, i'm not saying that opposing racism or bigotry is immature. I'm saying throwing out a successful open-source project because the owner is allegedly a racist/bigot (i admittedly know nothing or care to know anything about this DHH character) is counterproductive. Is the code racist/bigoted? If I make something using Omarchy as my OS, am I racist/bigoted? It sounds like that's what you're implying...

i find it interesting you think that i do not have kindness or empathy based on my stance. I'd be curious if you were to meet me in real life if you could pick me out of a hypothetical lineup.

This project has received money because it has drawn people to linux. I can still appreciate open-source code even if it's written by an asshat.

On the other hand, I won't touch an Apple product and I judge tech enthusiasts who do. I will still say they make impressive products, but I have a strong stance against proprietary code for the sake of profit.

herdr is another one that's out there. I've tried it out and have been driving it for a while. I like it cause I have a lot of agents open and it tells me who's blocked

don't forget, even a broken clock is right twice a day 😄