Show HN: KV-psi, using Linux PSI to to trim an LLM KV cache https://ift.tt/FYLktgj

Show HN: KV-psi, using Linux PSI to to trim an LLM KV cache I thought it'd be interesting to use Linux PSI (Pressure Stall Information) for an LLM runtime to trim the KV cache. This is mainly useful imo for edge devices like the Jetson Orin super nano kit which have unified memory. I haven't benched much, but plan to do so more over time and see if I can make a real use of it as I run local LLMs. Let me know if it makes sense :P (I of course vibed this idea) https://ift.tt/Xu4oAcn June 27, 2026 at 11:50PM