https://namesny.com/tags/ai/ Recent content in Ai on Hugo en-us Wed, 04 Feb 2026 00:00:00 +0000 https://namesny.com/blog/homelab/ Wed, 04 Feb 2026 00:00:00 +0000 https://namesny.com/blog/homelab/ <p>As part of my job over the past year, I&rsquo;ve been deploying and evaluating LLMs locally on various hardware setups. Naturally, I became well versed in the open source tools and models available and various hardware options. So I decided to build my own homelab for local inference.</p> https://namesny.com/blog/llamactl/ Thu, 04 Sep 2025 00:00:00 +0000 https://namesny.com/blog/llamactl/ <p>If you&rsquo;re running LLMs locally, you&rsquo;ve probably used Ollama or LM Studio. But they are effectively wrappers for llama.cpp. They’re convenient, but they impose limits that get in the way once you start trying to squeeze maximum performance out of your hardware.</p>