RE: How I Get Frontier Results With Local LLMs
by @tydynrain ยท 2026-09-29
Excellent video, my friend! I've been working with both local models, like Qwen3.5 35B-AB that you mentioned, as well as free open-source, open-weight cloud-based models, like GLM5.3-Flash, Kimi-K3, and Nemotron-3-Ultra in Hermes Agent on my Lenovo Legion 5 gaming laptop, though my main limitation with local models on this system is that I only have 8GB of VRAM, so I need to do CPU/RAM offloading to fit the larger models, and since I'm always doing a lot on my laptop, it's somewhat challenging. I only dove into all this in the spring, and I've come a very long way since then, and I'm just getting started! Local sovereign AI stacks are the way to go! ๐๐๐โจ๐ค
<sub>Posted via [HiveSuite](https://hivesuite.app/@tydynrain/9hgpyk89)</sub>