https://ramdi.fr/tags/qwen/Recent content in Qwen on Noureddine RAMDIHugoenSat, 23 May 2026 20:41:27 +0000https://ramdi.fr/post/ai-llm/local-llm-tokens-per-second-benchmark/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-tokens-per-second-benchmark/Part 2 of 4: a benchmark journal across nixpkgs llama.cpp, upstream master, and ik_llama.cpp on Qwen3.6-27B. Six hours, four backends, all converging at 66 tok/s — and the physical reason why.https://ramdi.fr/post/ai-llm/local-llm-speculative-decoding-hybrid-ssm/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-speculative-decoding-hybrid-ssm/Part 3 of 4: a deep-dive into why speculative decoding silently breaks (or runs anti-economically) on hybrid attention+SSM architectures like Qwen3.6, Mamba-2, and RWKV — and what would need to change upstream to fix it.https://ramdi.fr/post/ai-llm/local-llm-rtx5090-why-nixos/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-rtx5090-why-nixos/Part 1 of 4: motivation, hardware, and stack choices for serving Qwen3.6-27B locally on a 32 GB consumer GPU with NixOS, before any benchmarks or trade-offs kick in.