Posts on Noureddine RAMDI

Posts on Noureddine RAMDIhttps://ramdi.fr/post/Recent content in Posts on Noureddine RAMDIHugoenSat, 23 May 2026 20:41:27 +0000Hunting Tokens/sec: 4 LLM Backends, 1 Hard Ceiling (Part 2/4)https://ramdi.fr/post/ai-llm/local-llm-tokens-per-second-benchmark/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-tokens-per-second-benchmark/Part 2 of 4: a benchmark journal across nixpkgs llama.cpp, upstream master, and ik_llama.cpp on Qwen3.6-27B. Six hours, four backends, all converging at 66 tok/s — and the physical reason why.Speculative Decoding Meets Hybrid SSM: Why It Breaks (Part 3/4)https://ramdi.fr/post/ai-llm/local-llm-speculative-decoding-hybrid-ssm/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-speculative-decoding-hybrid-ssm/Part 3 of 4: a deep-dive into why speculative decoding silently breaks (or runs anti-economically) on hybrid attention+SSM architectures like Qwen3.6, Mamba-2, and RWKV — and what would need to change upstream to fix it.The NixOS Setup for llama.cpp: Declarative and Reproducible (Part 4/4)https://ramdi.fr/post/ai-llm/local-llm-nixos-llama-server-module/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-nixos-llama-server-module/Part 4 of 4: the actual NixOS module, llama-pull helper, claude-code-router wiring, and one-line workflow for switching models. Five Nix files for a complete, isolated, rollback-able local LLM service.Why I Serve Qwen3.6 Locally on My RTX 5090 (Part 1/4)https://ramdi.fr/post/ai-llm/local-llm-rtx5090-why-nixos/Tue, 28 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/local-llm-rtx5090-why-nixos/Part 1 of 4: motivation, hardware, and stack choices for serving Qwen3.6-27B locally on a 32 GB consumer GPU with NixOS, before any benchmarks or trade-offs kick in.Getting Started with Nix Flakeshttps://ramdi.fr/post/nixos/getting-started-with-nix-flakes/Sun, 12 Apr 2026 00:00:00 +0000https://ramdi.fr/post/nixos/getting-started-with-nix-flakes/A practical introduction to Nix Flakes — the modern way to manage NixOS configurations and development environments.Building AI Agents with Claude Codehttps://ramdi.fr/post/ai-llm/building-ai-agents-with-claude/Sat, 11 Apr 2026 00:00:00 +0000https://ramdi.fr/post/ai-llm/building-ai-agents-with-claude/How to leverage Claude Code to build autonomous AI agents that publish content, review code, and manage workflows.