Gpu-Inference on Noureddine RAMDIhttps://ramdi.fr/tags/gpu-inference/Recent content in Gpu-Inference on Noureddine RAMDIHugoenSat, 23 May 2026 20:41:27 +0000Zinc: A Zig-based LLM inference engine optimized for AMD RDNA and Apple Silicon GPUshttps://ramdi.fr/github-stars/zinc-a-zig-based-llm-inference-engine-optimized-for-amd-rdna-and-apple-silicon-gpus/Tue, 05 May 2026 13:37:39 +0000https://ramdi.fr/github-stars/zinc-a-zig-based-llm-inference-engine-optimized-for-amd-rdna-and-apple-silicon-gpus/Zinc is a Zig-written LLM inference engine using Vulkan and Metal for AMD RDNA and Apple Silicon GPUs. It supports GGUF quantized models and exposes an OpenAI-compatible API with streaming.