Inference Frameworks Articles | IntuitionLabs

Back to Articles

Articles tagged with “inference-frameworks”

Local LLM Deployment on 24GB GPUs: Models & Optimizations

Local LLM Deployment on 24GB GPUs: Models & Optimizations

This report details deploying LLMs on 24GB GPUs, covering model architectures, VRAM needs, and optimization methods for efficient local operation.

5 min read

5/27/2025

large language models local llms gpu inference llm deployment vram optimization quantization gguf inference frameworks