Articles tagged with “quantization”

Hardware Requirements for Running GPT-OSS-20B Locally

Learn the hardware requirements for running OpenAI's GPT-OSS-20B model locally. This guide covers GPU VRAM, CPU, system RAM, and other key components.

15 min read

9/28/2025

gpt-oss-20b large language models local inference hardware requirements ai workstation gpu vram quantization nvidia rtx

Local LLM Deployment on 24GB GPUs: Models & Optimizations

This report details deploying LLMs on 24GB GPUs, covering model architectures, VRAM needs, and optimization methods for efficient local operation.

5 min read

5/27/2025

large language models local llms gpu inference llm deployment vram optimization quantization gguf inference frameworks