LLM VRAM Calculator
Estimate model weights, KV cache, runtime overhead, and GPU count for inference.
- Useful for
- Sizing a local server, inference node, or GPU request
- Output
- GiB required and minimum GPU count
AI infrastructure reference
Use transparent calculators for memory, power, and data movement. The provider directory links to official provisioning documentation without assigning invented scores or implying an integration.
Start with the workload
These tools run locally and show the arithmetic. They do not fetch live pricing, inventory, quota, or account data.
Estimate model weights, KV cache, runtime overhead, and GPU count for inference.
Turn a GPU count into IT load, facility load, cooling, energy, and electricity cost.
Estimate transfer time, effective throughput, replicas, egress, storage, and growth.
Source-linked provider research
Documentation links last reviewed August 2, 2026. Prices, inventory, quotas, regions, and product names can change; verify them directly before spending.
A container-oriented GPU Pod API suited to experiments, inference workers, and direct GPU selection.
A focused REST API for launching and managing GPU instances, images, SSH keys, filesystems, and firewalls.
A broad infrastructure API with GPU instance families, networking, IAM, storage, Spot, and mature lifecycle controls.
A REST and client-library surface for creating VMs with attached accelerators, IAM, networks, disks, and reservations.
An Azure Resource Manager API for creating GPU VMs within subscriptions, resource groups, networks, and identity controls.
A Kubernetes-first AI cloud whose CKS API creates and manages clusters before GPU node pools and workloads are attached.
Clear boundary
The calculators and provider research require no Run Any AI account, AI API key, provider key, or database. No provider is scored or recommended by an unpublished formula.
Creating infrastructure happens with the provider and requires an account, current price and capacity checks, scoped credentials, spend controls, monitoring, and dependable cleanup. The source notes are a starting point for that review—not a substitute for it.