Hardware
VRAM
The memory on a GPU, measured in gigabytes. It holds the model weights, working data and caches while the GPU runs.
Why it matters
If a model does not fit in VRAM, it must be split across GPUs or shrunk, which changes both cost and complexity.
Want a deeper answer?
Ask Kova to explain VRAM in the context of your workload. Meet Kova →