NVIDIA
mid
A10
- 24 GB VRAM
- GDDR6
- 600 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 1.042 €/h
- €/GB
- –
BUY-SIDE · CONSUMER CARDS
GPUs with 24 GB VRAM or more
Graphics cards with at least 24 GB VRAM – enough for large local LLMs. Shop prices and hosting rates compared.
NVIDIA
high
A100
- 80 GB VRAM
- HBM2e
- 2,039 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.959 €/h
- €/GB
- –
NVIDIA
high
A100 40GB PCIe
- 40 GB VRAM
- HBM2e
- 1,555 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.247 €/h
- €/GB
- –
NVIDIA
mid
A30
- 24 GB VRAM
- HBM2
- 933 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 1.226 €/h
- €/GB
- –
NVIDIA
mid
A40
- 48 GB VRAM
- GDDR6
- 696 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 0.393 €/h
- €/GB
- –
AMD Radeon RX 7900 XTX
- 24 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- 879.99 €
- Hosting from
- –
- €/GB
- 36.670
NVIDIA
flagship
B200 SXM
- 192 GB VRAM
- HBM3e
- 8,000 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 6.713 €/h
- €/GB
- –
NVIDIA
flagship
B300
- 288 GB VRAM
- HBM3e
- 8,000 GB/s
- 2025
- Best shop price
- –
- Hosting from
- 6.00 €/h
- €/GB
- –
NVIDIA
enthusiast
GeForce RTX 3090
- 24 GB VRAM
- GDDR6X
- 936 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.101 €/h
- €/GB
- –
NVIDIA
enthusiast
GeForce RTX 3090 Ti
- 24 GB VRAM
- GDDR6X
- 1,008 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.112 €/h
- €/GB
- –
GeForce RTX 4090
- 24 GB VRAM
- GDDR6X
- 1,008 GB/s
- 2022
- Best shop price
- 14.90 €
- Hosting from
- 0.18 €/h
- €/GB
- 0.620
GeForce RTX 5090
- 32 GB VRAM
- GDDR7
- 1,792 GB/s
- 2025
- Best shop price
- 80.30 €
- Hosting from
- 0.281 €/h
- €/GB
- 2.510
NVIDIA
high
GeForce RTX 6000
- 48 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.496 €/h
- €/GB
- –
NVIDIA
flagship
H100
- 80 GB VRAM
- HBM3
- 3,350 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 1.44 €/h
- €/GB
- –
NVIDIA
flagship
H100 SXM
- 80 GB VRAM
- HBM3
- 3,350 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 1.204 €/h
- €/GB
- –
NVIDIA
flagship
H200
- 141 GB VRAM
- HBM3e
- 4,800 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 2.422 €/h
- €/GB
- –
NVIDIA
flagship
H200 SXM
- 141 GB VRAM
- HBM3e
- 4,800 GB/s
- 2024
- Best shop price
- –
- Hosting from
- 1.486 €/h
- €/GB
- –
NVIDIA
entry
L4
- 24 GB VRAM
- GDDR6
- 300 GB/s
- 2023
- Best shop price
- –
- Hosting from
- 0.494 €/h
- €/GB
- –
NVIDIA
high
L40
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.774 €/h
- €/GB
- –
NVIDIA
high
L40S
- 48 GB VRAM
- GDDR6
- 864 GB/s
- 2023
- Best shop price
- –
- Hosting from
- 0.436 €/h
- €/GB
- –
RTX 5000 Ada Generation
- 32 GB VRAM
- GDDR6
- 576 GB/s
- 2023
- Best shop price
- 4,999.00 €
- Hosting from
- –
- €/GB
- 156.220
NVIDIA
high
RTX 6000 Ada Generation
- 48 GB VRAM
- GDDR6
- 960 GB/s
- 2022
- Best shop price
- –
- Hosting from
- 0.831 €/h
- €/GB
- –
NVIDIA
mid
RTX A5000
- 24 GB VRAM
- GDDR6
- 768 GB/s
- 2021
- Best shop price
- –
- Hosting from
- 0.18 €/h
- €/GB
- –
NVIDIA
high
RTX A6000
- 48 GB VRAM
- GDDR6
- 768 GB/s
- 2020
- Best shop price
- –
- Hosting from
- 0.37 €/h
- €/GB
- –