Skip to main content
Find my setup

Large

Large AI hosting: several GPUs in one machine

Several GPUs in one machine for models of about 120 billion parameters and up.

Last updated

Server
2–8 GPUs in one machine
From
€4.34 or $35.28 an hour (about €3,168 or $25,754 a month)
Checked
25 Oct 2026

Monthly costs for hourly prices assume the server runs all month (730 hours).

Large plans give you several GPUs joined in one machine, or one GPU with 180 to 288 GB of memory, so a model too big for one ordinary card still fits. Models of 120 to 250 billion parameters built as a mixture of experts (only part of the model works on each word) need about 160 to 560 GB of GPU memory. Models of 400 billion parameters and more need eight cards such as the H200.

These machines are rented by the hour or by the month. Before you rent one, check whether a model API would do the job: with an API, the provider runs the GPUs and you pay for the tokens you send and receive.

For a model that fits one GPU, see Medium AI hosting.

What fits

These are the set-ups our finder suggests for this size, each with the reason.

  • 2–4 GPUs in one machine

    120–250B mixture-of-experts models need about 160–560 GB of GPU memory, which takes several GPUs joined in one machine.

  • One 8-GPU machine

    Models of 400B and more, such as DeepSeek V3.2, need eight H200s or similar in one machine.

Large plans we compare

You can filter them by billing or data-centre location. Each price shows the date we last checked it on the provider's own page.

Showing 9 plans from 4 of the 14 providers we compare, in our published ranking order. Prices exclude VAT unless the provider says otherwise.
Provider What you rent Size From Billing New-customer offer Link
Unihost AZM-11, 8x NVIDIA A100 · 8× 80 GB GPUs A dedicated server in the Netherlands with eight A100 cards, two Xeon Gold 6226R processors, 384 GB of memory, 2 TB of NVMe storage and a 10 Gbps port. Large €5,390.90/month monthly, paid in advance; minimum one month checked 25 Oct 2026 Monthly No offer Visit
UpCloud GPU Server, 2 x NVIDIA H100, 24 cores, 480 GB · 2× 80 GB GPUs Two dedicated NVIDIA H100 SXM cards with 24 cores and 480 GB of RAM in one server, charged by the hour in Helsinki. Large €4.34/hour (about €3,168/month) on demand, billed by the starting hour; price for the whole 2-GPU server checked 25 Oct 2026 Hourly No offer Visit
UpCloud GPU Server, 8 x NVIDIA H100, 96 cores, 1920 GB · 8× 80 GB GPUs Eight dedicated NVIDIA H100 SXM cards with 96 cores and 1,920 GB of RAM in one server, charged by the hour in Helsinki. Large €17.36/hour (about €12,673/month) on demand, billed by the starting hour; price for the whole 8-GPU server checked 25 Oct 2026 Hourly No offer Visit
GPU Mart Enterprise Multi-GPU Dedicated Server - 4xRTX A6000 · 4× 48 GB GPUs A whole server with four RTX A6000 cards (48 GB each), two 22-core E5-2699v4 processors, 512 GB of memory and a 1 Gbps unmetered port. Large $1,199/month monthly rate of a 24-month term, paid in advance · VAT not stated checked 25 Oct 2026 Monthly A free 24-hour trial of a VPS, dedicated or GPU server for new clients, on request checked 25 Oct 2026 Visit
Unihost AZM-12, 8x NVIDIA H100 NVLink · 8× 80 GB GPUs A dedicated server in the Netherlands with eight H100 cards linked by NVLink, two Xeon Gold 6448Y processors, 2,048 GB of memory and a 10 Gbps port. Large €13,890.90/month monthly, paid in advance; minimum one month checked 25 Oct 2026 Monthly No offer Visit
GPU Mart Enterprise Multi-GPU Dedicated Server - 2xRTX 5090 · 2× 32 GB GPUs A whole server with two RTX 5090 cards (32 GB each), two 22-core E5-2699v4 processors, 256 GB of memory and a 1 Gbps unmetered port. Large $859/month monthly rate of a 24-month term, paid in advance · VAT not stated checked 25 Oct 2026 Monthly A free 24-hour trial of a VPS, dedicated or GPU server for new clients, on request checked 25 Oct 2026 Visit
GPU Mart Enterprise Multi-GPU Dedicated Server - 4xA100 · 4× 40 GB GPUs A whole server with four 40 GB A100 cards joined by NVLink, two 22-core E5-2699v4 processors, 512 GB of memory and a 1 Gbps unmetered port. Large $1,899/month monthly rate of a 24-month term, paid in advance · VAT not stated checked 25 Oct 2026 Monthly A free 24-hour trial of a VPS, dedicated or GPU server for new clients, on request checked 25 Oct 2026 Visit
DigitalOcean GPU Droplet, 8 x NVIDIA H100 · 8× 80 GB GPUs Eight NVIDIA H100 cards with 640 GB of GPU memory in total, 160 vCPUs and 1,920 GiB of RAM in one machine, billed by the second. Large $35.28/hour (about $25,754/month) on demand, billed per second; price for the whole 8-GPU machine · VAT not stated checked 25 Oct 2026 Per second New accounts get a $5 credit that lasts 90 days and covers every product except SaaS add-ons checked 26 Oct 2026 Visit
Unihost LWN-G17, 4x Nvidia H100 · 4× GPUs A dedicated server in the Netherlands with four H100 cards, two EPYC 9224 processors, 512 GB of DDR5 memory, two 960 GB NVMe drives and a 10 Gbps port. Large €4,399.90/month monthly, paid in advance; minimum one month; plus a one-off set-up fee of €36.90 checked 25 Oct 2026 Monthly No offer Visit

Where to go next

Not sure which size you need? Answer four questions in our finder.