Headcount does not count: who types at once does
In an office, out of every ten people with access, one or two are waiting for an answer at any given moment. The rest are reading, thinking or doing something else. A company of fifty needs to serve about eight at once well, not fifty.
The exception is automated processes: if a program sends documents to the model non-stop, it counts as several people who never rest.
Graphics memory: the model and the conversations
The graphics card has to hold the model and, on top of it, the conversation of each person being served. A mid-sized model takes 10 to 20 GB. Each open conversation adds to that, and adds more if it includes long documents.
That is why a 16 GB card serves a small team, and 24 or 32 GB are needed as the number of people or the size of the documents goes up.
One large graphics card or two mid-sized ones
Two mid-sized cards serve more people at once, each with its own copy of the model, and if one fails the other carries on. One large card lets you load a bigger model, which reasons better. If capacity is what is missing, two. If answer quality is what is missing, one large one.
Professional graphics cards have error-correcting memory and are designed to work 24 hours a day inside a server.
Starting points by size
| People with access | Starting configuration | Price |
|---|---|---|
| Up to 5 | Ryzen 7 9700X · 32 GB · RTX 5060 Ti 16 GB | €3,076 |
| Up to 15 | Ryzen 9 9900X · 64 GB · RTX 5070 Ti 16 GB | €4,482 |
| Up to 30 | Ryzen 9 9950X · 64 GB · 2× RTX 5070 Ti 16 GB | €6,155 |
| Up to 60 | Ryzen 9 9950X · 128 GB · 2× RTX PRO 4000 Blackwell 24 GB | €12,252 |
| In a rack cabinet | AI Rack server, 24 GB RTX PRO 4000 | €6,407 |
| Large models for the whole company | AI Threadripper PRO server, 96 GB RTX PRO 6000 | €32,578 |
These are starting points. With your documents and your usage, we refine the configuration before giving a fixed price.
What surrounds the graphics card
The processor and system memory matter less than the graphics card, but they are not free: you need enough memory for the document index, a fast drive for the models and a power supply with headroom. If the server will sit in an office, noise is sized too.
Leaving room to grow
The cheapest option is to buy today with room for tomorrow: a board with a free slot for the second graphics card and a power supply that can take it. Expanding that way costs what the card costs. Changing machine costs the whole machine.
Related hardware and guides
Frequently asked questions
How many people can a 16 GB graphics card serve?
As a guide, a team of up to about five people with a mid-sized model. If they use long documents or many type at once, it falls short and it is worth moving to 24 GB or to two cards.
What happens if everyone logs in at once?
Answers get slower, but the server does not go down: requests wait their turn. If that happens often, it is the sign that it is time to expand.
Professional or consumer graphics card?
In a server working all day, professional: it has error-correcting memory, is certified for continuous use and fits better next to another. For a small team, a 16 GB consumer card is a reasonable starting point.
Can it be expanded later?
Yes, if it is ordered with room. The larger tiers have a free slot and a power supply for a second graphics card.
Shall we do the sums for your company?
Tell us how many people will use it and with which documents. We will reply with the hardware, the installation and a fixed price within 12 working hours.