Home
Hardware
Configurator
Services
OEM Guides About us Warranty Contact
ESENDEFRITPT
Compact · Unified memory

Compact computer with unified memory: artificial intelligence with 64 or 128 GB and no dedicated GPU

Until recently, running a large language model locally required an expensive graphics card with a lot of memory. Processors with unified memory change the sums: the model fits in system memory and the integrated GPU runs it. This guide explains when it is the best option and when it is not.

ACD&CO technical team7 November 20266 min read

What unified memory is

In a classic computer, the processor has its memory and the graphics card has its own, and a model has to fit in the card’s. In a processor with unified memory, both share the same 64 or 128 GB with high bandwidth: the integrated GPU can use almost all of that memory for the model. The result is a 10-litre unit, quiet and low-power, that runs models that do not fit in a 16 or 24 GB graphics card.

What it is for

For private assistants that summarise, draft and search the company’s documents; for language models of 30 to 70 billion parameters, quantised, that answer at reading speed; for offline vision and speech models; and for development and testing before moving to a server. All without data leaving the company and with the power draw of a large laptop.

What it is not for

For training models or serving many people at once: there compute power and the bandwidth of a dedicated GPU rule, and unified memory falls several times behind. Nor for generating images or video at production pace. In those cases, a workstation with an RTX PRO or an AI server.

The practical rule: if the bottleneck is that the model does not fit, unified memory; if the bottleneck is speed or the number of users, a dedicated GPU.

How much memory you need

Indicative memory by model size (quantised to 4 bits, with working context)
ModelMemory it takesMachine
7 to 8 billion parameters6 to 8 GBAny machine with 16 GB or an 8 GB graphics card
14 to 32 billion10 to 24 GB32 GB unified or a 24 GB graphics card
70 billion40 to 48 GB64 GB unified
Several models at once or a very long context64 to 100 GB128 GB unified

Leave headroom: the system, the conversation context and the documents loaded also take memory.

The form factor: 10 litres, quiet and wherever it is needed

A compact unit with unified memory fits on a desk, in an on-board cabinet or in a reception counter, with 12 to 24 V power if needed and, in the industrial version, fanless. We deliver it with the system and the inference engine installed, tested for 24 hours, and with the models you choose loaded. The price is quoted according to memory and form factor.

Frequently asked questions

Is it slower than a dedicated GPU?

In single-user response speed with a model that fits in both, the dedicated GPU is faster. The advantage of unified memory is that it runs models that do not fit in a 16 or 24 GB card, with far less power draw and noise.

How many people can use it at once?

A few. It is designed for a small team or a single desk, not to serve the whole company. For dozens of users, an AI server with a dedicated GPU.

Which models can I run?

Open language, vision and speech models, quantised: with 64 GB, models of up to 70 billion parameters; with 128 GB, several at once or very long contexts. We leave them loaded and tested.

Can it go on a boat or in a vehicle?

Yes. The industrial version is fanless, runs on 12 to 24 V, is vibration-tested and fits in shallow cabinets.

Where will your computer work?

Tell us the location, the power available and what it has to do. We will propose the compact unit, with tests and a price, within 12 working hours.

Ask for a proposal

A proposal within 12 working hours

Tell us what you need

Tell us what it is for and we will reply with a configuration and its price. If you already have a quote from another brand, send it over and we will prepare the equivalent.

  • A written reply within 12 working hours
  • A single point of contact, from quote to warranty
  • No obligation: we only use your details to reply

+34 613 17 68 06info@acdcompany.es

This field is required.
Check the email: something is missing.

Or call us: +34 613 17 68 06