gpuos

Compliance · 2 min read · updated Oct 6, 2026

GDPR and LLMs: keeping AI and SI data in the EU

What changes for GDPR when you run open models on your own GPUs instead of a US API, what gpuos stores, and a checklist for your records of processing.

Where the data goes with a hosted API

When an employee pastes a customer email into a hosted model, that personal data is transferred to the provider, often outside the EU. You then need a data processing agreement, a transfer mechanism and a clear retention story for every provider in the chain.

This guide explains how the architecture changes the picture. It is not legal advice; check your specific case with your DPO.

What changes when the model runs on your GPU

  • Processing location: inference happens on the GPU you choose, for example a server in Germany or Finland, or in your own office.
  • Model provider: open-weight models run locally, so the model vendor never sees your prompts.
  • Retention: you decide what is logged on your machines.

What gpuos itself processes

gpuos is built and hosted in the EU. API requests pass through the gpuos gateway, which forwards them to your node over the agent's outbound connection and streams the answer back.

DataStored by gpuos?
Prompt and completion textNo, only relayed
Token counts, latency, status, model, key, nodeYes, for usage metering
Account data: name, email, workspace membersYes
Model weightsNo, they live on your node

Checklist

  • List gpuos as a processor for account and metering data in your records of processing.
  • Document where your GPU nodes are located.
  • Create one API key per application so you can trace and revoke access.
  • Prefer licenses that allow commercial use without restrictions (Apache 2.0, MIT); every model page shows its license.

Questions

Is self-hosting automatically GDPR compliant?
No. It removes the third-party model provider from the data flow, which simplifies compliance, but you still need a lawful basis, retention rules and security measures.
Where are gpuos servers?
In the EU. Your nodes run wherever you install the agent.

Related

Run it on your own GPU

Free for one GPU. Connect a machine in one command and call your models through one OpenAI-compatible API.