Catalogue

Providers

Hosted inference, priced from primary sources — with the privacy answers pricing pages leave out.

When you use ChatGPT you are talking to one company's model on one company's computers. An inference provider rents you the same thing directly: you send text to an address on the internet, their machines run the model, and the reply comes back. That address is the API, and the tools you already use — an editor extension, a chat app, your own script — talk to it for you.

It matters because the same model is sold by several of them at different prices, different speeds, and different rules about whether your prompts are stored or trained on. The rows below are those differences.

The rows are grouped by what we can show you about each host, strongest evidence first: an independent SOC 2 audit on file, then hosts carrying 20 or more of the models we list, then everyone else. That is not a quality ranking. A host in the last group may be excellent, and we simply hold less about it. How the groups are decided.

Narrow by answer

Showing 14 of 85 hosts. Narrowing on an answer also removes every host with no answer on record — that is a gap in our records, not a "no" from them.

Audited hosts

14 shown

An independent SOC 2 audit on file with us.

Amazon BedrockUSTerms last changed 3 days ago37 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedBasetenUSTerms last changed 2 days ago8 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedCerebrasUSTerms last changed 3 hours ago2 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedDigitalOcean GradientUSTerms last changed 21 hours ago14 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedFireworks AIUSTerms last changed 33 hours ago6 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedGoogle Vertex AIUSTerms last changed 15 hours ago45 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedGroqUSTerms last changed 2 months ago7 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedMicrosoft Azure AIUSTerms last changed 45 hours ago55 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedMistral AIFRTerms last changed 6 days ago20 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedNebius AI StudioNLTerms last changed 7 days ago9 models✓Serves from an EU endpoint✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedPerplexityUSTerms last changed 2 months ago5 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedSambaNovaUSTerms last changed 9 hours ago7 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedTogether AIUSTerms last changed 3 hours ago17 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attestedxAIUSTerms last changed 3 days ago8 modelsEU endpoint: no answer on record✗Does not train on your prompts✓Offers a zero-retention option✓SOC 2 attested

Audited hosts

14 shown

An independent SOC 2 audit on file with us.

Amazon Bedrock
37 models served
US
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 3 days ago

Baseten
8 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 2 days ago

Cerebras
2 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 3 hours ago

DigitalOcean Gradient
14 models served
US
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 21 hours ago

Fireworks AI
6 models served
US
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 33 hours ago

Google Vertex AI
45 models served
US
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 15 hours ago

Groq
7 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 2 months ago

Microsoft Azure AI
55 models served
US
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 45 hours ago

Mistral AI
20 models served
FR
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 6 days ago

Nebius AI Studio
9 models served
NL
✓
Serves from an EU endpoint
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 7 days ago

Perplexity
5 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 2 months ago

SambaNova
7 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 9 hours ago

Together AI
17 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 3 hours ago

xAI
8 models served
US
EU endpoint: no answer on record
✗
Does not train on your prompts
✓
Offers a zero-retention option
✓
SOC 2 attested

Terms last changed 3 days ago