Privacy on this gateway

This gateway (ggpt.aiforbiz.email) runs on a server dedicated to one customer. It forwards each request to Microsoft Azure OpenAI and returns the answer.

What is not stored

• Prompts, messages, system instructions, tool definitions, files and images you send.
• Model outputs.
• Request bodies and headers, and your IP address.

A database trigger blanks these fields before any log row is written, so they never reach the disk. You can check the trigger and the stored rows yourself on the server: docker compose exec postgres psql -U litellm -d litellm -c 'SELECT messages, response, proxy_server_request FROM "LiteLLM_SpendLogs" ORDER BY "startTime" DESC LIMIT 5'.

What is stored

For billing and rate limits only: the time of each request, the model, the token counts, the cost, the status, and a hash of the API key used.

Microsoft Azure

Requests are processed by Azure OpenAI under Microsoft's data terms for Azure OpenAI.