For companies with strict compliance requirements: How to run the ORAI Agent entirely in your own infrastructure – from hardware to network to LLM options.
Many companies – especially in regulated industries like automotive, pharma, or finance – cannot or do not want to use a cloud solution. The ORAI Agent is designed as a single-tenant solution: Each customer runs their own instance. No shared infrastructure, no data in foreign hands – full data sovereignty.
The ORAI Agent consists of just a few containers that we deliver as a Docker Compose stack. No complex Kubernetes setup, no elaborate infrastructure – a server with Docker is all you need. We discuss hardware requirements individually based on usage intensity and number of users.
If needed, we connect your server to our Docker registry. This allows you to install updates quickly and easily – a simple docker compose pull and the new version is running. No manual deployments, no complicated upgrade procedures.
Installation takes just a few hours.
A VM or server with Docker – we advise you on the right sizing.
Customize Docker Compose file, pull containers from our registry, start – done.
Connect SAP, Microsoft 365, or other systems through the admin interface.
Network requirements are minimal: Inbound HTTPS for user access, outbound to your business systems (SAP, Microsoft 365, etc.). Optional: Outbound to an LLM provider if no local model is used.
The ORAI Agent supports multiple LLM providers: Azure OpenAI and OpenAI for cloud-based inference, or a local model for fully air-gapped operation. We are happy to advise you on choosing the right setup.
“For us, it was crucial that we could run the agent entirely in our data center. This way, we meet all TISAX requirements without compromise.”
Certificates, TLS, and Audit
The ORAI Agent supports TLS 1.3 for all connections and can be integrated with your enterprise CA. All logs can be stored locally – including SIEM integration via Syslog. This helps you meet requirements for TISAX, ISO 27001, and SOC 2.
Send us a note or book a short meeting.