ORAI Agent On-Premise: What You Need to Get Started
For companies with strict compliance requirements: How to run the ORAI Agent entirely in your own infrastructure, from hardware to network to LLM options.
Full Control Over Your Data
Many companies, especially in regulated industries like automotive, pharma, or finance, cannot or do not want to use a cloud solution. The ORAI Agent is designed as a single-tenant solution: Each customer runs their own instance. No shared infrastructure, no data in foreign hands, full data sovereignty.
Simple Deployment with Docker Compose
The ORAI Agent consists of just a few containers that we deliver as a Docker Compose stack. No complex Kubernetes setup, no elaborate infrastructure, a server with Docker is all you need. We discuss hardware requirements individually based on usage intensity and number of users.
Updates from Our Registry
If needed, we connect your server to our Docker registry. This allows you to install updates quickly and easily: a simple docker compose pull and the new version is running. No manual deployments, no complicated upgrade procedures.
From VM to First Query
Installation takes just a few hours.
- Provision Server
A VM or server with Docker. We advise you on the right sizing.
- Start Containers
Customize Docker Compose file, pull containers from our registry, start, done.
- Connect Integrations
Connect SAP, Microsoft 365, or other systems through the admin interface.
Network: Firewall & Connectivity
Network requirements are minimal: Inbound HTTPS for user access, outbound to your business systems (SAP, Microsoft 365, etc.). Optional: Outbound to an LLM provider if no local model is used.
Language Model: Flexible Choice
The ORAI Agent supports multiple LLM providers: Azure OpenAI and OpenAI for cloud-based inference, or a local model for fully air-gapped operation. We are happy to advise you on choosing the right setup.
“For us, it was crucial that we could run the agent entirely in our data center. This way, we meet all TISAX requirements without compromise.”
Security & Compliance
Certificates, TLS, and Audit
The ORAI Agent supports TLS 1.3 for all connections and can be integrated with your enterprise CA. All logs can be stored locally, including SIEM integration via Syslog. This helps you meet requirements for TISAX, ISO 27001, and SOC 2.
Contact
Clarify the on-premise setup for your environment
Tell us briefly about your infrastructure and compliance requirements. We will tell you how the agent would be sized in your case and which language model fits your constraints.
- Sizing
- network
- model choice
Keep reading
More on ORAI Agent

Three sales skills in the ORAI Agent: quotations, delivery inquiries, shipping backlog
Keeping an eye on expiring quotations, answering customers who ask about delivery dates, knowing the shipping backlog every morning: three inside sales tasks that are carried out every week. We built a skill for each and ran them against SAP S/4HANA.

Three supply chain skills in the ORAI Agent: late deliveries, reorder points, material availability
Chasing overdue purchase orders, checking reorder points, confirming material for a production order: three tasks that come back every week. We built a skill for each and ran them against a real SAP S/4HANA system.
The Skill Builder in the ORAI Agent: complex work, the same right way every time
Ask an AI the same thing twice and get two different answers: that is where AI stalls in most companies. A Skill fixes the steps, the tools and the approvals up front and lets the AI work only where it is strong. And you build one in a single sitting.