Multi-API Platform
Eldric Multi-API is an orchestration platform for running AI models in research, development, and enterprise environments. The solution enables connecting multiple inference servers into a scalable cluster with centralized management.
Core Features
- Cluster management with controller, router, and worker nodes
- Intelligent load balancing across multiple GPU machines
- Knowledge routing with automatic topic detection
- Multi-region deployment for global availability
- Integrated data worker for database connectivity
Research & Development
- Experiment with different models and backends
- A/B testing of different LLMs through the same API
- Quick switching between local and cloud models
- Integration of custom fine-tuned models
- Prototyping without vendor lock-in
Supported Backends (30+)
- Local: Ollama, llama.cpp, MLX (Apple Silicon)
- Enterprise: vLLM, HuggingFace TGI, NVIDIA Triton
- Cloud: OpenAI, Anthropic, Google Vertex AI, Azure
- Specialized: Replicate, Together AI, Groq, Fireworks
Use Cases
- On-premise AI for privacy-sensitive research
- Hybrid architectures with local and cloud backends
- High-availability AI services with automatic failover
- University and industrial research environments
The platform runs entirely on your own hardware – no data leaves your network. Ideal for research institutions and enterprises that need full control over their AI infrastructure.
Cluster Architecture
Scalable multi-region deployment with intelligent routing and enterprise database connectivity
Documentation
Cluster Architecture
Complete reference for distributed AI infrastructure. Multi-region deployment, node types, port assignments, and sample configurations.
Data Worker
Database connectivity for AI workers. Connection pooling, PostgreSQL, MySQL, SQLite, and IBM DB2 (including z/OS mainframes).
Knowledge Routing
AI-powered request routing with theme detection. Route requests to specialized models based on content (medicine, legal, code, etc.).
MultiAPI Reference
Controller API documentation. REST endpoints, cluster management, dashboard, licensing, and configuration options.
Components
eldric-multiapi
Controller with dashboard, API, and cluster management
eldric-workerd
AI inference worker (Ollama, vLLM, TGI, etc.)
eldric-datad
Database connectivity service
eldric-edge
Edge/CDN gateway server
eldric
Interactive command-line client
Quick Start
Supported Databases
SQLite
Built-in, always available
PostgreSQL
via libpq
MySQL
via libmysqlclient
IBM DB2
ODBC + CLI, z/OS support