- Hardware infrastructure
- Kubernetes clusters
- Inference services (models, user groups, access control)
- Linux system administration
- Kubernetes operations (
kubectl, Helm) - Log analysis and troubleshooting
- System credential management
For inference service features and API usage, see the Developer Guide.
Deployment options
SambaStack hosted
SambaStack hosted is a fully managed cloud service from SambaNova. It lets you build and operate high-performance inference services without managing the underlying infrastructure. SambaNova provides and maintains the AI hardware and Kubernetes environment. You configure and manage your AI services—such as model selection, user groups, and users—based on your requirements.SambaStack on-prem
SambaStack on-prem runs in your own data center. It gives you full control over the AI infrastructure, Kubernetes environment, and the AI services you deploy. You manage everything end-to-end, including model selection, user groups, and users, to support your organization’s needs.
Deployment comparison
| Component | Hosted | On-premises |
|---|---|---|
| Location | SambaNova data center | Customer data center |
| Infrastructure | SambaNova provides and manages | Customer manages (post-SambaNova installation) |
| Kubernetes | SambaNova installs and manages | Customer installs and manages |
| SambaStack software | Customer installs and manages | Customer installs and manages |
| Authentication options |
|
|
| DNS/TLS | SambaNova provides and manages | Customer provides and manages |
| Ingress | SambaNova provides | Customer provides |
| Software and model repository | SambaNova provides image/artifact access | SambaNova provides via GCP access (customer retrieves) |