# SambaNova Documentation - [v2.3.2 (398 pages)](https://docs.sambanova.ai/docs/_llms/v2-3-2.txt): English, Japanese. ## v2.2.6 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [SambaStack model lifecycle](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/model-lifecycle.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/models-chart.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) ###### Deploying models and bundles - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/overview.md) - [Deploy a single model](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-single-model.md) - [Deploy a bundle](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-bundle.md) - [Create a custom bundle](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/create-a-custom-bundle.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-custom-checkpoints.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deployment-configurations.md) - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/sambastack-v2-bundle-migration.md) - [Troubleshooting deployments](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/deploying-models-and-bundles/troubleshooting.md) ###### Custom resources - [PEF](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/custom-resources/pef.md) - [ModelProfile](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/custom-resources/model-profile.md) - [Model](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/custom-resources/model.md) - [ModelBundle](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/custom-resources/model-bundle.md) - [ModelDeployment](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/model-deployment/custom-resources/model-deployment.md) ##### Performance optimization - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Power Operations](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-power-admin.md) - [Firmware Updates](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-firmware-updates.md) - [Inventory file schema](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-inventory-file-schema.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) ###### Hardware Monitoring - [Monitoring overview](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-overview.md) - [Install monitoring](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-install.md) - [SambaNova exporter](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-sambanova.md) - [PDU exporter](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-pdu.md) - [XRDU exporter](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-xrdu.md) - [Reference dashboards](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-reference-dashboards.md) - [Troubleshoot monitoring](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-troubleshooting.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/thirdparty.md) - [SBOM and security reports](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/sbom-security-reports.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.2.6/sambastack/resources/glossary.md) ## v2.2.5 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [SambaStack model lifecycle](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/model-lifecycle.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/models-chart.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) ###### Deploying models and bundles - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/overview.md) - [Deploy a single model](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-single-model.md) - [Deploy a bundle](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-bundle.md) - [Create a custom bundle](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/create-a-custom-bundle.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-custom-checkpoints.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deployment-configurations.md) - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/sambastack-v2-bundle-migration.md) - [Troubleshooting deployments](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/deploying-models-and-bundles/troubleshooting.md) ###### Custom resources - [PEF](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/custom-resources/pef.md) - [ModelProfile](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/custom-resources/model-profile.md) - [Model](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/custom-resources/model.md) - [ModelBundle](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/custom-resources/model-bundle.md) - [ModelDeployment](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/model-deployment/custom-resources/model-deployment.md) ##### Performance optimization - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Power Operations](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-power-admin.md) - [Firmware Updates](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-firmware-updates.md) - [Inventory file schema](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-inventory-file-schema.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) ###### Hardware Monitoring - [Monitoring overview](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-overview.md) - [Install monitoring](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-install.md) - [SambaNova exporter](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-sambanova.md) - [PDU exporter](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-pdu.md) - [XRDU exporter](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-xrdu.md) - [Reference dashboards](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-reference-dashboards.md) - [Troubleshoot monitoring](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-troubleshooting.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/thirdparty.md) - [SBOM and security reports](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/sbom-security-reports.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.2.5/sambastack/resources/glossary.md) ## v2.2.3 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [SambaStack model lifecycle](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/model-lifecycle.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/models-chart.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) ###### Deploying models and bundles - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/overview.md) - [Deploy a single model](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-single-model.md) - [Deploy a bundle](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-bundle.md) - [Create a custom bundle](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/create-a-custom-bundle.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-custom-checkpoints.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deployment-configurations.md) - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/sambastack-v2-bundle-migration.md) - [Troubleshooting deployments](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/deploying-models-and-bundles/troubleshooting.md) ###### Custom resources - [PEF](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/custom-resources/pef.md) - [ModelProfile](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/custom-resources/model-profile.md) - [Model](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/custom-resources/model.md) - [ModelBundle](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/custom-resources/model-bundle.md) - [ModelDeployment](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/model-deployment/custom-resources/model-deployment.md) ##### Performance optimization - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Power Operations](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-power-admin.md) - [Firmware Updates](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-firmware-updates.md) - [Inventory file schema](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-inventory-file-schema.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) ###### Hardware Monitoring - [Monitoring overview](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-overview.md) - [Install monitoring](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-install.md) - [SambaNova exporter](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-sambanova.md) - [PDU exporter](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-pdu.md) - [XRDU exporter](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/exporter-xrdu.md) - [Reference dashboards](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-reference-dashboards.md) - [Troubleshoot monitoring](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/hardware-admin/sambarack-manager/monitoring/monitoring-troubleshooting.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/thirdparty.md) - [SBOM and security reports](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/sbom-security-reports.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.2.3/sambastack/resources/glossary.md) ## v2.1.2 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [SambaStack model lifecycle](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/model-lifecycle.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/models-chart.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) ###### Deploying models and bundles - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/overview.md) - [Deploy a single model](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-single-model.md) - [Deploy a bundle](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-bundle.md) - [Create a custom bundle](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/create-a-custom-bundle.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-custom-checkpoints.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deployment-configurations.md) - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/sambastack-v2-bundle-migration.md) - [Troubleshooting deployments](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/deploying-models-and-bundles/troubleshooting.md) ###### Custom resources - [PEF](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/custom-resources/pef.md) - [ModelProfile](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/custom-resources/model-profile.md) - [Model](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/custom-resources/model.md) - [ModelBundle](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/custom-resources/model-bundle.md) - [ModelDeployment](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/model-deployment/custom-resources/model-deployment.md) ##### Performance optimization - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/performance/deploy-with-speculative-decoding.md) - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Power Operations](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-power-admin.md) - [Firmware Updates](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-firmware-updates.md) - [Inventory file schema](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-inventory-file-schema.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/thirdparty.md) - [SBOM and security reports](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/sbom-security-reports.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.1.2/sambastack/resources/glossary.md) ## v2.1.1 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/models-chart.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) ###### Deploying models and bundles - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/overview.md) - [Deploy a single model](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-single-model.md) - [Deploy a bundle](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-a-bundle.md) - [Create a custom bundle](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/create-a-custom-bundle.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deploy-custom-checkpoints.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/deployment-configurations.md) - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/sambastack-v2-bundle-migration.md) - [Troubleshooting deployments](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/deploying-models-and-bundles/troubleshooting.md) ###### Custom resources - [PEF](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/custom-resources/pef.md) - [ModelProfile](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/custom-resources/model-profile.md) - [Model](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/custom-resources/model.md) - [ModelBundle](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/custom-resources/model-bundle.md) - [ModelDeployment](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/model-deployment/custom-resources/model-deployment.md) ##### Performance optimization - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/performance/deploy-with-speculative-decoding.md) - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Power Operations](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-power-admin.md) - [Firmware Updates](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-firmware-updates.md) - [Inventory file schema](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-inventory-file-schema.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/thirdparty.md) - [SBOM and security reports](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/sbom-security-reports.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.1.1/sambastack/resources/glossary.md) ## v2.0.2 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [Models chart](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/models-chart.md) - [Deploying models and bundles](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/deploying-model-bundles.md): Deploy models and bundles using ModelProfile, ModelBundle, and ModelDeployment resources on SambaStack, including custom bundles with custom models and checkpoints. - [Migrating bundle configuration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/sambastack-v2-bundle-migration.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/deploy-custom-checkpoints.md): Convert, upload, and serve your own custom or fine-tuned checkpoints on SambaStack, either by overriding the checkpoint of an existing model or by registering a new Model resource. - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/model-deployment/deployment-configurations.md) ##### Performance optimization - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/performance/deploy-with-speculative-decoding.md) - [Using prompt caching](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Device administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-device-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Command reference](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/sambastack-yaml.md): Configuration reference for the sambastack and sambastack-models Helm charts, covering ingress, TLS, high availability, service tiers, and model bundle configuration. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/thirdparty.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v2.0.2/sambastack/resources/glossary.md) ## v1.2.0 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/getting-started/on-prem.md) #### Service Administration ##### Model deployment - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/supported-models-and-bundles.md) - [Deploying model bundles](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/deploying-model-bundles.md) - [Deploying custom bundles](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/custom-bundle-deployment.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/deploy-custom-checkpoints.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/checkpoint-conversion-tool.md) - [High-throughput vs. high-interactivity](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/model-deployment/deployment-configurations.md) ##### Performance optimization - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/performance/deploy-with-speculative-decoding.md) - [Using prompt caching](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/performance/prompt-caching.md) - [Extended token generation](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/performance/ignore-eos.md) ##### Platform administration - [Authentication](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/platform-admin/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/platform-admin/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/platform-admin/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/platform-admin/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/service-administration/platform-admin/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Device administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-device-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Command reference](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/sambastack-yaml.md): This file defines ingress settings, TLS configuration, and high availability parameters. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/thirdparty.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v1.2.0/sambastack/resources/glossary.md) ## v1.1.1 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/getting-started/on-prem.md) #### Service Administration - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/supported-models-and-bundles.md) - [Deploying model bundles](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/deploying-model-bundles.md) - [Custom bundle deployment](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/custom-bundle-deployment.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/deploy-custom-checkpoints.md) - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/deploy-with-speculative-decoding.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/checkpoint-conversion-tool.md) - [Authentication](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/upgrade-sambastack.md) - [Choose a deployment configuration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/service-administration/deployment-configurations.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Device administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-device-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Command reference](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/sambastack-yaml.md): This file defines ingress settings, TLS configuration, and high availability parameters. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/thirdparty.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v1.1.1/sambastack/resources/glossary.md) ## v1.0.57 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/getting-started/on-prem.md) #### Service Administration - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/supported-models-and-bundles.md) - [Deploying model bundles](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/deploying-model-bundles.md) - [Custom bundle deployment](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/custom-bundle-deployment.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/deploy-custom-checkpoints.md) - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/deploy-with-speculative-decoding.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/checkpoint-conversion-tool.md) - [Authentication](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/upgrade-sambastack.md) - [Choose a deployment configuration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/service-administration/deployment-configurations.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Device administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-device-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Command reference](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/sambastack-yaml.md): This file defines ingress settings, TLS configuration, and high availability parameters. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/thirdparty.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v1.0.57/sambastack/resources/glossary.md) ## v0.5.17 ### SambaStack #### Getting Started - [Introduction](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/getting-started/introduction.md) - [Quickstart - hosted](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/getting-started/hosted.md) - [Quickstart - on-prem](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/getting-started/on-prem.md) #### Service Administration - [Supported models and bundles](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/supported-models-and-bundles.md) - [Deploying model bundles](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/deploying-model-bundles.md) - [Custom bundle deployment](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/custom-bundle-deployment.md) - [Deploying custom checkpoints](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/deploy-custom-checkpoints.md) - [Deploying with speculative decoding](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/deploy-with-speculative-decoding.md) - [Checkpoint conversion tool](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/checkpoint-conversion-tool.md) - [Authentication](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/authentication.md) - [User access and permissions](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/usergroup-management.md) - [Custom database](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/custom-database.md) - [Custom domain and TLS certificate configuration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/custom-domain.md) - [Upgrading SambaStack](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/service-administration/upgrade-sambastack.md) #### Hardware Administration - [SambaRack overview](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-overview.md) - [Network administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/network-admin.md) - [Power management](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/power-management.md) - [Host module OS administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/host-os.md) - [Host module BMC administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/host-bmc-admin.md) - [RDU module administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/rdu-administration.md) ##### SambaRack Manager - [Overview](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-overview.md) - [Install and upgrade](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-install.md) - [Initial setup](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-initial-setup.md) - [Rack administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-rack-admin.md) - [Device credentials](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-device-credentials.md) - [Node administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-node-admin.md) - [Device administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-device-admin.md) - [Group administration](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-group-admin.md) - [Command reference](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/hardware-admin/sambarack-manager/srm-command-reference.md) #### Reference Architecture - [Integration with LiteLLM](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/litellm.md) ##### Monitoring and Observability - [Overview](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/overview.md) - [Log storage and search - OpenSearch](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/log-storage.md) - [Log forwarding with Fluent Bit](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/log-forwarder.md) - [Monitoring with Prometheus and Grafana](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/monitoring-prom.md) - [Metrics](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/metrics.md) - [Logs](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/reference-architecture/observability/logs.md) #### Resources - [SambaStack.yaml reference](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/sambastack-yaml.md): This file defines ingress settings, TLS configuration, and high availability parameters. - [SambaStack pods reference](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/pods-reference.md) - [SambaRack SN40L-16 and Core Services Rack - installation guide](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/sambarack-csr-installation-guide.md) - [SambaRack components and cabling](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/sn40l-16-hardware-reference.md) - [Third-party components](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/thirdparty.md) - [SambaStack glossary](https://docs.sambanova.ai/docs/en/v0.5.17/sambastack/resources/glossary.md) ## OpenAPI Specs - [openapi.documented](https://raw.githubusercontent.com/sambanova/sambanova-inference-api-spec/refs/heads/main/openapi.documented.json) - [chat-sambanova-agent-api-spec](https://raw.githubusercontent.com/sambanova/agents/refs/heads/main/chat-sambanova-agent-api-spec.yaml) > The links below point to documentation indexes. Follow each `/_llms/` index recursively until you reach documentation pages. ## Indexes - [v2.3.2 (398 pages)](https://docs.sambanova.ai/docs/_llms/v2-3-2.txt): English, Japanese. - [v2.3.2 / Japanese (188 pages)](https://docs.sambanova.ai/docs/_llms/v2-3-2/ja.txt): 開発者ガイド, API リファレンス, 外部ツール連携, SambaStack, リリースノート. - [v2.2.6 / Japanese (65 pages)](https://docs.sambanova.ai/docs/_llms/v2-2-6/ja.txt): SambaStack. - [v2.2.5 / Japanese (65 pages)](https://docs.sambanova.ai/docs/_llms/v2-2-5/ja.txt): SambaStack. - [v2.2.3 / Japanese (65 pages)](https://docs.sambanova.ai/docs/_llms/v2-2-3/ja.txt): SambaStack. - [v2.1.2 / Japanese (59 pages)](https://docs.sambanova.ai/docs/_llms/v2-1-2/ja.txt): SambaStack. - [v2.1.1 / Japanese (58 pages)](https://docs.sambanova.ai/docs/_llms/v2-1-1/ja.txt): SambaStack. - [v2.0.2 / Japanese (46 pages)](https://docs.sambanova.ai/docs/_llms/v2-0-2/ja.txt): SambaStack. - [v1.2.0 / Japanese (45 pages)](https://docs.sambanova.ai/docs/_llms/v1-2-0/ja.txt): SambaStack. - [v1.1.1 / Japanese (43 pages)](https://docs.sambanova.ai/docs/_llms/v1-1-1/ja.txt): SambaStack. - [v1.0.57 / Japanese (43 pages)](https://docs.sambanova.ai/docs/_llms/v1-0-57/ja.txt): SambaStack. - [v0.5.17 / Japanese (42 pages)](https://docs.sambanova.ai/docs/_llms/v0-5-17/ja.txt): SambaStack.