Gradio
Gradio is an open-source python library for building interactive web applications to showcase machine learning models, APIs, and python functions. The sambanova-gradio package extends Gradio’s capabilities by simplifying SambaNova model integration. It provides a user-friendly interface for developers to connect SambaNova models to their applications.
The sambanova-gradio package has two dependencies: OpenAI and Gradio. It streamlines the setup process with a built-in registry function, sambanova_gradio.registry
, which facilitates seamless connections to various models. The registry function accepts a model ID
as the name
parameter. Executing the script automatically generates an application interface using the specified model.;
For implementation details and additional configurations, see the Github repository.
Installation
Follow these steps to integrate SambaNova models with Gradio.
Install the sambanova-gradio package by running the command below to install the required package.
Set Your SambaNova API Key by saving your API key as an environment variable, as shown below.
Create a Gradio interface
Use the sambanova_gradio.registry
function to build and launch your Gradio application, as shown below.
Running this Python script will launch a Gradio interface connected to the Meta-Llama-3.1-405B-Instruct model.
Customize your interface
You can personalize the interface by modifying the model, input/output components, and additional settings to gr.Interface
, as shown below.
Example screenshot
The following interface was generated using the above code snippet.
See more examples of Gradio applications in our SambaNova HuggingFace space.