Gradio is an open-source python library for building interactive web applications to showcase machine learning models, APIs, and python functions. The sambanova-gradio package extends Gradio’s capabilities by simplifying SambaNova model integration. It provides a user-friendly interface for developers to connect SambaNova models to their applications.
The sambanova-gradio package has two dependencies: OpenAI and Gradio. It streamlines the setup process with a built-in registry function, sambanova_gradio.registry
, which facilitates seamless connections to various models. The registry function accepts a model ID
as the name
parameter. Executing the script automatically generates an application interface using the specified model.;
For implementation details and additional configurations, see the Github repository.
Follow these steps to integrate SambaNova models with Gradio.
Install the sambanova-gradio package by running the command below to install the required package.
Set Your SambaNova API Key by saving your API key as an environment variable, as shown below.
Use the sambanova_gradio.registry
function to build and launch your Gradio application, as shown below.
Running this Python script will launch a Gradio interface connected to the Meta-Llama-3.1-405B-Instruct model.
You can personalize the interface by modifying the model, input/output components, and additional settings to gr.Interface
, as shown below.
The following interface was generated using the above code snippet.
See more examples of Gradio applications in our SambaNova HuggingFace space.
Gradio is an open-source python library for building interactive web applications to showcase machine learning models, APIs, and python functions. The sambanova-gradio package extends Gradio’s capabilities by simplifying SambaNova model integration. It provides a user-friendly interface for developers to connect SambaNova models to their applications.
The sambanova-gradio package has two dependencies: OpenAI and Gradio. It streamlines the setup process with a built-in registry function, sambanova_gradio.registry
, which facilitates seamless connections to various models. The registry function accepts a model ID
as the name
parameter. Executing the script automatically generates an application interface using the specified model.;
For implementation details and additional configurations, see the Github repository.
Follow these steps to integrate SambaNova models with Gradio.
Install the sambanova-gradio package by running the command below to install the required package.
Set Your SambaNova API Key by saving your API key as an environment variable, as shown below.
Use the sambanova_gradio.registry
function to build and launch your Gradio application, as shown below.
Running this Python script will launch a Gradio interface connected to the Meta-Llama-3.1-405B-Instruct model.
You can personalize the interface by modifying the model, input/output components, and additional settings to gr.Interface
, as shown below.
The following interface was generated using the above code snippet.
See more examples of Gradio applications in our SambaNova HuggingFace space.