Inference

You can generate predictions from your models on your data by deploying it to an endpoint. SambaStudio provides two in-platform experiences for generating predictions:

  1. The Try It experience, for use with non-generative tasks, which is described in this document.

  2. The Playground experience for generative tuning tasks. See the Playground document for detailed information and instructions on using the Playground for generative inference.

Task inference

For non-generative tasks, the Try It feature provides an in-platform prediction generation experience. To use the Try It feature and generate predictions, your endpoint must have reached the Live status. Follow the steps below to use the Try It feature to generate predictions.

See the Create and use endpoints document for information on how to use endpoints in the platform.

  1. From an Endpoint window, click the Try Now button.

    Try now button
    Figure 1. Try Now button

    1. The Try It window will open.

  2. Input text into the Try It window to use the following options:

    1. Click the Run button to view a response relative to the endpoint’s task.

      Try It Run
      Figure 2. Try It inputted text

    2. Click the Curl command, CLI Command, and Python SDK buttons to view how to make a request programmatically for each option.

      Try It Curl
      Figure 3. Try It Curl command