Language models
Based on the GPT architecture, SambaStudio’s transformer language models enable computers to understand text by recognizing learned patterns. By implementing computational techniques and theories of linguistics, our language models are able to understand, generate, translate, analyze, and interpret natural language texts.
Model architecture
The table below describes the ML App and architecture for the SambaStudio provided language models. The linked document provides the following information for each model:
-
Prompt guidelines
-
Usage guidelines
| Filed of application | ML App | Architecture | Models |
|---|---|---|---|
Language |
Generative tuning 13B |
GPT13B |
|
Data preparation
The Generative data preparation document describes how to prepare data to be used for training all SambaStudio language models.