Start a chat
1
Open AI inference
In your project, open AI Inference.
2
Create an API key
Create an inference API key if the project does not already have one.
3
Open Playground
Choose the Playground tab.
4
Pick a model and key
Choose an inference endpoint and an API key.
5
Send a message
Enter a prompt and submit the request.
Advanced settings
Advanced settings can include:- Temperature.
- Top-p.
- Maximum tokens.
- Streaming mode.
- System prompt.
Files
If file upload is available for the selected endpoint, attach files only when the model supports that input type.Embedding endpoints are not chat models. Use text generation endpoints in the playground.

