Inference

OpenAI-compatible chat completions endpoint for running inference against deployed models. Use this endpoint to send prompts and receive generated responses.

Endpoints

---

POST

Create chat completion

Sends a chat prompt to a deployed model and returns a completion. Supports both streaming and non-streaming response modes.