Early accessGnani Evon v3.5 is now available as an API to early access registrants.
Overview
The LLM API follows OpenAI’s Chat Completions API. Most code written for OpenAI works unchanged: you point the client at Gnani, use your Gnani API key, and setmodel to evon-v3.5.
This page lists what works the same, what works differently, and what is not supported.
Change two lines
Authorization: Bearer <key>, which the API accepts.
What is supported
Supported
These work as they do in OpenAI’s API. Value ranges are on the Chat Completions page.Supported with differences
Not supported
Fields the API does not know are refused. A field that is neither on the Chat Completions page nor in the table above returns
400 unknown_parameter, for example Unrecognized request argument supplied: topk. A typo in a field name is an error, not a silent no-op.
Gnani-only
These are not part of OpenAI’s API. With OpenAI’s Python SDK, pass them inextra_body. The Gnani Python SDK is built on it, so its sync and async clients work the same way (see Python SDK: LLM). With the JavaScript SDK, put them straight into the request object.
Frameworks
Frameworks that can talk to an OpenAI-compatible server work the same way: set the base URL, the API key and the model.Voice agents
The Gnani LiveKit plugin and Pipecat plugin provide Gnani speech-to-text and text-to-speech. For the language model step, use your framework’s OpenAI-compatible LLM service with the base URL, API key and model above.Related
Chat Completions reference
Every request parameter, the response, and code examples.
Errors
Both error shapes, and how to handle them in the SDKs.
Thinking
How thinking works, and when to turn it off.
Limits
Context size, reply length, rate limits and the daily token quota.