Skip to main content
Early accessGnani Evon v3.5 is now available as an API to early access registrants.

Overview

The LLM API follows OpenAI’s Chat Completions API. Most code written for OpenAI works unchanged: you point the client at Gnani, use your Gnani API key, and set model to evon-v3.5. This page lists what works the same, what works differently, and what is not supported.

Change two lines

The SDK sends the key as Authorization: Bearer <key>, which the API accepts.
Thinking is on by default, unlike most OpenAI chat models. The thinking counts toward max_tokens, which is 1,024 on Free and Pay-as-you-go plans. For quick answers, send reasoning_effort="none". See Thinking.

What is supported

Supported

These work as they do in OpenAI’s API. Value ranges are on the Chat Completions page.

Supported with differences

Not supported

Fields the API does not know are refused. A field that is neither on the Chat Completions page nor in the table above returns 400 unknown_parameter, for example Unrecognized request argument supplied: topk. A typo in a field name is an error, not a silent no-op.

Gnani-only

These are not part of OpenAI’s API. With OpenAI’s Python SDK, pass them in extra_body. The Gnani Python SDK is built on it, so its sync and async clients work the same way (see Python SDK: LLM). With the JavaScript SDK, put them straight into the request object.

Frameworks

Frameworks that can talk to an OpenAI-compatible server work the same way: set the base URL, the API key and the model.

Voice agents

The Gnani LiveKit plugin and Pipecat plugin provide Gnani speech-to-text and text-to-speech. For the language model step, use your framework’s OpenAI-compatible LLM service with the base URL, API key and model above.

Chat Completions reference

Every request parameter, the response, and code examples.

Errors

Both error shapes, and how to handle them in the SDKs.

Thinking

How thinking works, and when to turn it off.

Limits

Context size, reply length, rate limits and the daily token quota.