Early accessGnani Evon v3.5 is now available as an API to early access registrants.
By default, the model thinks before it answers: it works through the problem step by step, then writes the reply. Thinking helps with multi-step questions, calculations and planning. For simple questions it mostly adds time and tokens.
When to use this
- Thinking on: maths, multi-step questions, planning, comparing options.
- Thinking off: short factual answers, translation, rewriting, classification, extracting fields, and usually JSON output from a clear instruction.
- Thinking off: voice agents and other replies where speed matters most.
Turn thinking off
Send"reasoning_effort": "none". This is OpenAI’s standard field, so it works from every OpenAI SDK:
Set up the client once. The examples on this page use client from here. Your API key is read from the GNANI_API_KEY environment variable. The Python examples below the setup are written for the OpenAI SDK, and work unchanged with the Gnani SDK client (GnaniLLMClient). With AsyncGnaniLLMClient, add await to each call. See the Python SDK page.
"enable_thinking": false. If a request has both fields, enable_thinking is used.
How it works
The thinking is returned separately from the answer:What thinking costs
Thinking tokens are output tokens, the same as the answer’s:- They are included in
usage.completion_tokens. - They count toward
max_tokens. - They count toward your daily token quota.
- They add time before the first word of the answer.
Limit how long the model thinks
reasoning_budget sets the most tokens the model may spend thinking, from 0 to 65536. The default is 32,768. Thinking also counts toward max_tokens, so the effective limit is the lower of the two.
extra_body={"reasoning_budget": 256}. OpenAI’s JavaScript SDK sends extra fields as they are, so put it in the request object:
Multi-turn conversations
When you send the conversation back, include each earlier assistant reply’scontent. You do not need to send reasoning; it is ignored if you do.
Related
Streaming
Show the thinking as it arrives in
delta.reasoning.Limits
max_tokens and the daily token quota.JSON output
Extraction and classification, with thinking off.
Chat Completions
Every request field, including
reasoning_effort.