Skip to main content
Early accessGnani Evon v3.5 is now available as an API to early access registrants.
By default, the model thinks before it answers: it works through the problem step by step, then writes the reply. Thinking helps with multi-step questions, calculations and planning. For simple questions it mostly adds time and tokens.

When to use this

  • Thinking on: maths, multi-step questions, planning, comparing options.
  • Thinking off: short factual answers, translation, rewriting, classification, extracting fields, and usually JSON output from a clear instruction.
  • Thinking off: voice agents and other replies where speed matters most.
minimal, low, medium and high all turn thinking on and do not change how long the model thinks. To limit thinking, use reasoning_budget.

Turn thinking off

Send "reasoning_effort": "none". This is OpenAI’s standard field, so it works from every OpenAI SDK: Set up the client once. The examples on this page use client from here. Your API key is read from the GNANI_API_KEY environment variable. The Python examples below the setup are written for the OpenAI SDK, and work unchanged with the Gnani SDK client (GnaniLLMClient). With AsyncGnaniLLMClient, add await to each call. See the Python SDK page.
You can also send "enable_thinking": false. If a request has both fields, enable_thinking is used.

How it works

The thinking is returned separately from the answer:

What thinking costs

Thinking tokens are output tokens, the same as the answer’s:
  • They are included in usage.completion_tokens.
  • They count toward max_tokens.
  • They count toward your daily token quota.
  • They add time before the first word of the answer.
Thinking can use up the whole reply budget. On Free and Pay-as-you-go plans, max_tokens is at most 1,024. If the model spends those tokens thinking, the reply comes back with empty or missing content and finish_reason: "length".To fix it, turn thinking off for that request, lower reasoning_budget, or raise max_tokens if your plan allows it.

Limit how long the model thinks

reasoning_budget sets the most tokens the model may spend thinking, from 0 to 65536. The default is 32,768. Thinking also counts toward max_tokens, so the effective limit is the lower of the two.
reasoning_budget: 0 sets no budget. It does not turn thinking off; use "reasoning_effort": "none" for that.
Here thinking can use at most 256 of the 1,024 output tokens, which leaves at least 768 for the answer. With OpenAI’s Python SDK, pass it in extra_body={"reasoning_budget": 256}. OpenAI’s JavaScript SDK sends extra fields as they are, so put it in the request object:

Multi-turn conversations

When you send the conversation back, include each earlier assistant reply’s content. You do not need to send reasoning; it is ignored if you do.

Streaming

Show the thinking as it arrives in delta.reasoning.

Limits

max_tokens and the daily token quota.

JSON output

Extraction and classification, with thinking off.

Chat Completions

Every request field, including reasoning_effort.