Sign in to use the playground
Run this model with your Chutes account, quota, and API access.
Model facts & API quick start
Gemma 4 31B Turbo (google/gemma-4-31B-turbo-TEE) is served on Chutes inside a Trusted Execution Environment (TEE). Call it through the OpenAI-compatible API at https://llm.chutes.ai/v1 with a Chutes API key and "model": "google/gemma-4-31B-turbo-TEE".
Gemma 4 31B Turbo at a glance
- Model ID
google/gemma-4-31B-turbo-TEE- Developer
- Deployed by
- chutes
- Type
- LLM
- Input price
- $0.12 per 1M tokens
- Output price
- $0.37 per 1M tokens
- Cached input price
- $0.012 per 1M tokens
- Context length
- 131,072 tokens
- Modalities
- text, image in → text out
- Confidential compute (TEE)
- Yes, runs in a Trusted Execution Environment
- Precision
- NVFP4 (NVIDIA ModelOpt quantization, as served on Chutes)
- Open weights
nvidia/Gemma-4-31B-IT-NVFP4- Parameters
- 30.7B (dense)
- Architecture
- Dense transformer (Gemma4ForConditionalGeneration) with hybrid attention: local sliding-window (1024 tokens) interleaved with full global attention, unified KV in global layers, Proportional RoPE; ~550M vision encoder
- License
- Apache-2.0 (Gemma 4)
- Released
- 2026-03
- Layers
- 60, GQA 32Q/16KV, head dim 256
- Vocabulary
- 262,144 tokens
- Thinking
- Configurable: enabled by placing <|think|> at the start of the system prompt
- Languages
- 140+ (model card)
- Benchmarks (card)
- MMLU Pro 85.2, LiveCodeBench v6 80.0, GPQA Diamond 84.3, MMMU Pro 76.9
- Serving on Chutes
- TEE, NVFP4 quantized weights (nvidia/Gemma-4-31B-IT-NVFP4), DFlash speculative decoding
API quick start
- Base URL
https://llm.chutes.ai/v1- model
google/gemma-4-31B-turbo-TEE- Endpoint
POST /v1/chat/completions- Auth header
Authorization: Bearer $CHUTES_API_KEY
OpenAI-compatible: point any OpenAI SDK at the base URL above and pass your Chutes API key as the API key.
curl -X POST "https://llm.chutes.ai/v1/chat/completions" \
-H "Authorization: Bearer $CHUTES_API_KEY" \
-H "Content-Type: application/json" \
-d '{
"model": "google/gemma-4-31B-turbo-TEE",
"messages": [
{
"role": "user",
"content": "Hello!"
}
],
"stream": true,
"max_tokens": 1024,
"temperature": 0.7
}'Gemma 4 31B Turbo FAQ
What does turbo mean in this model's name?
It is a serving configuration, not a different Google model. The chute runs NVIDIA's NVFP4 quantization of Gemma 4 31B IT (nvidia/Gemma-4-31B-IT-NVFP4, built with TensorRT Model Optimizer) plus DFlash speculative decoding, trading a small amount of numerical precision for substantially faster, cheaper inference.
How do I enable thinking mode?
Gemma 4 enables reasoning when the <|think|> control token appears at the start of the system prompt; remove it to disable thinking. When enabled, the model emits its reasoning before the final answer. Do not feed previous turns' thinking content back into the conversation history.
What context window does it support?
This chute serves a 131,072-token context (context_length in https://llm.chutes.ai/v1/models). Upstream, the model card lists 256K tokens and config.json sets max_position_embeddings to 262,144. The hybrid local/global attention design with p-RoPE is what keeps memory usage manageable at long context.
Can it process images?
Yes. Gemma 4 31B accepts text and image input with variable aspect ratio and resolution support, and scores 76.9 on MMMU Pro per the card. It does not accept audio; only the smaller E2B and E4B family members have audio encoders.
What sampling settings does Google recommend?
Temperature 1.0, top_p 0.95, top_k 64, which match the shipped generation_config.json. The chute's own default temperature is 0.7, so pass temperature explicitly if you want the card-recommended behavior.
How do I call it from the OpenAI SDK?
Set base_url to https://llm.chutes.ai/v1 with your Chutes API key and model to google/gemma-4-31B-turbo-TEE. Chat completions and streaming work as with any OpenAI-compatible endpoint.
Is Gemma 4 licensed for commercial use?
Yes. Google released Gemma 4 under an Apache 2.0 license (see the Gemma 4 license page linked from the model card), and NVIDIA's NVFP4 quantization page states the model is ready for commercial and non-commercial use. Chutes billing is separate from the license.
What does the TEE suffix mean?
The chute runs inside a Trusted Execution Environment: attested confidential-compute hardware that keeps prompts and outputs protected while being processed. It is a deployment guarantee on Chutes and does not change the model.