Google's Gemma 4 31B (google/gemma-4-31b-it) is available free via NVIDIA NIM through InferAll. No credit card, no billing setup — create a key and call it now.

from openai import OpenAI

client = OpenAI(
    base_url="https://api.inferall.ai/v1",
    api_key="ifu_your_key_here",  # get one at inferall.ai/keys
)

response = client.chat.completions.create(
    model="google/gemma-4-31b-it",
    messages=[{"role": "user", "content": "What are Gemma 4's key improvements over Gemma 3?"}],
    max_tokens=512,
)

print(response.choices[0].message.content)

What is Gemma 4?

Gemma 4 is Google's fourth generation of open-weight foundation models. The 31B instruction-tuned variant (gemma-4-31b-it) offers strong performance on reasoning, coding, and instruction following — significantly more capable than the Gemma 3 family while remaining fully open-weight and free to run via NVIDIA NIM.

Like all Gemma models, it's fully open-weight under Google's Gemma Terms of Use, available for commercial use, and hosted without charge on NVIDIA's DGX Cloud infrastructure.

TypeScript / Node.js

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferall.ai/v1",
  apiKey: process.env.INFERALL_API_KEY,
});

const response = await client.chat.completions.create({
  model: "google/gemma-4-31b-it",
  messages: [{ role: "user", content: "Write a Python function to parse JSON." }],
});

console.log(response.choices[0].message.content);

Streaming

with client.chat.completions.create(
    model="google/gemma-4-31b-it",
    messages=[{"role": "user", "content": "Explain transformer attention in plain English."}],
    stream=True,
) as stream:
    for chunk in stream:
        print(chunk.choices[0].delta.content or "", end="")

Claude Code / Cline / Cursor

export ANTHROPIC_BASE_URL=https://api.inferall.ai
export ANTHROPIC_API_KEY=ifu_your_key_here

Gemma 4 routes as the "sonnet" tier equivalent for Anthropic-compatible clients.

Free Google models on InferAll

Model	Size	Notes
`google/gemma-4-31b-it`	31B	Newest Gemma generation

All are free on NVIDIA NIM. The full model list is always live at the API.

Compare with other free models

# Gemma 4 vs Llama 4 vs Nemotron — one prompt, three free models
models = [
    "google/gemma-4-31b-it",
    "nvidia/nemotron-3-super-120b-a12b",
]

for model in models:
    resp = client.chat.completions.create(
        model=model,
        messages=[{"role": "user", "content": "What year was the transformer paper published?"}],
        max_tokens=50,
    )
    print(f"{model.split('/')[-1]}: {resp.choices[0].message.content.strip()}")

Get started

inferall.ai/keys — sign up free and start calling (25 free NIM calls before any payment; the $5 starter pack unlocks ongoing use) at /billing. The $5 becomes spendable balance: 25+ open NIM models stay $0 in/out against it (within the free-plan daily request caps); premium providers (OpenAI, Anthropic, Google) bill at the provider's published per-token rate with zero markup.

Google Gemma 4 31B — free API at $0 in/out