Route agent requests
The beta Gateway selects models per turn using factors such as task difficulty, context length and cache size. It builds a cost profile from each agent’s traffic.
Access foundation-model APIs and optimize AI-agent traffic with a beta gateway. AI21 also offers dedicated-model work for enterprise workloads.
AI21 provides a modular enterprise AI stack spanning foundation-model APIs and tools for optimizing existing agent workflows. Teams can use Jamba models through APIs or connect an agent’s API base URL to AI21 Gateway for request routing, caching and context compaction.
Gateway is currently in beta and free during the preview. Model-and-harness optimization is offered through AI21’s enterprise post-training engagements; confirm the scope and delivery with the team. Dedicated-model tuning is arranged with AI21 for defined enterprise workloads; foundation-model API usage has separate pricing and custom-plan options.
The beta Gateway selects models per turn using factors such as task difficulty, context length and cache size. It builds a cost profile from each agent’s traffic.
Reduce redundant context in prompts, tool schemas and outputs, and adjust context for caching. The Gateway considers the broader agent run when making recommendations.
Inspect recommended changes and expected savings, then approve changes before they reach production.
Use Jamba Mini or Jamba Large through foundation-model APIs and SDKs, with usage-based input and output token charges.
Work with AI21 to tune a dedicated small open model for defined enterprise workloads.
Connect agent traffic to the Gateway to review routing, context and caching opportunities without replacing the agent’s harness.
Use foundation-model APIs for instruct or chat workloads, with billing based on model input and output tokens.
Use dedicated-model tuning for a defined business workload and discuss delivery requirements with AI21.
AI21 Gateway is free during its beta preview. The official pricing page advertises a separate foundation-model API trial with $10 in credits and no credit card required; confirm the applicable trial period and eligibility when signing up. Paid API access uses usage-based billing.
Jamba Mini costs $0.20 per million input tokens and $0.40 per million output tokens. Jamba Large costs $2 per million input tokens and $8 per million output tokens. These are foundation-model API rates, separate from dedicated-model work.
Point the agent’s API base URL at AI21 Gateway. The Gateway sits between the harness and models, builds a cost profile from traffic and presents recommendations for review before production changes.
No. Gateway is in beta. Dedicated-model training and model-and-harness optimization are arranged with AI21 for enterprise workloads. Foundation-model APIs have usage-based access and custom-plan options.
Os dados de tráfego são apenas para referência.
| mai. | 170162 |
|---|---|
| jun. | 146693 |
| jul. | 134331 |
As análises de tráfego ainda não estão disponíveis.