Twigg logo

Twigg

Freemium
訪問

Twigg 是用於建置 LLM 應用程式的有狀態 API,提供代管式對話儲存、脈絡組裝、壓縮與模型路由。開發者只需傳送下一個事件,即可在多個請求間保留聊天記錄,並切換模型或提供者,而不必將對話移至特定廠商的執行緒。

什麼是 Twigg?

Twigg is a hosted context store, assembler, and model router for applications that interact with large language models. An application creates a chat, keeps its chat ID, and sends new events to the same chat; Twigg stores the conversation, assembles the request context, calls the named model, and returns the response and usage information.

The conversation remains outside the LLM providers, allowing a single chat to be used with models from different providers. The API can retain provider-native artifacts such as reasoning and tool calls, translate the accumulated ledger into each provider's message format, and compact older context when necessary.

Twigg 能做什麼?

Stateful chat API

Create a chat once and post subsequent events to `/api/v1/chats/{chat_id}/responses`, rather than rebuilding the full transcript for every request.

Hosted context management

Twigg stores and retrieves conversation history, so the application can keep only the chat ID instead of its complete transcript.

Model and provider switching

Each run names the model to use, allowing a conversation to move between listed models and providers without migrating the chat into a new vendor thread.

Context assembly and compaction

Twigg assembles the history for each request and compacts older material when needed to keep the request within the configured context budget.

Retention controls

Namespaces can define context-window budgets and rules for retaining, truncating, or dropping different content types. Tool arguments and results can have separate size and recency rules.

Streaming and usage reporting

Responses can stream back through the API, and completed runs include model, token usage, stop reason, and cost information when returned by the service.

使用情境

“Multi-user chat applications”

Keep each user's chats under a separate namespace while the application stores only the open chat ID. Twigg's example CLI supports creating, listing, reopening, and switching between user conversations.

“Long-running assistants”

Let a process restart or move between machines without losing the conversation, because the transcript is retrieved by chat ID rather than held in application memory.

“Provider evaluation and routing”

Send different turns in one conversation to different named models or providers to compare behavior or match tasks to available model capabilities.

“Tool-using agents”

Preserve tool calls, tool results, reasoning artifacts, and ordinary messages in the context ledger while applying separate retention rules to large tool payloads.

“Lightweight prototypes and command-line clients”

Use the documented JavaScript or Python examples to build a streaming chatbot without an SDK or external package dependencies in the examples.

常見問題

What does an application need to keep locally?

For the documented chat workflow, the application can keep the chat ID and its own agent-loop state. The example CLI says it stores nothing beyond the ID of the open chat, while Twigg keeps the chat and messages.

Can a model be changed during a conversation?

Yes. The response request includes a model name, and the examples list models through `GET /api/v1/models` and select a different model for later turns in the same chat.

Does Twigg stream responses?

Yes. The examples consume a streamed response and print text delta events as they arrive. The API example also shows a run frame and a final `done` event.

How does Twigg handle conversations that grow too large?

Twigg assembles the conversation within a context budget and can compact older material. The site also describes namespace and model-level controls for budgets, retention boundaries, and truncation rules.

Does Twigg run an application's tools or agent loop?

No such full runtime is documented. The product description assigns the application responsibility for the agent loop and tools, while Twigg manages the context ledger, request assembly, model call, and related response data.

快速資訊

Category
Developer Tool
Product type
Stateful LLM API
Primary workflow
Create a chat, send the next event, receive a response
Response mode
Streaming supported in the documented examples
Example languages
JavaScript and Python
API base shown in examples
https://api.twigg.ai/api/v1

Twigg 流量分析

流量數據僅供參考。

網域評分
4