Documentation/Runtime boundaries

Runtime boundaries

Choose guarantees by execution path, not by the presence of a field in a form.

Example

go test ./internal/dataplane/... ./internal/live -count=1

Contract

Path Guarantee / limit
Complete response cache Non-streaming results; process-local LRU, no shared invalidation/TTL guarantee
Idempotency-Key Authenticated non-streaming coordination/replay; process-local
Stream No successful cache/stickiness update after failure; cannot restart after output
Native tasks Query using creation identity and registered task path
Task settlement Successful measured result, deduplicated PostgreSQL event
Task recovery Redis context lasts seven days; without Redis, process-local
Guardrails Pre-call text on normal Chat / Responses, not every Bypass path

There is no background task polling settlement or budget reservation. Preserve the existing task ID after an uncertain create result.

Source and verification

internal/dataplane/execution/official.go

go test ./internal/dataplane/... -count=1

Test prerequisites · Next: pricing

Search full documentation: budgets, routing, Docker…