Core Concepts

Concept pages covering Agent Stream’s architecture, request pipeline, guardrails, cost governance, attribution, and how it extends governed model access to editors and enterprise document stores.

AI applications and agents that call LLM providers directly have no shared control point: every team wires up its own keys, retries, and safety checks, and nobody can answer who spent what, on which model. Agent Stream provides that shared control point: identity, guardrails, cost governance, and observability, configured once on a surface and applied to every call. Architecture →

Agent Stream is part of the Affinidi Trust Fabric, a suite of products for decentralised identity management, scope governance, and trust in agentic AI systems.

Applications, agents, editors
Agent Stream
LLM providers and services

Concepts in order

The concepts follow the order in which most teams build their understanding of Agent Stream: architecture and actors first, then trust-fabric integration, surfaces, model configuration, governance controls, operations, and lifecycle.

ConceptWhat it explains
ArchitectureHow Agent Stream sits between your applications and the providers they call, and how it is deployed as a single, hot-reloadable appliance.
Entities and ActorsOverview of the actors, entities, credentials, and organisational references managed across Agent Stream.
Trust Fabric integrationHow gateway-to-gateway DIDComm, the model marketplace, and x402 payments put Agent Stream on the trust fabric.
SurfacesHow the LLM Surface fronts one provider adapter and the IDE Surface aggregates them into a governed model menu.
Providers and ModelsHow provider adapters, model capabilities, pricing, and request profiles resolve from the hot-reloadable catalogue.
Surface VariantsHow named Surface variations inherit base configuration and support aliases, targeted rollout, and safe promotion.
Prompt ManagementHow versioned prompt templates, point-in-time snapshots, and the interactive playground support centrally managed prompts.
Pipeline and stagesThe named stages every request passes through, and why unused stages add no latency.
Security and access controlHow identity, RBAC, secrets management, and SSRF protection secure callers and the appliance control plane.
PoliciesHow gateway-level and surface-level Rego policies decide whether a request is allowed.
GuardrailsHow Prompt Guard, Expert Witnesses, Judge, and Jury layer content safety around a call.
PII protectionHow Prompt Guard detects sensitive data and pseudonymises it with NER IDs or static redaction.
Cost and usage governanceHow Agent Stream meters cost and tokens per stage and enforces budgets before they are exceeded.
Cost and attributionHow members and teams attribute spend and usage and enforce quota controls.
Resilience and cachingHow failover, load balancing, retry, and response caching protect model calls.
LLM drift detectionHow a surface samples live traffic and replays captured sessions to track behaviour against a baseline.
Governance recordsHow signed, tamper-evident records and hash chains prove what entered a surface, how it was processed, and what left.
ObservabilityWhat telemetry Agent Stream produces, what the dashboard shows, and how to export it to your own stack.
Storage and LifecycleHow Agent Stream manages persistence boundaries, hot-reloadable configuration, and warm-standby failover.