Parsing
Two stages: decode the wire format, then let the right parser claim the event.
Stage one picks a decoder by topic, turns the protobuf into a generic event, and writes it to a raw topic that ClickHouse reads. Stage two tries event parsers until one succeeds: one named for the topic first, then one named for its prefix, then the rest. Each parser checks for the shape it expects — Claude Code exports logs, LangGraph and ADK export spans — so a parser that can't read an event fails and the next one tries. The winner's agents, traces, compositions and communications go back to Kafka for the ingestor. A new runtime is a new parser.
- Stages
- Decode · parse
- Parsers
- LangGraph · Claude Code · ADK · GenAI logs and metrics
- Out
- Agents · traces · compositions · communications
- Language
- Rust