When the evaluation says pass, but the agent is wrong.
Deterministic checks, semantic judges and the difference between a score and a guarantee.
Explore the topic ↗
An engineering workbench, open to explore
Good systems.
Hard questions.
Why do systems fail in unexpected ways? What makes them easier to operate? Explore the investigations, experiments and tools behind our engineering work.
NOTRIX / SOFTWARE SYSTEMS · APPLIED AI · RELIABILITY
SYSTEM BEHAVIOR / EXPERIMENT 004
TRACE / 12 EVENTS
COMPARE RUNS ↗
Start exploring
↘
01 — Engineering investigations
The problems worth looking into.
Failure modes, overlooked tradeoffs and experiments that reveal how software actually behaves.
FEATURED / AI RELIABILITY
Read the investigation ↗
Why your production RAG system slowly gets worse.
The quiet degradation of retrieval quality — and what normal monitoring misses.
What actually happens during an agent tool call?
From proposed actions to guarded execution, traces and completion decisions.
Visit the labs ↗Design decisions that make failures easier to diagnose.
Systems thinking, tradeoffs, architecture notes and practical engineering judgment.
Browse engineering notes ↗
02 — Interactive workbench
Don't just read.
Run the experiment.
Explore bounded demos of agent behavior, tool calls, evaluation and system traces.
CORBOOST / AGENT LABS
Enter CorBoost ↗
See every decision an agent makes.
Inspect planning, execution, evaluation and failure recovery in approved demo scenarios.
03 — From investigation to implementation
Things we've built.
Tools that make specific, recurring tasks easier — not technology for its own sake.
OPEN SOURCE / DEVELOPER TOOLS
Notrix Trax.
Capture and compare AI workflow execution to understand what changed, where and why.
Explore the repository ↗
⌁
PRODUCT / CONTENT OPERATIONS
BotRun Post.
Turn working material into publishable drafts, without recreating the workflow from scratch.
Explore BotRun ↗
↗
04 — Keep following the thread
One curiosity. Several doors.
Focused publishing and experimental spaces, connected by engineering questions rather than corporate categories.
ENGINEERING NOTES
Core Routers ↗
Architecture, software engineering and practical systems thinking.
SPECIALIST PUBLICATION
AI Workflow Reliability ↗
Failure analysis, observability and evaluation of AI workflows.
LIVE LABORATORIES
CorBoost ↗
Interactive systems, bounded experiments and agent traces.
05 — When the problem is yours
Some problems need more than another article.
We also work directly with teams on persistent engineering problems — with practical diagnosis, clearer tradeoffs and focused implementation.
Start a technical conversation ↗
Performance & reliability investigations
↗
Distributed systems architecture
↗
AI workflow evaluation & debugging
↗
Applied AI systems implementation
↗
Scoped technical work. No generalized “digital transformation” promises.