原始内容
Vivarium Lab
Research findings from Credentum AI
About
Vivarium Lab is Credentum's research arm. We test AI capabilities with simple, honest experiments and report what we find. No hype. Just truth.
Studies
| Study | Summary | Status |
|---|---|---|
| Agent Bootstrap | 160 words of flat navigational anchors beat 1,000 words of memory. Four Laws of Agentic Context from 174 trials. | Complete |
| Governance as Computation | Doing the math for LLM agents prevents commons collapse. Raw information doesn't help — the computed answer is the active ingredient. 0% → 80% survival. | Complete |
| Movable Feast | LLMs know lunar holidays but can't find them on a calendar. 0% → 100% accuracy gap. | Complete |
| Persona Skills | Natural Language Routing achieves 81% reliability—then breaks on compound prompts. | Complete |
Agent Bootstrap
The Four Laws of Agentic Context: How 160 Words Beat 1,000
We ran 174 trials across 12 startup context variants to determine what autonomous agents need at boot time. The winner: 160 words of deterministic navigational anchors — a flat-format repo map, file handles, and warnings. 1.000 accuracy, zero noise, no LLM required.
Variant Words Adj. Score Note
──────────────────────────────────────────────────────
anchor_compact 160 1.000 ← production default
briefing_light 161 0.948 manual fallback
bare (nothing) 0 0.938 agents self-orient
raw memory injection 1015 0.206 attention DDoS
The Four Laws: (1) 160-word ceiling, (2) density ≠ relevance, (3) curiosity is a latency tax, (4) agents understand document hierarchies.
Governance as Computation
How Doing the Math for LLM Agents Prevents Commons Collapse
We ran 30 simulations of the GovSim commons dilemma with Claude Haiku 4.5. Giving agents the pre-computed sustainable limit achieves 80% survival. Giving them the raw inputs to calculate it themselves? 0% — indistinguishable from baseline.
Condition Survival p vs Raw Math
───────────────────────────────────────────────────────
No information (Baseline) 0/5 (0%) 0.177 (ns)
Raw information (Raw Math) 0/5 (0%) —
Computed answer (Advisory) 4/5 (80%) 0.009 **
The computed answer is the active ingredient. Raw information is not enough.
Movable Feast
How 4 Frontier LLMs Handle Movable Holiday Dates
We asked four frontier LLMs to identify holidays from calendar dates. Fixed holidays (Christmas, July 4th): 67-100% accuracy. Movable holidays (Easter, Eid, Lunar New Year): 3-60% accuracy.
Model Fixed Movable Gap
─────────────────────────────────────────────
Grok-4.1-Fast 100.0% 60.0% 40pp
Llama-4-Maverick 97.5% 26.7% 71pp
Gemini-3-Pro 80.0% 16.7% 63pp
GPT-5.1 67.5% 3.3% 64pp
Persona Skills
The Hierarchy of Agentic Reliability: From Routing to Orchestration
We used Anthropic's Agent Skills for persona/voice shaping. After 16 phases of testing:
- Single-shot tool selection: 81%+ reliability
- Compound prompts: Breaks completely
Key insight: Natural Language Routing works for tool selection but fails for task orchestration.
Philosophy
We build memory systems for agents that remember reliably, accountably, and honestly. Our research follows the same principles:
- Simple experiments - One task, clear metrics
- Honest reporting - We describe what we observed
- No overclaiming - Hypotheses are labeled as such
- Reproducible - Code and data included
Links
- Website: credentum.ai
- Lab Page: credentum.ai/lab
- Twitter: @credentum
- Bluesky: @credentum.bsky.social
"Truth, remembered. Especially when it wounds."
License
MIT License. See individual study folders for details.