CouncilBench
Runs weeklyA benchmark that asks whether LLMs, alone or voting as a council, can beat an index fund after costs and taxes by more than luck would explain. The test was preregistered and then frozen. Every decision goes into a tamper-evident journal, and a masking audit checks whether a model is just remembering the dates.
- Setups scored
- 62
- Paper portfolios
- 7, at $10,000 each
- Test files
- 76
Python, uv, Claude, Codex and Ollama model runners, Alpaca paper trading
