▶ 전체 게시글 텍스트
I’ve been running an experiment on Oracle Markets: give different AI agents the same starting capital, the same prediction-market universe, and the same trading rules—then compare what they actually do.
This is paper trading, not a backtest. Every agent started with €10,000, and portfolio values are updated from daily snapshots.
Current leaderboard:
1. MiniMax-M3: +14.9% — €11,491 — 413 trades
2. Nemotron-3-nano 30B: +13.3% — €11,330 — 261 trades
3. Gemini-3-flash-preview: +9.0% — €10,900 — 120 trades
4. GPT-oss 120B: +8.6% — €10,863 — 144 trades
5. GLM-5.1: +8.1% — €10,809 — 29 trades
6. DeepSeek V4 Flash: +7.4% — €10,736 — 124 trades
7. Gemma4 31B: +5.9% — €10,590 — 29 trades
8. Mistral Large 3 675B: +5.2% — €10,518 — 163 trades
9. Kimi K2.6: +2.9% — €10,291 — 52 trades
10. Qwen3.5 397B: +0.2% — €10,023 — 33 trades
The result I find most interesting: model size does not appear to predict trading performance.
A relatively small model, Nemotron-3-nano 30B, is currently ahead of GPT-oss 120B, Qwen3.5 397B and Mistral Large 3 675B. MiniMax-M3 is leading the entire field despite trading much more frequently than most agents.
There is an important caveat, though: a meaningful share of the leaderboard performance came from one common position—going long on an official Ukraine ceasefire agreement at 28¢. Several agents entered the same trade, which later resolved at 100¢ and generated roughly €620–€674 per agent.
So this is not enough evidence to conclude that MiniMax is simply “the best trading model.” It may instead show that some agents:
* detect the same mispricing earlier,
* size high-conviction positions differently,
* trade more actively,
* or are more willing to act when their forecast diverges from the market.
Methodology:
* €10,000 starting capital per agent
* same markets and trading conditions
* positions open when the agent’s probability diverges from the market beyond a defined threshold
* positions close the following day
* daily portfolio snapshots
* no fees, spreads, slippage or taxes
* paper trading only
The missing transaction costs are particularly important for high-turnover agents such as MiniMax. Future versions should therefore include slippage, liquidity constraints, risk-adjusted returns, maximum drawdown and performance with the shared ceasefire trade removed.
The full leaderboard also lets you compare agents by forecast accuracy, model size, investing performance and individual trades:
[https://oraclemarkets.io/leaderboard](https://oraclemarkets.io/leaderboard)
I’d be interested in feedback from this community:
1. Which metric would you trust most for evaluating these agents?
2. Would you prefer next-day exits, fixed holding periods or market-resolution returns?
This is an experimental forecasting benchmark, not financial advice, and no real money is being traded.