What a paper result leaves out
A paper result assumes a fill at the recorded price for the full stake, held to settlement. That makes it reproducible; it does not make it executable. The gaps, in rough order of how much they usually matter:
- Entry delay. By the time you see a trade the price has often moved. A $100 buy at 40 cents returns $150 on a win; the same buy five cents later at 45 cents returns $122. The outcome did not change, the payoff fell by a fifth.
- Spread and depth. The recorded price is the whale's fill. Whether the book has that size at that price a moment later is a separate question, which is why connected orders in the terminal quote first.
- Fees. Both venues charge fees on fills. Paper PnL is gross.
- Correlation. Ten recorded buys in one market are ten events but one outcome. Distinct-market counts are shown everywhere for this reason.
- Capital. A flat stake on every match ignores how much would be tied up at once. Autopilot's per-day cap exists because real accounts are finite.
- Survivorship. Choosing a trader because they already rank highly is a selection. The holdout and the 90-day scoring window limit how much a single hot streak can dominate.
None of this makes paper results useless. It makes them a filter: a rule that cannot clear a gross paper test will not clear a net live one, and a rule that does still has to earn its place through a paper strategy before Autopilot spends a dollar on it.
Published research
Studies on the research page apply these same definitions to a fixed observation window and freeze the result. Each states its population filter, window boundaries in UTC, stake, method version and export time, and ships the aggregate table as JSON and CSV with a SHA-256 content hash. A study is never edited after publication; a re-run of the same window at a later date is a new study with a new date, because settlements continue to arrive.
Glossary
- Whale tape: trades above the size floor, any trader.
- Traders feed: any trade by an identified trader.
- Position delta: open, add, flip, trim, close or unknown.
- Resolution: win, loss, void, or unresolved.
- Paper PnL: stake / price − stake on a win, −stake on a loss.
- Return on stake: paper PnL divided by stake deployed on settled trades.
- Copy score: Wilson lower bound of the 90-day win rate, 0 to 100.
- Holdout: earlier two-thirds to score, final third to validate.
- Strategy event: one recorded match between a trade and a strategy.
Frequently asked questions
Is the PnL on trader profiles real money?
It is paper PnL computed from real trades and real settlements: each recorded buy is treated as filled at the recorded price for the recorded size and held to resolution. Fees, slippage and any later exit by the trader are not modelled. Where a venue publishes an official account PnL, the profile shows that in preference to the observed figure.
Why are sells never scored?
A sell closes or trims a position that may have been opened before Rivo saw it, at a price Rivo did not record. Scoring it would require inventing a cost basis. Sells are recorded and drive alerts and Autopilot exits, but they carry no resolution and no PnL.
What counts as a win?
A recorded buy_yes wins when the market resolves yes; a buy_no wins when it resolves no. A market still open at 99.75 percent or higher is treated as settled in favour of that side. Voided or cancelled markets are marked void and excluded from win rate and PnL.
How is a backtest return computed?
Each matching recorded buy is replayed at a fixed stake, $100 by default, at its recorded price. Return is total paper PnL divided by total stake on settled trades. Trades still open at the end of the window are counted separately and never scored.
What does the holdout flag mean?
The window is split into the earlier two-thirds and the later third. The rule is scored on each part separately. It holds when the later part, which was never used to tune the rule, still returns more than zero. It is a sanity check against curve-fitting, not a significance test.
Why does a trader with a 100 percent win rate get a B?
Because five wins from five trades is weak evidence. The copy score is the lower bound of a 95 percent confidence interval on the win rate, so it rises with both accuracy and sample size. Thirty wins from forty trades scores higher than five from five.
Can I reproduce a published study?
Yes. Every study on the research page states its window, population filter, stake and method version, and ships the aggregate table as JSON and CSV with a content hash. The API exposes the same underlying events through query_whale_events and backtest.