DagsHub buying guide: Two results of 75% can have different denominators
Use eight fictional paper cards to distinguish overall results from a shared subset. Equal percentages need not support the same conclusion.
When two results say 75%, first ask whether they cover the same materials, not whether they tied. DagsHub’s historical release described managing data, annotations and experiment records in one workflow. Recording the scope beside each result makes incompatible percentages easier to spot.
Find the overlap in existing paper records
Suppose a shape catalog has eight numbered cards. A checks all eight and finds six meet the labeling rule: 6/8. B checks only cards 1 through 4 and finds three meet the rule: 3/4. The original paper record also shows that A passed just two of those same four. Both overall ratios are 75%, but their denominators cover different sets. These numbers are invented; no real data, scripts or experiments were used.
To compare the same four cards, report A 2/4 and B 3/4. This does not establish that B did better across all eight: B has no record for the other four. If the handoff contains only the two 75% figures and no card IDs, you cannot compare them. Do not guess the overlap from dates or percentages. Ask another reader to identify the denominators, overlap and unknowns before treating the record as reviewable.

Original paper diagram. The blocks show counts, not individual card outcomes. Hatched means unchecked, not zero successes.
Keep a paper table for a one-off change in scope
If a team often compares versions or subsets and wants experiment records and scope together, consider DagsHub’s approach. For a single static check, an ordinary table with card IDs, counts and reasons for blanks is usually enough. This exercise neither establishes which denominators the platform saves automatically nor reproduces experimental performance.
Content note:This article is based on publicly available information and is intended as a reference for evaluating tools. Features, pricing, and related policies may change at any time; please refer to the latest official information.
Original source:dagshub.com