R-ORD GOLD-ONLY not-a-function-of-the-data
card_games · dev_20251106-00000-of-00001 from https://huggingface.co/datasets/birdsql/bird_sql_dev_20251106/resolve/3c11fb193e5439b338e23677fa0aae11e8b85db9/data/dev_20251106-00000-of-00001.json (commit 3c11fb19, downloaded 2026-09-07)
Please list the Italian names of the cards in the set Coldsnap with the highest converted mana cost.
the hint the set supplies: card set Coldsnap refers to name = 'Coldsnap'; Italian refers to language = 'Italian'; highest converted mana cost refers to MAX(convertedManaCost)
This question was audited without a prediction beside it, so there is nothing to compare the gold with. The probes below read the gold alone.
read by hand, 2026-09-07: wrong the gold does not answer its question on this data
the gold orders by converted mana cost and never cuts, returning all 155 Italian cards of the set where 12 carry the highest cost the question asks for
a maintainer's reading of this question, out of classification.json, copied from plans/reports/bird-dev-sqlite-260907/classification.json. It is not a verdict and nothing above it was computed from it.
SELECT T2.name FROM foreign_data AS T1 INNER JOIN cards AS T2 ON T2.uuid = T1.uuid INNER JOIN sets AS T3 ON T3.code = T2.setCode WHERE T3.name = 'Coldsnap' AND T1.language = 'Italian' ORDER BY T2.convertedManaCost DESCsha256:5b4794354466cd05c176c45405f063f5d800b98594181512e22be2c89a3128bf
from evidence-gold.json, 155 rows, 50 on this page
| nameTEXT |
|---|
| Sunscour |
| Commandeer |
| Jokulmorder |
| Rimefeather Owl |
| Herald of Leshrac |
| Soul Spike |
| Tresserhorn Skyknight |
| Fury of the Horde |
| Rimescale Dragon |
| Allosaurus Rider |
| Panglacial Wurm |
| Garza Zol, Plague Queen |
| Adarkar Valkyrie |
| Darien, King of Kjeldor |
| Kjeldoran Gargoyle |
| Ronom Serpent |
| Void Maw |
| Greater Stone Spirit |
| Arctic Nishoba |
| Aurochs Herd |
| Shape of the Wiitigo |
| Deepfire Elemental |
| Phyrexian Snowcrusher |
| Boreal Griffin |
| Ursine Fylgja |
| Adarkar Windform |
| Drelnoch |
| Heidar, Rimewind Master |
| Gristle Grinner |
| Lovisa Coldeyes |
| Thermopod |
| Hibernation's End |
| Rimehorn Aurochs |
| Ronom Hulk |
| Steam Spitter |
| Diamond Faerie |
| Juniper Order Ranger |
| Sek'Kuar, Deathkeeper |
| Thrumming Stone |
| Glacial Plating |
| Woolly Razorback |
| Arcum Dagsson |
| Controvert |
| Krovikan Whispers |
| Rimewind Cryomancer |
| Surging Aether |
| Balduvian Fallen |
| Chill to the Bone |
| Disciple of Tevesh Szat |
| Zombie Musher |
A smell is a mechanical reason to read this gold statement again. It is a heuristic: it does not state that the statement is wrong, and a maintainer decides.
this statement orders by a text column holding only numbers, and ordering it as a number gives a different answer, so the gold may be sorting 9.5 above 10
no ORDER BY key resolves to a text column
{
"heuristic": true,
"reason": "no ORDER BY key resolves to a text column",
"keys": [
{
"key": "T2.convertedManaCost",
"column": "cards.convertedManaCost",
"declared_type": "REAL",
"not_applicable": "the column is not declared as text"
}
]
}this statement cuts its result at a LIMIT that does not decide which rows come back, so a different but equally correct statement can return other rows and score zero
the statement states no LIMIT
{
"heuristic": true,
"reason": "the statement states no LIMIT"
}rerun over the same rows in another physical order this statement gives another answer, so its result depends on how the rows are stored and not only on the data
from smells.json, 10 rows
| Commandeer |
| Allosaurus Rider |
| Jokulmorder |
| Herald of Leshrac |
| Soul Spike |
| Fury of the Horde |
| Rimescale Dragon |
| Garza Zol, Plague Queen |
| Rimefeather Owl |
| Sunscour |
{
"heuristic": true,
"rule": "R-ORD",
"baseline_result_hash": "sha256:5b4794354466cd05c176c45405f063f5d800b98594181512e22be2c89a3128bf",
"baseline_result": {
"columns": [
{
"name": "name",
"declared_type": "TEXT"
}
],
"row_count": 155,
"truncated": false,
"rows_shown": 10,
"rows": [
[
{
"type": "str",
"value": "Sunscour"
}
],
[
{
"type": "str",
"value": "Commandeer"
}
],
[
{
"type": "str",
"value": "Jokulmorder"
}
],
[
{
"type": "str",
"value": "Rimefeather Owl"
}
],
[
{
"type": "str",
"value": "Herald of Leshrac"
}
],
[
{
"type": "str",
"value": "Soul Spike"
}
],
[
{
"type": "str",
"value": "Tresserhorn Skyknight"
}
],
[
{
"type": "str",
"value": "Fury of the Horde"
}
],
[
{
"type": "str",
"value": "Rimescale Dragon"
}
],
[
{
"type": "str",
"value": "Allosaurus Rider"
}
]
],
"result_hash": "sha256:5b4794354466cd05c176c45405f063f5d800b98594181512e22be2c89a3128bf"
},
"planner_statistics": {},
"shuffle": {
"seed": "1",
"row_limit": 300000,
"tables": [
"foreign_data",
"cards",
"sets"
],
"tables_not_shuffled": [],
"tables_skipped_for_size": {
"legalities": 427907
},
"tables_not_reached_by_a_copy": {}
},
"shuffled_copies": {
"run": true,
"verdict": "not_equal",
"differs": true,
"result_hash": "sha256:c2853df91ba45b399e72eaee1381806c701a108f7dd6c60d7b6baa043c01e569",
"result": {
"columns": [
{
"name": "name",
"declared_type": "TEXT"
}
],
"row_count": 155,
"truncated": false,
"rows_shown": 10,
"rows": [
[
{
"type": "str",
"value": "Commandeer"
}
],
[
{
"type": "str",
"value": "Allosaurus Rider"
}
],
[
{
"type": "str",
"value": "Jokulmorder"
}
],
[
{
"type": "str",
"value": "Herald of Leshrac"
}
],
[
{
"type": "str",
"value": "Soul Spike"
}
],
[
{
"type": "str",
"value": "Fury of the Horde"
}
],
[
{
"type": "str",
"value": "Rimescale Dragon"
}
],
[
{
"type": "str",
"value": "Garza Zol, Plague Queen"
}
],
[
{
"type": "str",
"value": "Rimefeather Owl"
}
],
[
{
"type": "str",
"value": "Sunscour"
}
]
],
"result_hash": "sha256:c2853df91ba45b399e72eaee1381806c701a108f7dd6c60d7b6baa043c01e569"
}
},
"plan_variant": {
"run": false,
"reason": "the plan variant was not asked for"
}
}this statement returns the same whole row more than once and never says DISTINCT, so a statement answering the same question once per row disagrees on multiplicity alone
{
"heuristic": true,
"rows": 155,
"distinct_rows": 155,
"repeated_rows": 0,
"largest_repeat": 1,
"result_bounded": false,
"distinct_stated": false,
"set_operation": false
}SELECT T2.name FROM foreign_data AS T1 INNER JOIN cards AS T2 ON T2.uuid = T1.uuid INNER JOIN sets AS T3 ON T3.code = T2.setCode WHERE T3.name = 'Coldsnap' AND T1.language = 'Italian' ORDER BY T2.convertedManaCost DESCresult_hash sha256:5b4794354466cd05c176c45405f063f5d800b98594181512e22be2c89a3128bf recomputed from this JSON: match
record_hash sha256:2e9e29faaa68a3f785b9d9f9eeef7c8058e116da7d54b1589c9cc2822ede05ef recomputed from this JSON: match
from evidence-gold.json, 155 rows, 50 on this page
| nameTEXT |
|---|
| Sunscour |
| Commandeer |
| Jokulmorder |
| Rimefeather Owl |
| Herald of Leshrac |
| Soul Spike |
| Tresserhorn Skyknight |
| Fury of the Horde |
| Rimescale Dragon |
| Allosaurus Rider |
| Panglacial Wurm |
| Garza Zol, Plague Queen |
| Adarkar Valkyrie |
| Darien, King of Kjeldor |
| Kjeldoran Gargoyle |
| Ronom Serpent |
| Void Maw |
| Greater Stone Spirit |
| Arctic Nishoba |
| Aurochs Herd |
| Shape of the Wiitigo |
| Deepfire Elemental |
| Phyrexian Snowcrusher |
| Boreal Griffin |
| Ursine Fylgja |
| Adarkar Windform |
| Drelnoch |
| Heidar, Rimewind Master |
| Gristle Grinner |
| Lovisa Coldeyes |
| Thermopod |
| Hibernation's End |
| Rimehorn Aurochs |
| Ronom Hulk |
| Steam Spitter |
| Diamond Faerie |
| Juniper Order Ranger |
| Sek'Kuar, Deathkeeper |
| Thrumming Stone |
| Glacial Plating |
| Woolly Razorback |
| Arcum Dagsson |
| Controvert |
| Krovikan Whispers |
| Rimewind Cryomancer |
| Surging Aether |
| Balduvian Fallen |
| Chill to the Bone |
| Disciple of Tevesh Szat |
| Zombie Musher |
The whole result is in evidence-gold.json, beside this page.
re-run this statement read-only against SQLite 3.53.4 | file=/private/tmp/attestql-runs/data/dev/dev_databases/card_games/card_games.sqlite | size=261820416 under the session settings and over the data this record's fixture digest names, and compare the two results under R-ORD