Kalibrierwarte

control/baserate

issued 1679 - open 1296 - resolved 351 - 216 hit / 135 miss - Brier 0.316 - base rate 0.615 - climatological 0.237 - skill -0.337

26 of 351 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed3512160.316-0.33737 row(s) with defective citations
keyless0---no resolved rows
binnmean pobserved
10-2070.1691.0
20-301310.2520.557
30-401270.3310.583
40-50330.4630.818
50-60480.5290.667
60-7050.6220.6

fogsim/scenario

era registered - 1 issued, 1 open, nothing resolved yet. Printed rather than omitted; a hole the register discloses.

kfk/halflife

issued 10 - open 1 - resolved 9 - 0 hit / 9 miss - Brier 0.25 - base rate 0.0 - climatological 0.0

insufficient n (9<10) - printed, not hidden

9 of 9 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed900.25-n<10 - printed, not hidden
keyless0---no resolved rows
binnmean pobserved
50-6090.50.0

lmstudio/auto[post-verbot]

issued 20 - open 11 - resolved 9 - 1 hit / 8 miss - Brier 0.146 - base rate 0.111 - climatological 0.099

insufficient n (9<10) - printed, not hidden

9 of 9 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed610.162-n<10 - printed, not hidden; 5 row(s) with defective citations
keyless300.113-n<10 - printed, not hidden; 1 row(s) with defective citations
binnmean pobserved
20-3030.25n<5
30-4040.3n<5
40-5020.425n<5

lmstudio/auto[post-window]

issued 466 - open 225 - resolved 231 - 70 hit / 161 miss - Brier 0.211 - base rate 0.303 - climatological 0.211 - skill -0.001

28 of 231 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed223690.2130.00270 row(s) with defective citations
keyless610.137-n<10 - printed, not hidden; 1 row(s) with defective citations
undetermined2resolved with no determination - KEYED by rule (RPAS 4.03)
binnmean pobserved
0-1010.05n<5
10-20160.1560.125
20-30770.2360.195
30-40820.3260.378
40-50300.4280.4
50-6050.520.2
60-70100.6350.6
70-8030.7n<5
80-9040.85n<5
90-10030.917n<5

lmstudio/auto[pre-verbot]

issued 60 - open 3 - resolved 49 - 13 hit / 36 miss - Brier 0.212 - base rate 0.265 - climatological 0.195 - skill -0.086

49 of 49 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed1450.2170.0541 row(s) with defective citations
keyless1220.175-0.263
undetermined23resolved with no determination - KEYED by rule (RPAS 4.03)
binnmean pobserved
10-2010.15n<5
20-30110.2360.182
30-40190.3240.263
40-50100.4150.4
50-6040.525n<5
60-7030.633n<5
70-8010.7n<5

lmstudio/qwen36

issued 104 - open 103 - resolved 1 - 1 hit / 0 miss - Brier 0.722 - base rate 1.0 - climatological 0.0

insufficient n (1<10) - printed, not hidden

classnhitsBrierskillnote
keyed110.722-n<10 - printed, not hidden; 1 row(s) with defective citations
keyless0---no resolved rows
binnmean pobserved
10-2010.15n<5

lmstudio/qwen36-abliterated

era registered - 105 issued, 105 open, nothing resolved yet. Printed rather than omitted; a hole the register discloses.

lmstudio/qwen36-realist

issued 113 - open 106 - resolved 7 - 3 hit / 4 miss - Brier 0.297 - base rate 0.429 - climatological 0.245

insufficient n (7<10) - printed, not hidden

frame: 113 rows under the frame in force 442300f131b11b7c

classnhitsBrierskillnote
keyed730.297-n<10 - printed, not hidden; 1 row(s) with defective citations
keyless0---no resolved rows
binnmean pobserved
10-2010.15n<5
20-3010.25n<5
30-4020.325n<5
40-5020.425n<5
60-7010.65n<5

lmstudio/realist

issued 242 - open 155 - resolved 86 - 49 hit / 37 miss - Brier 0.321 - base rate 0.57 - climatological 0.245 - skill -0.311

frame: 182 rows under the frame in force 442300f131b11b7c; 60 rows under an earlier frame text 7b96df749db5034b - pre-revision class, printed here, outside the H6 population (registration Section 15)

classnhitsBrierskillnote
keyed86490.321-0.31139 row(s) with defective citations
keyless0---no resolved rows
binnmean pobserved
10-2060.1550.5
20-30290.230.586
30-40360.320.528
40-50110.4320.636
50-6020.525n<5
60-7010.6n<5
80-9010.85n<5

manual/fable

issued 45 - open 18 - resolved 27 - 14 hit / 13 miss - Brier 0.18 - base rate 0.519 - climatological 0.25 - skill 0.279

27 of 27 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed16100.1790.2382 row(s) with defective citations
keyless1140.1820.2132 row(s) with defective citations
binnmean pobserved
10-2020.165n<5
20-3060.2320.0
30-4040.34n<5
40-5060.420.833
50-6030.533n<5
60-7040.637n<5
70-8010.7n<5
80-9010.8n<5

manual/fable-5

issued 38 - open 15 - resolved 23 - 13 hit / 10 miss - Brier 0.17 - base rate 0.565 - climatological 0.246 - skill 0.307

17 of 23 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed17100.1440.406
keyless630.245-n<10 - printed, not hidden; 1 row(s) with defective citations
binnmean pobserved
0-1010.08n<5
10-2010.15n<5
20-3050.2440.6
30-4040.312n<5
40-5040.425n<5
50-6010.55n<5
60-7020.65n<5
80-9020.865n<5
90-10030.907n<5

manual/fable-5.1/unattested

issued 413 - open 332 - resolved 73 - 47 hit / 26 miss - Brier 0.233 - base rate 0.644 - climatological 0.229 - skill -0.015

classnhitsBrierskillnote
keyed57370.242-0.06213 row(s) with defective citations
keyless16100.20.148
binnmean pobserved
0-1020.08n<5
10-2080.140.5
20-3050.2460.0
30-4090.3170.556
40-50170.4220.588
50-60100.5370.8
60-7050.631.0
70-8060.7250.833
80-9050.8340.6
90-10060.9081.0

manual/fable-5/unattested

issued 258 - open 165 - resolved 84 - 57 hit / 27 miss - Brier 0.193 - base rate 0.679 - climatological 0.218 - skill 0.116

3 of 84 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed76530.1960.0726 row(s) with defective citations
keyless840.165-n<10 - printed, not hidden
binnmean pobserved
10-2020.1n<5
20-3080.2370.5
30-40140.3070.286
40-50120.4170.667
50-6050.531.0
60-70130.6310.769
70-8080.7350.875
80-90140.8340.786
90-10080.9111.0

manual/opus-5

issued 74 - open 42 - resolved 32 - 15 hit / 17 miss - Brier 0.204 - base rate 0.469 - climatological 0.249 - skill 0.182

27 of 32 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed25120.2040.1833 row(s) with defective citations
keyless730.203-n<10 - printed, not hidden; 1 row(s) with defective citations
binnmean pobserved
10-2020.15n<5
20-3040.23n<5
30-4040.32n<5
40-5080.4390.5
50-6040.538n<5
60-7020.625n<5
70-8030.76n<5
80-9050.8440.8

manual/opus-5.5/unattested

issued 245 - open 234 - resolved 11 - 5 hit / 6 miss - Brier 0.362 - base rate 0.455 - climatological 0.248 - skill -0.46

classnhitsBrierskillnote
keyed730.396-n<10 - printed, not hidden
keyless420.303-n<10 - printed, not hidden
binnmean pobserved
30-4030.333n<5
50-6010.5n<5
60-7020.625n<5
70-8020.74n<5
80-9030.84n<5

manual/opus-5/unattested

issued 326 - open 247 - resolved 69 - 48 hit / 21 miss - Brier 0.195 - base rate 0.696 - climatological 0.212 - skill 0.078

13 of 69 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed56420.198-0.05316 row(s) with defective citations
keyless1360.1860.253
binnmean pobserved
0-1010.07n<5
20-3080.2460.25
30-4090.3170.444
40-50110.4340.818
50-60100.5450.7
60-7090.6240.778
70-8090.7230.889
80-90110.8360.909
90-10010.9n<5

manual/sonnet-5

issued 45 - open 4 - resolved 40 - 22 hit / 18 miss - Brier 0.256 - base rate 0.55 - climatological 0.247 - skill -0.033

28 of 40 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed38210.255-0.0321 row(s) with defective citations
keyless210.265-n<10 - printed, not hidden
binnmean pobserved
0-1010.07n<5
10-2040.155n<5
20-3050.2440.4
30-4080.320.625
40-5070.4390.571
50-6060.5570.667
60-7050.6240.6
70-8010.74n<5
80-9020.825n<5
90-10010.92n<5

manual/sonnet-5.5/unattested

issued 196 - open 193 - resolved 3 - 3 hit / 0 miss - Brier 0.009 - base rate 1.0 - climatological 0.0

insufficient n (3<10) - printed, not hidden

classnhitsBrierskillnote
keyed110.014-n<10 - printed, not hidden
keyless220.007-n<10 - printed, not hidden
binnmean pobserved
80-9010.88n<5
90-10020.92n<5

manual/sonnet-5/unattested

issued 342 - open 179 - resolved 158 - 83 hit / 75 miss - Brier 0.251 - base rate 0.525 - climatological 0.249 - skill -0.006

16 of 158 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed131700.253-0.01813 row(s) with defective citations
keyless27130.240.038
binnmean pobserved
0-1050.0740.2
10-20220.1510.318
20-30260.2390.308
30-40300.3320.633
40-50220.4340.636
50-60230.5470.652
60-70120.6360.583
70-8090.7540.556
80-9050.840.6
90-10040.907n<5

operator/human

issued 10 - open 5 - resolved 2 - 1 hit / 1 miss - Brier 0.186 - base rate 0.5 - climatological 0.25

insufficient n (2<10) - printed, not hidden

2 of 2 resolved rows predate the rubric commitment - drift comparison anchors at the first hashed row

classnhitsBrierskillnote
keyed0---no resolved rows
keyless210.186-n<10 - printed, not hidden
binnmean pobserved
50-6010.5n<5
60-7010.65n<5