MathCAMPS Logo

Claude-3 Haiku

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.98 - - -
K.NBT.A.1 0.94 - - -
K.OA.A.5 0.96 1.00 0.97 125
K.CC.C.7 0.99 - 1.00 99

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.98 1.00 0.97 133
1.OA.A.1 0.98 0.98 0.96 139
1.OA.D.8 0.99 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.98 0.99 0.99 151
2.MD.B.5 0.97 0.92 0.99 146
2.NBT.B.6 0.94 0.97 0.99 140
2.OA.A.1 0.97 - - -
2.NBT.B.5 0.97 0.98 0.96 134
2.MD.C.8 0.99 0.98 1.00 154

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.94 0.95 0.98 123
3.MD.D.8-quadrilateral 0.99 - - -
3.OA.A.4 1.00 - - -
3.MD.D.8-polygon 0.96 - - -
3.MD.D.8-triangle 1.00 - - -
3.NBT.A.2 0.99 0.96 0.98 153
3.OA.A.3 0.97 0.97 0.70 108
3.OA.C.7 0.98 0.95 0.82 126

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.98 0.95 1.00 133
4.OA.B.4 1.00 - - -
4.MD.A.2-decimal 0.93 0.96 0.92 126
4.MD.A.3 0.99 - 1.00 85
4.MD.A.2-fraction 0.38 0.71 0.94 48
4.NBT.B.6 0.82 - 0.90 72
4.NF.A.2 0.97 - 0.95 97
4.NBT.B.5 1.00 - 0.95 93
4.OA.A.3 0.79 0.89 0.95 84

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.91 0.91 0.77 96
5.NBT.B.6 0.98 - 0.04 74
5.NF.A.1 0.16 0.33 0.77 28
5.NBT.B.5 0.93 1.00 0.98 84
5.NF.B.4 0.68 0.64 0.73 100
5.NBT.B.7 0.75 0.80 0.97 106
5.NF.A.2 0.41 0.36 0.68 65

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.98 - - -
6.NS.B.2 0.93 - 0.13 47
6.EE.A.1 0.99 - 0.98 96
6.NS.B.3 0.79 0.80 0.95 111

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.31 0.38 0.54 57
7.NS.A.2 0.55 0.44 0.80 94
7.NS.A.1-decimal 0.98 0.99 1.00 173
7.NS.A.3-fraction 0.18 0.67 0.62 19
7.NS.A.3-decimal 0.91 0.88 0.95 133

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.96 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.58 - - -