MathCAMPS Logo

LLemma 7B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.97 - - -
K.NBT.A.1 0.86 - - -
K.OA.A.5 0.41 0.76 0.84 57
K.CC.C.7 0.88 - 0.80 88

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.87 0.98 0.97 115
1.OA.A.1 0.93 0.89 0.96 133
1.OA.D.8 0.89 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.87 0.63 0.96 136
2.MD.B.5 0.89 0.82 0.96 134
2.NBT.B.6 0.77 0.80 0.91 118
2.OA.A.1 0.80 - - -
2.NBT.B.5 0.90 0.72 0.97 126
2.MD.C.8 0.85 0.76 0.91 134

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.77 0.78 0.97 103
3.MD.D.8-quadrilateral 0.59 - - -
3.OA.A.4 0.92 - - -
3.MD.D.8-polygon 0.56 - - -
3.MD.D.8-triangle 0.71 - - -
3.NBT.A.2 0.93 0.69 0.87 144
3.OA.A.3 0.95 0.80 0.87 105
3.OA.C.7 0.88 0.86 0.89 117

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.82 0.55 0.83 112
4.OA.B.4 0.53 - - -
4.MD.A.2-decimal 0.59 0.66 0.74 81
4.MD.A.3 0.43 - 0.65 37
4.MD.A.2-fraction 0.27 0.36 0.70 31
4.NBT.B.6 0.16 - 0.50 12
4.NF.A.2 0.73 - 0.78 73
4.NBT.B.5 0.45 - 0.59 41
4.OA.A.3 0.30 0.69 0.71 37

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.48 0.25 0.68 52
5.NBT.B.6 0.73 - 0.25 57
5.NF.A.1 0.06 0.17 0.50 12
5.NBT.B.5 0.19 - 0.79 14
5.NF.B.4 0.56 0.51 0.50 81
5.NBT.B.7 0.64 0.36 0.84 95
5.NF.A.2 0.20 0.27 0.26 30

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.78 - - -
6.NS.B.2 0.43 - 0.21 24
6.EE.A.1 1.00 - 0.96 97
6.NS.B.3 0.47 0.35 0.88 63

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.10 0.11 - 19
7.NS.A.2 0.31 0.32 0.52 55
7.NS.A.1-decimal 0.90 0.68 0.82 157
7.NS.A.3-fraction 0.10 0.20 0.20 15
7.NS.A.3-decimal 0.66 0.76 0.92 97

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.67 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.41 - - -