MathCAMPS Logo

Gemma 2B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.87 - - -
K.NBT.A.1 0.67 - - -
K.OA.A.5 0.66 0.44 0.69 93
K.CC.C.7 0.44 - 0.50 34

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.81 0.50 0.56 103
1.OA.A.1 0.82 0.33 0.57 109
1.OA.D.8 0.65 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.77 0.09 0.49 102
2.MD.B.5 0.77 0.21 0.66 113
2.NBT.B.6 0.46 0.52 0.50 61
2.OA.A.1 0.75 - - -
2.NBT.B.5 0.86 0.11 0.48 98
2.MD.C.8 0.84 0.27 0.71 114

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.72 0.32 0.64 83
3.MD.D.8-quadrilateral 0.42 - - -
3.OA.A.4 0.84 - - -
3.MD.D.8-polygon 0.37 - - -
3.MD.D.8-triangle 0.58 - - -
3.NBT.A.2 0.91 0.10 0.48 123
3.OA.A.3 0.78 0.71 0.67 82
3.OA.C.7 0.73 0.66 0.60 92

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.83 0.11 0.34 90
4.OA.B.4 0.34 - - -
4.MD.A.2-decimal 0.44 0.21 0.50 52
4.MD.A.3 0.82 - 0.60 67
4.MD.A.2-fraction 0.21 0.50 0.42 16
4.NBT.B.6 0.18 - 0.27 11
4.NF.A.2 0.52 - 0.33 43
4.NBT.B.5 0.31 - 0.39 28
4.OA.A.3 0.10 0.50 0.50 14

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.29 0.33 0.55 25
5.NBT.B.6 0.56 - 0.10 42
5.NF.A.1 0.02 - - 4
5.NBT.B.5 0.18 - 0.40 15
5.NF.B.4 0.36 0.22 0.61 36
5.NBT.B.7 0.49 0.36 0.50 54
5.NF.A.2 0.07 - 0.33 4

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.68 - - -
6.NS.B.2 0.27 - 0.14 14
6.EE.A.1 0.89 - 0.89 81
6.NS.B.3 0.37 0.16 0.50 39

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.04 - - 2
7.NS.A.2 0.14 0.22 0.50 17
7.NS.A.1-decimal 0.73 0.20 0.48 101
7.NS.A.3-fraction 0.03 - 0.50 2
7.NS.A.3-decimal 0.58 0.33 0.58 63

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.55 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.25 - - -