MathCAMPS Logo

CodeLlama 7B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.92 - - -
K.NBT.A.1 0.90 - - -
K.OA.A.5 0.88 0.59 0.90 46
K.CC.C.7 0.70 - 0.89 64

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.94 0.84 1.00 38
1.OA.A.1 0.97 1.00 1.00 32
1.OA.D.8 0.86 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.78 0.39 0.89 37
2.MD.B.5 0.86 1.00 0.62 13
2.NBT.B.6 0.77 0.73 0.68 30
2.OA.A.1 0.81 - - -
2.NBT.B.5 0.89 0.73 1.00 31
2.MD.C.8 0.91 0.93 0.92 64

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.85 0.67 0.92 36
3.MD.D.8-quadrilateral 0.46 - - -
3.OA.A.4 0.89 - - -
3.MD.D.8-polygon 0.27 - - -
3.MD.D.8-triangle 0.44 - - -
3.NBT.A.2 0.89 0.75 0.95 38
3.OA.A.3 0.86 1.00 0.79 22
3.OA.C.7 0.82 0.50 1.00 18

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.82 0.17 0.78 15
4.OA.B.4 0.15 - - -
4.MD.A.2-decimal 0.49 0.64 0.73 22
4.MD.A.3 0.50 - 1.00 3
4.MD.A.2-fraction 0.24 0.67 1.00 7
4.NBT.B.6 0.17 - 1.00 1
4.NF.A.2 0.44 - 0.58 19
4.NBT.B.5 0.25 - 1.00 5
4.OA.A.3 0.24 1.00 0.50 5

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.38 1.00 0.67 8
5.NBT.B.6 0.31 - - 1
5.NF.A.1 0.04 - - -
5.NBT.B.5 0.13 - 1.00 1
5.NF.B.4 0.34 0.25 0.67 17
5.NBT.B.7 0.47 - 1.00 6
5.NF.A.2 0.06 - - -

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.71 - - -
6.NS.B.2 0.20 - - -
6.EE.A.1 0.99 - 0.90 10
6.NS.B.3 0.38 1.00 1.00 2

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.02 - - -
7.NS.A.2 0.13 0.25 0.50 8
7.NS.A.1-decimal 0.54 - 1.00 5
7.NS.A.3-fraction 0.05 - - -
7.NS.A.3-decimal 0.52 0.60 0.86 12

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.33 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.14 - - -