MathCAMPS Logo

Mixtral 8x7B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.96 - - -
K.NBT.A.1 0.91 - - -
K.OA.A.5 0.93 0.84 0.95 124
K.CC.C.7 0.98 - 0.95 98

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.94 0.96 0.96 125
1.OA.A.1 0.97 0.91 0.96 136
1.OA.D.8 0.98 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.95 0.83 0.96 145
2.MD.B.5 0.96 0.88 0.94 148
2.NBT.B.6 0.87 0.89 0.92 129
2.OA.A.1 0.93 - - -
2.NBT.B.5 0.93 0.96 0.96 131
2.MD.C.8 0.95 0.92 0.99 147

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.92 0.83 0.91 121
3.MD.D.8-quadrilateral 0.89 - - -
3.OA.A.4 0.92 - - -
3.MD.D.8-polygon 0.78 - - -
3.MD.D.8-triangle 0.92 - - -
3.NBT.A.2 0.97 0.77 0.88 152
3.OA.A.3 0.95 0.94 0.76 106
3.OA.C.7 0.95 0.97 0.82 123

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.93 0.79 0.90 128
4.OA.B.4 0.86 - - -
4.MD.A.2-decimal 0.84 0.86 0.91 118
4.MD.A.3 0.99 - 0.98 85
4.MD.A.2-fraction 0.38 0.58 0.78 44
4.NBT.B.6 0.50 - 0.64 42
4.NF.A.2 0.90 - 0.77 90
4.NBT.B.5 0.91 - 0.83 84
4.OA.A.3 0.47 0.93 0.92 50

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.72 0.71 0.72 74
5.NBT.B.6 0.95 - 0.08 72
5.NF.A.1 0.10 0.22 0.50 19
5.NBT.B.5 0.54 1.00 0.81 49
5.NF.B.4 0.55 0.53 0.67 84
5.NBT.B.7 0.62 0.56 0.87 90
5.NF.A.2 0.15 0.18 0.36 25

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.92 - - -
6.NS.B.2 0.77 - 0.23 40
6.EE.A.1 0.97 - 0.96 94
6.NS.B.3 0.55 0.65 0.90 77

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.14 0.17 0.33 24
7.NS.A.2 0.60 0.46 0.74 103
7.NS.A.1-decimal 0.93 0.95 0.89 165
7.NS.A.3-fraction 0.15 - 0.53 21
7.NS.A.3-decimal 0.81 0.78 0.96 118

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.95 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.41 - - -