MathCAMPS Logo

Llama 3 8B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.99 - - -
K.NBT.A.1 0.92 - - -
K.OA.A.5 0.93 0.98 0.99 122
K.CC.C.7 0.91 - 0.69 91

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.96 1.00 0.97 129
1.OA.A.1 0.99 0.93 0.95 140
1.OA.D.8 0.96 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.99 0.97 0.98 153
2.MD.B.5 0.98 0.88 0.95 149
2.NBT.B.6 0.91 0.96 0.95 136
2.OA.A.1 0.97 - - -
2.NBT.B.5 0.92 0.96 0.99 127
2.MD.C.8 0.98 0.94 0.99 152

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.92 0.89 0.95 122
3.MD.D.8-quadrilateral 0.97 - - -
3.OA.A.4 0.97 - - -
3.MD.D.8-polygon 0.84 - - -
3.MD.D.8-triangle 0.99 - - -
3.NBT.A.2 0.98 0.94 0.94 152
3.OA.A.3 0.92 0.90 0.74 103
3.OA.C.7 0.95 0.95 0.83 122

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.76 0.78 0.88 104
4.OA.B.4 0.97 - - -
4.MD.A.2-decimal 0.81 0.93 0.86 108
4.MD.A.3 0.99 - 0.96 85
4.MD.A.2-fraction 0.40 0.53 0.78 47
4.NBT.B.6 0.68 - 0.77 56
4.NF.A.2 0.90 - 0.58 90
4.NBT.B.5 0.79 - 0.64 72
4.OA.A.3 0.72 0.90 0.88 76

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.83 0.90 0.72 88
5.NBT.B.6 0.93 - 0.09 69
5.NF.A.1 0.11 0.27 0.73 22
5.NBT.B.5 0.43 - 0.62 39
5.NF.B.4 0.59 0.78 0.78 85
5.NBT.B.7 0.58 0.58 0.96 85
5.NF.A.2 0.35 0.28 0.32 59

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.99 - - -
6.NS.B.2 0.65 - 0.11 36
6.EE.A.1 1.00 - 0.95 97
6.NS.B.3 0.51 0.53 0.89 72

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.14 0.25 0.29 26
7.NS.A.2 0.60 0.58 0.82 108
7.NS.A.1-decimal 0.93 0.96 0.94 165
7.NS.A.3-fraction 0.19 - 0.65 23
7.NS.A.3-decimal 0.77 0.87 0.97 113

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.87 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.43 - - -