MathCAMPS Logo

DeepSeek 67B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.98 - - -
K.NBT.A.1 0.98 - - -
K.OA.A.5 0.93 0.96 1.00 123
K.CC.C.7 0.90 - 0.94 86

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.98 1.00 0.99 131
1.OA.A.1 0.99 0.97 0.98 140
1.OA.D.8 0.99 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.98 0.90 0.96 152
2.MD.B.5 0.98 0.89 0.99 149
2.NBT.B.6 0.92 0.95 1.00 134
2.OA.A.1 0.95 - - -
2.NBT.B.5 0.97 0.96 1.00 130
2.MD.C.8 0.99 0.95 0.99 152

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.96 0.97 0.98 127
3.MD.D.8-quadrilateral 0.97 - - -
3.OA.A.4 0.98 - - -
3.MD.D.8-polygon 0.75 - - -
3.MD.D.8-triangle 0.91 - - -
3.NBT.A.2 0.99 0.91 0.96 149
3.OA.A.3 0.94 0.96 0.80 102
3.OA.C.7 0.97 0.97 0.89 120

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.96 0.95 0.99 128
4.OA.B.4 0.95 - - -
4.MD.A.2-decimal 0.85 0.91 0.97 108
4.MD.A.3 0.98 - 0.99 79
4.MD.A.2-fraction 0.39 0.64 0.89 42
4.NBT.B.6 0.63 - 0.77 47
4.NF.A.2 0.94 - 0.95 40
4.NBT.B.5 0.89 - 0.82 76
4.OA.A.3 0.75 0.88 0.94 67

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.77 0.72 0.78 77
5.NBT.B.6 0.98 - 0.12 64
5.NF.A.1 0.14 - 0.86 14
5.NBT.B.5 0.51 1.00 0.86 43
5.NF.B.4 0.66 0.77 0.76 69
5.NBT.B.7 0.66 0.56 0.98 82
5.NF.A.2 0.45 0.33 0.72 53

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.97 - - -
6.NS.B.2 0.79 - 0.16 37
6.EE.A.1 1.00 - 0.99 91
6.NS.B.3 0.61 0.54 0.89 75

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.20 0.60 0.75 9
7.NS.A.2 0.77 0.64 0.91 82
7.NS.A.1-decimal 0.99 0.97 0.95 116
7.NS.A.3-fraction 0.24 0.40 0.77 18
7.NS.A.3-decimal 0.86 0.84 0.99 127

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.94 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.48 - - -