MathCAMPS Logo

DeepSeek Math 7B Base

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.94 - - -
K.NBT.A.1 0.92 - - -
K.OA.A.5 0.91 0.94 0.95 123
K.CC.C.7 0.99 - 0.95 99

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.97 1.00 0.97 130
1.OA.A.1 0.98 0.95 0.96 139
1.OA.D.8 0.95 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.93 0.85 0.96 147
2.MD.B.5 0.99 0.95 0.98 151
2.NBT.B.6 0.90 0.91 0.95 133
2.OA.A.1 0.84 - - -
2.NBT.B.5 0.93 0.88 0.97 128
2.MD.C.8 0.97 0.91 1.00 153

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.91 0.86 0.95 120
3.MD.D.8-quadrilateral 0.77 - - -
3.OA.A.4 0.96 - - -
3.MD.D.8-polygon 0.73 - - -
3.MD.D.8-triangle 0.89 - - -
3.NBT.A.2 0.99 0.92 0.96 153
3.OA.A.3 0.94 0.89 0.95 101
3.OA.C.7 0.95 0.84 0.98 122

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.98 0.82 1.00 133
4.OA.B.4 0.85 - - -
4.MD.A.2-decimal 0.84 0.87 0.97 114
4.MD.A.3 0.93 - 0.89 80
4.MD.A.2-fraction 0.41 0.80 0.84 47
4.NBT.B.6 0.38 - 0.69 29
4.NF.A.2 0.89 - 0.93 89
4.NBT.B.5 0.93 - 0.94 86
4.OA.A.3 0.58 0.81 0.91 63

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.89 0.77 0.86 93
5.NBT.B.6 0.94 - 0.36 72
5.NF.A.1 0.10 0.38 0.80 18
5.NBT.B.5 0.70 1.00 0.89 63
5.NF.B.4 0.76 0.75 0.85 115
5.NBT.B.7 0.73 0.57 0.95 103
5.NF.A.2 0.30 0.45 0.52 49

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.91 - - -
6.NS.B.2 0.90 - 0.24 45
6.EE.A.1 1.00 - 0.99 97
6.NS.B.3 0.65 0.66 0.88 92

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.16 0.62 0.57 27
7.NS.A.2 0.50 0.62 0.80 86
7.NS.A.1-decimal 0.99 0.94 0.97 176
7.NS.A.3-fraction 0.16 - 0.88 21
7.NS.A.3-decimal 0.82 0.92 0.96 122

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.91 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.74 - - -