MathCAMPS Logo

DeepSeek Coder 33B

Performance on individual Common Core standards, grouped by grade level.
IFUP Acc. = Incremental Followup Accuracy, CFUP Acc. = Counterfactual Followup Accuracy, Total FUPs Seen = Number of followup questions a model sees, since a model only sees followups if it answers the main question correctly.

Grade K

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
K.OA.A.4 0.97 - - -
K.NBT.A.1 0.91 - - -
K.OA.A.5 0.91 0.95 0.95 59
K.CC.C.7 0.74 - 0.89 28

Grade 1

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
1.OA.A.2 0.92 1.00 0.80 18
1.OA.A.1 0.97 0.83 0.95 71
1.OA.D.8 0.91 - - -

Grade 2

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
2.NBT.B.7 0.90 0.83 0.88 49
2.MD.B.5 0.97 0.82 1.00 62
2.NBT.B.6 0.82 1.00 1.00 20
2.OA.A.1 0.89 - - -
2.NBT.B.5 0.95 0.75 0.93 39
2.MD.C.8 0.96 0.74 0.95 75

Grade 3

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
3.OA.D.8 0.90 0.81 1.00 53
3.MD.D.8-quadrilateral 0.65 - - -
3.OA.A.4 0.96 - - -
3.MD.D.8-polygon 0.53 - - -
3.MD.D.8-triangle 0.73 - - -
3.NBT.A.2 0.98 0.63 0.97 50
3.OA.A.3 0.93 0.95 0.68 60
3.OA.C.7 0.93 0.90 0.83 67

Grade 4

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
4.NBT.B.4 0.87 0.64 0.81 27
4.OA.B.4 0.01 - - -
4.MD.A.2-decimal 0.60 0.62 0.92 38
4.MD.A.3 0.88 - 0.89 18
4.MD.A.2-fraction 0.36 0.60 0.85 18
4.NBT.B.6 0.45 - 0.84 19
4.NF.A.2 0.45 - 0.78 9
4.NBT.B.5 0.75 - 0.62 26
4.OA.A.3 0.52 0.83 0.89 24

Grade 5

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
5.OA.A.1 0.47 0.60 0.79 24
5.NBT.B.6 0.47 - 0.28 18
5.NF.A.1 0.04 - - -
5.NBT.B.5 0.35 - 0.92 12
5.NF.B.4 0.46 0.50 1.00 5
5.NBT.B.7 0.49 0.67 1.00 15
5.NF.A.2 0.26 0.67 0.50 7

Grade 6

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
6.EE.B.7 0.85 - - -
6.NS.B.2 0.33 - 0.10 10
6.EE.A.1 1.00 - 1.00 1
6.NS.B.3 0.46 0.60 0.89 19

Grade 7

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
7.NS.A.1-fraction 0.11 - - -
7.NS.A.2 0.28 - - -
7.NS.A.1-decimal 0.94 0.78 0.91 20
7.NS.A.3-fraction 0.10 - 0.50 2
7.NS.A.3-decimal 0.77 0.79 0.91 57

Grade 8

Standard Overall Acc. IFUP Acc. CFUP Acc. Total FUPs
8.EE.A.2 0.79 - - -
8.EE.C.8 0.00 - - -
8.EE.C.7 0.36 - - -