Chapter 4 Test Design
4.1 Introduction
The intent of this chapter is to show how the assessment design supports the purposes of Smarter Balanced Interim Assessments. Test design entails developing a test philosophy (i.e., Theory of Action), identifying test purposes, and determining the targeted examinee populations, test specifications, item pool design, and other features such as test delivery (Schmeiser & Welch, 2006). The Smarter Balanced Theory of Action, test purposes, and the targeted examinee population were outlined in the introduction of this report and in Chapter 1. The following section provides information about how content specifications, item specifications, and item pool design were established for the interim assessment’s content structure.
4.2 Content Structure
Figure 4.1 briefly encapsulates the Smarter Balanced interim test design process. An early goal in the development of Smarter Balanced assessments was to align the assessment with the expectations of content, rigor, and performance that comprise the CCSS. Because the CCSS were not specifically developed for assessment, they contain extensive rationale and information concerning instruction. Therefore, adopting previous practices used by many state programs, Smarter Balanced content experts produced content specifications in ELA/literacy and mathematics, distilling assessment-focused elements from the CCSS. The Smarter Balanced content specifications for the ICAs, the IABs, and the FIABs is the same as those for the summative assessments and can be found in the Smarter Balanced Content Specifications (Smarter Balanced, 2017c, 2017d). Also see the Content Explorer.
Item development specifications (https://portal.smarterbalanced.org/library-home/) are then based on content specifications. Each item is aligned to a specific claim and target and to a Common Core State Standard.
There are four broad claims within each of the two subject areas (ELA/literacy and mathematics) in grades 3 to 8 and high school. Within each claim, there are a number of assessment targets. The claims in ELA/literacy and mathematics are given in Table 4.1.
Claim | ELA/Literacy | Mathematics |
---|---|---|
1 | Reading | Concepts and Procedures |
2 | Writing | Problem Solving |
3 | Speaking/Listening | Communicating Reasoning |
4 | Research | Modeling and Data Analysis |
Currently, only the listening part of ELA/literacy claim 3 is assessed. For the ICA in mathematics, claims 2 and 4 are reported together, which results in three reporting categories for mathematics. For the IABs and FIABs, the claim/target structure is used in test specification, and results are reported for the overall IAB or FIAB.
Because of the breadth in coverage of the individual claims, targets, and target clusters within each claim, evidence statements define more specific performance expectations. The relationship between targets and Common Core State Standards elements is made explicit in the Smarter Balanced Content Specifications (Smarter Balanced, 2017c, 2017d). The claim/target hierarchy is the basis for summative and ICA test structure. IABs and FIABs are based on target clusters or content domains that correspond to skill clusters commonly taught as a group.
4.3 Item and Task Development
All items and tasks in the interim assessments were drawn from the same pool of items that are used for the summative assessments. Please refer to the sections on item and task development and field testing in Chapter 4 of the 2018-19 summative technical report for details.
4.4 Test Blueprints
Test specifications and blueprints define the knowledge, skills, and abilities intended to be measured on each student’s test event. A blueprint also specifies how skills are sampled from a set of content standards (i.e., the CCSS). Other important factors, such as depth of knowledge (DOK), are also specified. Specifically, a test blueprint is a formal document that guides the development and assembly of an assessment by explicating the following types of essential information:
- content (claims and assessment targets) that is included for each assessed subject and grade, across various levels of the system (student, classroom, school, district, state);
- the relative emphasis of content standards generally indicated as the number of items per claim and assessment target;
- task models used or required, which communicate to item developers how to measure each claim and assessment target and communicate to teachers and students about learning expectations; and
- depth of knowledge (DOK), indicating the complexity of item types for each claim and assessment target.
The following sections provide more details about the interim test blueprints.
4.4.1 Performance Task (PT) and Non-Performance Task (Non-PT) Components
Each ICA and some IABs/FIABs contain performance tasks. Specifically, each ICA contains one performance task. For IABs, there is a performance task for each grade. There is no performance task for FIABs. Performance tasks measure a student’s ability to integrate knowledge and skills across multiple standards. Performance tasks measure capacities such as essay writing, research skills, and complex analysis, which are not as easy to assess with individual, discrete items. Each ELA/literacy performance task on the ICAs has a set of related stimuli presented with one research item and an essay portion. Each mathematics performance task has four to six items relating to a central problem or stimulus.
The ICA for each subject consists of two parts: a performance task (PT) part and a non-performance task (non-PT) part. Both parts are online. The non-PT section in an ICA is the counterpart of the computer adaptive section in the summative assessment, except that it is not computer adaptive.. As with the summative assessment, no order is imposed on ICA components; either the non-PT or PT portion can be administered to students first.
Performance tasks on IABs are usually stand-alone tasks with four to six items. They are given separately from non-PT IABs/FIABs and are provided primarily to provide practice for students and professional development for teachers in hand scoring and understanding task demands.
4.4.2 Interim Comprehensive Assessments (ICAs)
The ICA blueprints are very similar to the summative blueprints with exceptions generally due to the fact that ICAs are fixed forms, while the summative assessments are computer adaptive. Typically, blueprints for computer adaptive tests specify a range, rather than an exact number of items or points, that must be delivered for each test content area. Blueprints for fixed forms can specify an exact number. Summative and ICA blueprints for 2021-22 are available online.
For each designated grade range (3 to 5, 6 to 8, and high school), the ICA blueprints document the claims that comprise reporting categories, the stimuli used, the number of items by non-PT or PT, and the total number of items by claim. Details are given separately for each grade and include claim, assessment target, DOK, assessment type (non-PT/PT), and the total number of items. Assessment targets are nested within claims and represent a more detailed specification of content. Note that in addition to the nested hierarchical structure, each blueprint also specifies a number of rules applied at global or claim levels. Most of these specifications are in the footnotes, which constitute important parts of the test blueprints.
4.4.3 Interim Assessment Blocks (IABs)
The IABs are designed by teams of content experts to reflect groups of skills most likely to be addressed in instructional units. These tests provide an indicator of whether a student is clearly above or below standard, or whether information is not sufficient to make a judgment with regard to meeting the standard.
Blueprints are available for all IABs. Each IAB blueprint contains information about the claim(s), assessment target(s), and DOK level(s) addressed by the items in that block, as well as the numbers of items allocated to each categories. Other more subject-specific information is also included. For example, the ELA/literacy IAB blueprints incorporate details on passage length and scoring of responses, while the mathematics IAB blueprints specify to what extent the relevant task models are represented in each block. Details are given separately for each grade. The details include claim, assessment target, DOK, assessment type (non-PTs/PT), and the total number of items. IAB blueprints for 2021-22 are available online.
4.4.4 Focused Interim Assessment Blocks (FIABs)
Smarter Balanced began releasing the FIABs in 2019-20. Smarter Balanced followed a detailed process to develop FIABs, working with members and educators to ensure that the new assessments met their needs; this document describes the FIAB development process. FIABs are designed to measure no more than three assessment targets, which provides educators with a more detailed understanding of students’ knowledge and academic performance as well as precise next steps for instruction. FIAB blueprints, similar to those for IABs, are specified for all FIABS and are available online.
4.5 Test Maps
A test map is provided for every interim assessment. Test maps for 2021-22 are provided in appendices to this report. Table 4.7, in a later section of this chapter, provides the meaning of the abbreviations that are used to represent item types in the test maps. Test maps include the following information for each interim assessment and item in the test:
For each ICA (See Appendix A for ELA/literacy and Appendix B for mathematics):
- Grade
- Part (performance task [PT] or not a performance task [non-PT])
- For each item in the ICA:
- Item sequence
- Claim
- Target
- Depth of knowledge (DOK)
- Item type
- Point value
For each IAB (See Appendix C for ELA/literacy and Appendix D for mathematics):
- Grade
- Block name (name of the IAB)
- For each item in the IAB:
- Item sequence
- Claim
- Target
- Depth of knowledge (DOK)
- Item type
- Point value
For each FIAB (See Appendix E for ELA/literacy and Appendix F for mathematics):
- Grade
- Block name (name of the FIAB)
- For each item in the FIAB:
- Item sequence
- Claim
- Target
- Depth of knowledge (DOK)
- Item type
- Point value
4.6 Composition of Interim Item Pools
This section presents counts of items in the IABs, FIABs, and ICAs by claim and item type, as well as a summary of item statistics (difficulty and discrimination). For each interim assessment, the number of items by claim matches the blueprint specifications.
4.6.1 Composition by Claim
The numbers of items per claim in each IAB is shown in Table 4.2 and Table 4.3. The numbers of items per claim in each FIAB is shown in Table 4.4 and Table 4.5. The number of items by claim in each ICA is shown in Table 4.6.
Grade | Interim Assessment Block Name | Claim 1 | Claim 2 | Claim 3 | Claim 4 | Total # Items |
---|---|---|---|---|---|---|
3 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 3 | 5 | |
Read Informational Texts | 16 | 0 | 0 | 0 | 16 | |
Read Literary Texts | 15 | 0 | 0 | 0 | 15 | |
Research | 0 | 0 | 0 | 17 | 17 | |
Revision | 0 | 15 | 0 | 0 | 15 | |
4 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 3 | 5 | |
Read Informational Texts | 14 | 0 | 0 | 0 | 14 | |
Read Literary Texts | 15 | 0 | 0 | 0 | 15 | |
Research | 0 | 0 | 0 | 18 | 18 | |
Revision | 0 | 15 | 0 | 0 | 15 | |
5 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 3 | 5 | |
Read Informational Texts | 15 | 0 | 0 | 0 | 15 | |
Read Literary Texts | 14 | 0 | 0 | 0 | 14 | |
Research | 0 | 0 | 0 | 18 | 18 | |
Revision | 0 | 15 | 0 | 0 | 15 | |
6 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 2 | 4 | |
Read Informational Texts | 16 | 0 | 0 | 0 | 16 | |
Read Literary Texts | 12 | 0 | 0 | 0 | 12 | |
Research | 0 | 0 | 0 | 18 | 18 | |
Revision | 0 | 15 | 0 | 0 | 15 | |
7 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 3 | 5 | |
Read Informational Texts | 16 | 0 | 0 | 0 | 16 | |
Read Literary Texts | 15 | 0 | 0 | 0 | 15 | |
Research | 0 | 0 | 0 | 18 | 18 | |
Revision | 0 | 15 | 0 | 0 | 15 | |
8 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Edit/Revise | 0 | 14 | 0 | 0 | 14 | |
Performance Task | 0 | 2 | 0 | 3 | 5 | |
Read Informational Texts | 16 | 0 | 0 | 0 | 16 | |
Read Literary Texts | 16 | 0 | 0 | 0 | 16 | |
Research | 0 | 0 | 0 | 16 | 16 | |
11 | Brief Writes | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 2 | 0 | 2 | 4 | |
Read Informational Texts | 15 | 0 | 0 | 0 | 15 | |
Read Literary Texts | 16 | 0 | 0 | 0 | 16 | |
Research | 0 | 0 | 0 | 18 | 18 | |
Revision | 0 | 15 | 0 | 0 | 15 |
Grade | Interim Assessment Block Name | Claim 1 | Claim 2 | Claim 3 | Claim 4 | Total # items |
---|---|---|---|---|---|---|
3 | Measurement and Data | 12 | 1 | 1 | 1 | 15 |
Operations and Algebraic Thinking | 12 | 1 | 1 | 1 | 15 | |
Performance Task | 0 | 2 | 2 | 2 | 6 | |
4 | Measurement and Data | 13 | 1 | 0 | 1 | 15 |
Number and Operations - Fractions | 12 | 1 | 2 | 0 | 15 | |
Number and Operations in Base Ten | 12 | 1 | 2 | 0 | 15 | |
Operations and Algebraic Thinking | 9 | 2 | 2 | 3 | 16 | |
Performance Task | 0 | 2 | 2 | 2 | 6 | |
5 | Measurement and Data | 9 | 3 | 1 | 1 | 14 |
Number and Operations - Fractions | 11 | 1 | 2 | 1 | 15 | |
Number and Operations in Base Ten | 11 | 1 | 2 | 1 | 15 | |
Operations and Algebraic Thinking | 13 | 1 | 0 | 1 | 15 | |
Performance Task | 0 | 2 | 2 | 2 | 6 | |
6 | Expressions and Equations | 13 | 1 | 1 | 1 | 16 |
Performance Task | 0 | 2 | 2 | 2 | 6 | |
The Number System | 13 | 1 | 1 | 0 | 15 | |
7 | Expressions and Equations | 12 | 1 | 1 | 1 | 15 |
Geometry | 11 | 2 | 0 | 0 | 13 | |
Performance Task | 0 | 2 | 1 | 3 | 6 | |
8 | Expressions and Equations I | 9 | 3 | 2 | 0 | 14 |
Geometry | 12 | 0 | 1 | 1 | 14 | |
Performance Task | 0 | 2 | 2 | 2 | 6 | |
11 | Algebra and Functions I | 11 | 2 | 1 | 1 | 15 |
Algebra and Functions II | 12 | 0 | 1 | 2 | 15 | |
Geometry Congruence | 0 | 0 | 12 | 0 | 12 | |
Geometry Measurement and Modeling | 0 | 4 | 0 | 6 | 10 | |
Performance Task | 0 | 1 | 2 | 3 | 6 |
Grade | Interim Assessment Block Name | Claim 1 | Claim 2 | Claim 3 | Claim 4 | Total # Items |
---|---|---|---|---|---|---|
3 | Editing | 0 | 15 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 15 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 15 | 0 | 15 | |
Research: Analyze Information | 0 | 0 | 0 | 10 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 0 | 10 | 10 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Informational Texts | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 10 | 0 | 0 | 10 | |
4 | Editing | 0 | 15 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 14 | 0 | 0 | 14 | |
Listen/Interpret | 0 | 0 | 14 | 0 | 14 | |
Research: Analyze Information | 0 | 0 | 0 | 10 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 0 | 12 | 12 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Informational Texts | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 11 | 0 | 0 | 11 | |
5 | Editing | 0 | 14 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 15 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 14 | 0 | 14 | |
Research: Analyze Information | 0 | 0 | 0 | 10 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 0 | 12 | 12 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Informational Texts | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 10 | 0 | 0 | 10 | |
6 | Editing | 0 | 14 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 15 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 15 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 0 | 10 | 10 | |
Research: Evaluate Information and Sources | 0 | 0 | 0 | 12 | 12 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Explanatory Texts | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 11 | 0 | 0 | 11 | |
7 | Editing | 0 | 13 | 0 | 0 | 13 |
Language and Vocabulary Use | 0 | 15 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 15 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 0 | 11 | 11 | |
Research: Evaluate Information and Sources | 0 | 0 | 0 | 11 | 11 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Argumentative Texts | 0 | 10 | 0 | 0 | 10 | |
Write and Revise Explanatory Texts | 0 | 11 | 0 | 0 | 11 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 | |
8 | Editing | 0 | 14 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 14 | 0 | 0 | 14 | |
Listen/Interpret | 0 | 0 | 15 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 0 | 11 | 11 | |
Research: Evaluate Information and Sources | 0 | 0 | 0 | 12 | 12 | |
Research: Use Evidence | 0 | 0 | 0 | 10 | 10 | |
Write and Revise Explanatory Texts | 0 | 12 | 0 | 0 | 12 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 | |
11 | Editing | 0 | 15 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 15 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 15 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 0 | 10 | 10 | |
Research: Evaluate Information and Sources | 0 | 0 | 0 | 10 | 10 | |
Research: Use Evidence | 0 | 0 | 0 | 12 | 12 | |
Write and Revise Argumentative Texts | 0 | 11 | 0 | 0 | 11 | |
Write and Revise Narratives | 0 | 10 | 0 | 0 | 10 |
Grade | Interim Assessment Block Name | Claim 1 | Claim 2 | Claim 3 | Claim 4 | Total # items |
---|---|---|---|---|---|---|
3 | Four Operations: Interpret, Represent, and Solve | 11 | 2 | 0 | 1 | 14 |
Geometry | 12 | 0 | 0 | 0 | 12 | |
Linear and Area Measurement | 10 | 1 | 0 | 1 | 12 | |
Multiplication and Division: Interpret, Represent, and Solve | 8 | 2 | 2 | 0 | 12 | |
Multiply and Divide within 100 | 14 | 0 | 0 | 0 | 14 | |
Number and Operations - Fractions | 13 | 0 | 1 | 0 | 14 | |
Number and Operations in Base Ten | 12 | 2 | 0 | 0 | 14 | |
Properties of Multiplication and Division | 9 | 1 | 1 | 0 | 11 | |
Time, Volume, and Mass | 10 | 2 | 0 | 1 | 13 | |
4 | Build Fractions from Unit Fractions | 12 | 2 | 0 | 0 | 14 |
Factors and Multiples | 11 | 0 | 0 | 0 | 11 | |
Four Operations: Interpret, Represent, and Solve | 11 | 1 | 1 | 1 | 14 | |
Fraction Equivalence and Ordering | 10 | 0 | 3 | 0 | 13 | |
Fractions and Decimal Notation | 11 | 1 | 1 | 0 | 13 | |
Generate and Analyze Patterns | 8 | 0 | 0 | 0 | 8 | |
Geometry | 11 | 0 | 0 | 0 | 11 | |
Multidigit Arithmetic: Place Value and Operations | 11 | 0 | 1 | 0 | 12 | |
Place Value and Multidigit Whole Numbers | 12 | 0 | 1 | 0 | 13 | |
5 | Add and Subtract with Equivalent Fractions | 13 | 0 | 2 | 0 | 15 |
Convert Measurements | 6 | 4 | 2 | 1 | 13 | |
Geometry | 9 | 1 | 2 | 1 | 13 | |
Numerical Expressions | 14 | 0 | 0 | 0 | 14 | |
Operations with Whole Numbers and Decimals | 11 | 0 | 1 | 0 | 12 | |
Place Value System | 10 | 0 | 1 | 0 | 11 | |
Volume Concepts | 9 | 1 | 1 | 0 | 11 | |
6 | Algebraic Expressions | 9 | 0 | 2 | 1 | 12 |
Dependent and Independent Variables | 9 | 0 | 2 | 0 | 11 | |
Divide Fractions by Fractions | 12 | 1 | 0 | 1 | 14 | |
Geometry | 11 | 1 | 1 | 1 | 14 | |
Multidigit Numbers, Factors, and Multiples | 14 | 0 | 0 | 0 | 14 | |
One-Variable Expressions and Equations | 13 | 0 | 1 | 0 | 14 | |
Rational Number System II | 5 | 0 | 6 | 0 | 11 | |
Ratios and Proportional Relationships | 11 | 1 | 1 | 0 | 13 | |
Statistics and Probability | 13 | 0 | 0 | 0 | 13 | |
7 | Algebraic Expressions and Equations | 11 | 2 | 0 | 0 | 13 |
Angles, Areas, and Volume | 9 | 1 | 1 | 0 | 11 | |
Equivalent Expressions | 8 | 0 | 2 | 0 | 10 | |
Geometric Figures | 9 | 2 | 0 | 0 | 11 | |
Ratios and Proportional Relationships | 10 | 1 | 1 | 1 | 13 | |
Statistics and Probability | 13 | 0 | 0 | 2 | 15 | |
The Number System | 11 | 0 | 2 | 1 | 14 | |
8 | Analyze and Solve Linear Equations | 7 | 2 | 3 | 0 | 12 |
Congruence and Similarity | 7 | 0 | 5 | 0 | 12 | |
Expressions and Equations II | 10 | 1 | 1 | 1 | 13 | |
Functions | 11 | 1 | 2 | 1 | 15 | |
Proportional Relationships, Lines, and Linear Equations | 8 | 0 | 2 | 0 | 10 | |
The Number System | 13 | 0 | 0 | 0 | 13 | |
Volume of Cylinders, Cones, and Spheres | 8 | 2 | 0 | 0 | 10 | |
11 | Create Equations: Linear and Exponential | 8 | 3 | 0 | 1 | 12 |
Create Equations: Quadratic | 6 | 2 | 0 | 2 | 10 | |
Equations and Reasoning | 9 | 0 | 2 | 0 | 11 | |
Geometry and Right Triangle Trigonometry | 11 | 1 | 3 | 0 | 15 | |
Interpreting Functions | 10 | 1 | 1 | 2 | 14 | |
Number and Quantity | 11 | 0 | 3 | 1 | 15 | |
Seeing Structure in Expressions/Polynomial Expressions | 10 | 0 | 4 | 1 | 15 | |
Solve Equations and Inequalities: Linear and Exponential | 10 | 0 | 1 | 1 | 12 | |
Solve Equations and Inequalities: Quadratic | 9 | 1 | 0 | 0 | 10 | |
Statistics and Probability | 6 | 3 | 0 | 3 | 12 |
Subject | Grade | Claim 1 | Claim 2 | Claim 3 | Claim 4 | Total # items |
---|---|---|---|---|---|---|
ELA/Literacy | 3 | 14 | 8 | 9 | 9 | 40 |
4 | 16 | 8 | 9 | 9 | 42 | |
5 | 16 | 8 | 9 | 9 | 42 | |
6 | 17 | 8 | 9 | 9 | 43 | |
7 | 17 | 8 | 9 | 9 | 43 | |
8 | 16 | 8 | 8 | 9 | 41 | |
9 | 15 | 8 | 9 | 9 | 41 | |
10 | 15 | 8 | 9 | 9 | 41 | |
11 | 15 | 8 | 9 | 9 | 41 | |
Sum | 141 | 72 | 80 | 81 | 374 | |
Mathematics | 3 | 20 | 4 | 8 | 5 | 37 |
4 | 20 | 4 | 7 | 5 | 36 | |
5 | 20 | 4 | 8 | 5 | 37 | |
6 | 19 | 6 | 8 | 3 | 36 | |
7 | 20 | 4 | 7 | 6 | 37 | |
8 | 20 | 5 | 8 | 4 | 37 | |
9 | 21 | 2 | 9 | 5 | 37 | |
10 | 21 | 2 | 9 | 5 | 37 | |
11 | 21 | 3 | 8 | 6 | 38 | |
Sum | 182 | 34 | 72 | 44 | 332 |
4.6.2 Composition by Item Type
The Consortium develops many different types of items beyond the traditional multiple-choice item. This is done to measure claims and assessment targets with varying degrees of complexity by allowing students to respond in a variety of ways rather than simply recognizing a correct response. The item types used in Smarter Balanced interim assessments are listed in Table 4.7, along with indications of the subject areas in which each item type is used.
Item Types | ELA/Literacy | Mathematics |
---|---|---|
Multiple Choice (MC) | X | X |
Hot Text (HTQ) | X | |
Short Answer Text Response (SA) | X | X |
Evidence-Based Selected Response (EBSR) | X | |
Match Interaction (MI) | X | X |
Multiple Select (MS) | X | X |
Essay/Writing Extended Response (WER) | X | |
Equation Response (EQ) | X | |
Table Interaction (TI) | X |
The frequency of item types by IAB is shown in Table 4.8 (ELA/literacy) and Table 4.9 (mathematics). The frequency of item types by FIAB is shown in Table 4.10 (ELA/literacy) and Table 4.11 (mathematics). The frequency of item types by claim for ICAs is shown in Table 4.12 (ELA/literacy) and Table 4.13 (mathematics). Note that each Essay/Writing Extended Response (WER) is associated with two test items to measure student achievement. The essay response is scored on three rubrics, two of which are combined (averaged), resulting in two items for each essay. The two rubrics that are combined are four-point rubrics—one for evidence/elaboration and the other for organization/purpose. The other rubric is a two-point rubric for conventions.
Grade | Interim Assessment Block Name | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 2 | 5 | |
Read Informational Texts | 2 | 0 | 4 | 8 | 1 | 0 | 1 | 0 | 0 | 16 | |
Read Literary Texts | 3 | 0 | 5 | 6 | 0 | 0 | 1 | 0 | 0 | 15 | |
Research | 0 | 0 | 3 | 12 | 2 | 0 | 0 | 0 | 0 | 17 | |
Revision | 0 | 0 | 4 | 6 | 5 | 0 | 0 | 0 | 0 | 15 | |
4 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 2 | 5 | |
Read Informational Texts | 1 | 0 | 3 | 5 | 4 | 0 | 1 | 0 | 0 | 14 | |
Read Literary Texts | 2 | 0 | 2 | 7 | 3 | 0 | 1 | 0 | 0 | 15 | |
Research | 0 | 0 | 1 | 11 | 5 | 1 | 0 | 0 | 0 | 18 | |
Revision | 0 | 0 | 2 | 10 | 3 | 0 | 0 | 0 | 0 | 15 | |
5 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 1 | 0 | 2 | 0 | 2 | 5 | |
Read Informational Texts | 1 | 0 | 3 | 6 | 3 | 0 | 2 | 0 | 0 | 15 | |
Read Literary Texts | 3 | 0 | 3 | 4 | 3 | 0 | 1 | 0 | 0 | 14 | |
Research | 0 | 0 | 2 | 8 | 8 | 0 | 0 | 0 | 0 | 18 | |
Revision | 0 | 0 | 3 | 8 | 4 | 0 | 0 | 0 | 0 | 15 | |
6 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 2 | 4 | |
Read Informational Texts | 4 | 0 | 3 | 3 | 5 | 0 | 1 | 0 | 0 | 16 | |
Read Literary Texts | 1 | 0 | 2 | 6 | 2 | 0 | 1 | 0 | 0 | 12 | |
Research | 0 | 0 | 7 | 6 | 5 | 0 | 0 | 0 | 0 | 18 | |
Revision | 0 | 0 | 1 | 11 | 3 | 0 | 0 | 0 | 0 | 15 | |
7 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 2 | 5 | |
Read Informational Texts | 3 | 0 | 4 | 2 | 6 | 0 | 1 | 0 | 0 | 16 | |
Read Literary Texts | 4 | 0 | 2 | 7 | 2 | 0 | 0 | 0 | 0 | 15 | |
Research | 0 | 0 | 4 | 5 | 6 | 3 | 0 | 0 | 0 | 18 | |
Revision | 0 | 0 | 3 | 9 | 3 | 0 | 0 | 0 | 0 | 15 | |
8 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Edit/Revise | 0 | 0 | 3 | 7 | 4 | 0 | 0 | 0 | 0 | 14 | |
Performance Task | 0 | 0 | 0 | 0 | 0 | 1 | 2 | 0 | 2 | 5 | |
Read Informational Texts | 2 | 0 | 4 | 4 | 4 | 0 | 2 | 0 | 0 | 16 | |
Read Literary Texts | 1 | 0 | 2 | 8 | 4 | 0 | 1 | 0 | 0 | 16 | |
Research | 0 | 0 | 6 | 7 | 2 | 1 | 0 | 0 | 0 | 16 | |
11 | Brief Writes | 0 | 0 | 0 | 0 | 0 | 0 | 6 | 0 | 0 | 6 |
Performance Task | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 2 | 4 | |
Read Informational Texts | 2 | 0 | 4 | 6 | 1 | 0 | 2 | 0 | 0 | 15 | |
Read Literary Texts | 2 | 0 | 2 | 8 | 3 | 0 | 1 | 0 | 0 | 16 | |
Research | 0 | 0 | 7 | 9 | 2 | 0 | 0 | 0 | 0 | 18 | |
Revision | 0 | 0 | 2 | 9 | 4 | 0 | 0 | 0 | 0 | 15 |
Grade | Interim Assessment Block Name | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | Measurement and Data | 0 | 9 | 0 | 5 | 1 | 0 | 0 | 0 | 0 | 15 |
Operations and Algebraic Thinking | 0 | 9 | 0 | 2 | 0 | 2 | 0 | 2 | 0 | 15 | |
Performance Task | 0 | 2 | 0 | 0 | 0 | 0 | 4 | 0 | 0 | 6 | |
4 | Measurement and Data | 0 | 8 | 0 | 0 | 0 | 5 | 0 | 2 | 0 | 15 |
Number and Operations - Fractions | 0 | 8 | 0 | 0 | 2 | 5 | 0 | 0 | 0 | 15 | |
Number and Operations in Base Ten | 0 | 6 | 0 | 5 | 2 | 2 | 0 | 0 | 0 | 15 | |
Operations and Algebraic Thinking | 0 | 7 | 0 | 6 | 0 | 3 | 0 | 0 | 0 | 16 | |
Performance Task | 0 | 1 | 0 | 1 | 0 | 0 | 3 | 1 | 0 | 6 | |
5 | Measurement and Data | 0 | 11 | 0 | 2 | 0 | 1 | 0 | 0 | 0 | 14 |
Number and Operations - Fractions | 0 | 4 | 0 | 9 | 2 | 0 | 0 | 0 | 0 | 15 | |
Number and Operations in Base Ten | 0 | 6 | 0 | 6 | 0 | 3 | 0 | 0 | 0 | 15 | |
Operations and Algebraic Thinking | 0 | 5 | 0 | 10 | 0 | 0 | 0 | 0 | 0 | 15 | |
Performance Task | 0 | 3 | 0 | 0 | 0 | 0 | 2 | 1 | 0 | 6 | |
6 | Expressions and Equations | 0 | 8 | 0 | 1 | 5 | 2 | 0 | 0 | 0 | 16 |
Performance Task | 0 | 4 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 6 | |
The Number System | 0 | 10 | 0 | 1 | 1 | 3 | 0 | 0 | 0 | 15 | |
7 | Expressions and Equations | 0 | 6 | 0 | 6 | 3 | 0 | 0 | 0 | 0 | 15 |
Geometry | 0 | 9 | 0 | 0 | 1 | 3 | 0 | 0 | 0 | 13 | |
Performance Task | 0 | 1 | 0 | 1 | 0 | 0 | 2 | 2 | 0 | 6 | |
8 | Expressions and Equations I | 0 | 8 | 0 | 4 | 2 | 0 | 0 | 0 | 0 | 14 |
Geometry | 0 | 5 | 0 | 4 | 1 | 4 | 0 | 0 | 0 | 14 | |
Performance Task | 0 | 3 | 0 | 0 | 0 | 0 | 2 | 1 | 0 | 6 | |
11 | Algebra and Functions I | 0 | 5 | 0 | 7 | 0 | 3 | 0 | 0 | 0 | 15 |
Algebra and Functions II | 0 | 2 | 0 | 6 | 1 | 6 | 0 | 0 | 0 | 15 | |
Geometry Congruence | 0 | 1 | 0 | 9 | 0 | 2 | 0 | 0 | 0 | 12 | |
Geometry Measurement and Modeling | 0 | 5 | 0 | 4 | 0 | 1 | 0 | 0 | 0 | 10 | |
Performance Task | 0 | 1 | 0 | 1 | 0 | 0 | 4 | 0 | 0 | 6 |
Grade | Interim Assessment Block Name | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | Editing | 0 | 0 | 7 | 6 | 2 | 0 | 0 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 0 | 2 | 7 | 6 | 0 | 0 | 0 | 0 | 15 | |
Listen/Interpret | 3 | 0 | 0 | 7 | 1 | 4 | 0 | 0 | 0 | 15 | |
Research: Analyze Information | 0 | 0 | 0 | 8 | 2 | 0 | 0 | 0 | 0 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 1 | 7 | 2 | 0 | 0 | 0 | 0 | 10 | |
Research: Use Evidence | 0 | 0 | 3 | 5 | 2 | 0 | 0 | 0 | 0 | 10 | |
Write and Revise Informational Texts | 0 | 0 | 3 | 5 | 0 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 0 | 3 | 3 | 2 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 0 | 0 | 5 | 3 | 0 | 2 | 0 | 0 | 10 | |
4 | Editing | 0 | 0 | 3 | 9 | 3 | 0 | 0 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 0 | 4 | 6 | 4 | 0 | 0 | 0 | 0 | 14 | |
Listen/Interpret | 2 | 0 | 0 | 7 | 3 | 2 | 0 | 0 | 0 | 14 | |
Research: Analyze Information | 0 | 0 | 0 | 7 | 3 | 0 | 0 | 0 | 0 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 1 | 9 | 1 | 1 | 0 | 0 | 0 | 12 | |
Research: Use Evidence | 0 | 0 | 4 | 4 | 2 | 0 | 0 | 0 | 0 | 10 | |
Write and Revise Informational Texts | 0 | 0 | 1 | 5 | 2 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 0 | 3 | 5 | 0 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 0 | 2 | 4 | 3 | 0 | 2 | 0 | 0 | 11 | |
5 | Editing | 0 | 0 | 4 | 8 | 2 | 0 | 0 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 0 | 5 | 5 | 5 | 0 | 0 | 0 | 0 | 15 | |
Listen/Interpret | 4 | 0 | 0 | 6 | 2 | 2 | 0 | 0 | 0 | 14 | |
Research: Analyze Information | 0 | 0 | 0 | 5 | 5 | 0 | 0 | 0 | 0 | 10 | |
Research: Interpret and Integrate | 0 | 0 | 3 | 5 | 4 | 0 | 0 | 0 | 0 | 12 | |
Research: Use Evidence | 0 | 0 | 5 | 4 | 1 | 0 | 0 | 0 | 0 | 10 | |
Write and Revise Informational Texts | 0 | 0 | 1 | 3 | 4 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 0 | 4 | 3 | 1 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Opinion Texts | 0 | 0 | 1 | 5 | 2 | 0 | 2 | 0 | 0 | 10 | |
6 | Editing | 0 | 0 | 6 | 7 | 1 | 0 | 0 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 0 | 0 | 8 | 7 | 0 | 0 | 0 | 0 | 15 | |
Listen/Interpret | 5 | 0 | 0 | 5 | 4 | 1 | 0 | 0 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 8 | 0 | 2 | 0 | 0 | 0 | 0 | 10 | |
Research: Evaluate Information and Sources | 0 | 0 | 0 | 3 | 9 | 0 | 0 | 0 | 0 | 12 | |
Research: Use Evidence | 0 | 0 | 2 | 4 | 2 | 2 | 0 | 0 | 0 | 10 | |
Write and Revise Explanatory Texts | 0 | 0 | 3 | 4 | 1 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Narratives | 0 | 0 | 2 | 4 | 3 | 0 | 2 | 0 | 0 | 11 | |
7 | Editing | 0 | 0 | 2 | 7 | 4 | 0 | 0 | 0 | 0 | 13 |
Language and Vocabulary Use | 0 | 0 | 4 | 5 | 6 | 0 | 0 | 0 | 0 | 15 | |
Listen/Interpret | 3 | 0 | 0 | 9 | 3 | 0 | 0 | 0 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 7 | 4 | 0 | 0 | 0 | 0 | 0 | 11 | |
Research: Evaluate Information and Sources | 0 | 0 | 1 | 5 | 5 | 0 | 0 | 0 | 0 | 11 | |
Research: Use Evidence | 0 | 0 | 4 | 5 | 0 | 1 | 0 | 0 | 0 | 10 | |
Write and Revise Argumentative Texts | 0 | 0 | 4 | 2 | 2 | 0 | 2 | 0 | 0 | 10 | |
Write and Revise Explanatory Texts | 0 | 0 | 6 | 2 | 1 | 0 | 2 | 0 | 0 | 11 | |
Write and Revise Narratives | 0 | 0 | 2 | 4 | 2 | 0 | 2 | 0 | 0 | 10 | |
8 | Editing | 0 | 0 | 5 | 6 | 3 | 0 | 0 | 0 | 0 | 14 |
Language and Vocabulary Use | 0 | 0 | 3 | 8 | 3 | 0 | 0 | 0 | 0 | 14 | |
Listen/Interpret | 2 | 0 | 0 | 11 | 1 | 1 | 0 | 0 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 7 | 4 | 0 | 0 | 0 | 0 | 0 | 11 | |
Research: Evaluate Information and Sources | 0 | 0 | 1 | 7 | 4 | 0 | 0 | 0 | 0 | 12 | |
Research: Use Evidence | 0 | 0 | 3 | 5 | 0 | 2 | 0 | 0 | 0 | 10 | |
Write and Revise Explanatory Texts | 0 | 0 | 4 | 1 | 4 | 0 | 3 | 0 | 0 | 12 | |
Write and Revise Narratives | 0 | 0 | 2 | 3 | 2 | 0 | 3 | 0 | 0 | 10 | |
11 | Editing | 0 | 0 | 7 | 6 | 2 | 0 | 0 | 0 | 0 | 15 |
Language and Vocabulary Use | 0 | 0 | 6 | 5 | 4 | 0 | 0 | 0 | 0 | 15 | |
Listen/Interpret | 0 | 0 | 0 | 10 | 4 | 1 | 0 | 0 | 0 | 15 | |
Research: Analyze and Integrate Information | 0 | 0 | 5 | 4 | 1 | 0 | 0 | 0 | 0 | 10 | |
Research: Evaluate Information and Sources | 0 | 0 | 2 | 4 | 3 | 1 | 0 | 0 | 0 | 10 | |
Research: Use Evidence | 0 | 0 | 3 | 5 | 4 | 0 | 0 | 0 | 0 | 12 | |
Write and Revise Argumentative Texts | 0 | 0 | 2 | 4 | 3 | 0 | 2 | 0 | 0 | 11 | |
Write and Revise Narratives | 0 | 0 | 0 | 3 | 4 | 0 | 3 | 0 | 0 | 10 |
Grade | Interim Assessment Block Name | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | Four Operations: Interpret, Represent, and Solve | 0 | 12 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 14 |
Geometry | 0 | 2 | 0 | 0 | 0 | 10 | 0 | 0 | 0 | 12 | |
Linear and Area Measurement | 0 | 10 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 12 | |
Multiplication and Division: Interpret, Represent, and Solve | 0 | 9 | 0 | 2 | 1 | 0 | 0 | 0 | 0 | 12 | |
Multiply and Divide within 100 | 0 | 7 | 0 | 0 | 0 | 7 | 0 | 0 | 0 | 14 | |
Number and Operations - Fractions | 0 | 9 | 0 | 3 | 1 | 1 | 0 | 0 | 0 | 14 | |
Number and Operations in Base Ten | 0 | 12 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 14 | |
Properties of Multiplication and Division | 0 | 1 | 0 | 7 | 1 | 2 | 0 | 0 | 0 | 11 | |
Time, Volume, and Mass | 0 | 11 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 13 | |
4 | Build Fractions from Unit Fractions | 0 | 11 | 0 | 0 | 0 | 3 | 0 | 0 | 0 | 14 |
Factors and Multiples | 0 | 0 | 0 | 9 | 0 | 2 | 0 | 0 | 0 | 11 | |
Four Operations: Interpret, Represent, and Solve | 0 | 13 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 14 | |
Fraction Equivalence and Ordering | 0 | 5 | 0 | 2 | 0 | 6 | 0 | 0 | 0 | 13 | |
Fractions and Decimal Notation | 0 | 8 | 0 | 2 | 0 | 3 | 0 | 0 | 0 | 13 | |
Generate and Analyze Patterns | 0 | 0 | 0 | 2 | 0 | 6 | 0 | 0 | 0 | 8 | |
Geometry | 0 | 0 | 0 | 0 | 0 | 11 | 0 | 0 | 0 | 11 | |
Multidigit Arithmetic: Place Value and Operations | 0 | 8 | 0 | 4 | 0 | 0 | 0 | 0 | 0 | 12 | |
Place Value and Multidigit Whole Numbers | 0 | 6 | 0 | 3 | 0 | 4 | 0 | 0 | 0 | 13 | |
5 | Add and Subtract with Equivalent Fractions | 0 | 8 | 0 | 7 | 0 | 0 | 0 | 0 | 0 | 15 |
Convert Measurements | 0 | 11 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 13 | |
Geometry | 0 | 0 | 0 | 8 | 1 | 4 | 0 | 0 | 0 | 13 | |
Numerical Expressions | 0 | 7 | 0 | 7 | 0 | 0 | 0 | 0 | 0 | 14 | |
Operations with Whole Numbers and Decimals | 0 | 10 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 12 | |
Place Value System | 0 | 4 | 0 | 3 | 0 | 4 | 0 | 0 | 0 | 11 | |
Volume Concepts | 0 | 9 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 11 | |
6 | Algebraic Expressions | 0 | 9 | 0 | 1 | 2 | 0 | 0 | 0 | 0 | 12 |
Dependent and Independent Variables | 0 | 6 | 0 | 1 | 1 | 0 | 0 | 3 | 0 | 11 | |
Divide Fractions by Fractions | 0 | 8 | 0 | 6 | 0 | 0 | 0 | 0 | 0 | 14 | |
Geometry | 0 | 12 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 14 | |
Multidigit Numbers, Factors, and Multiples | 0 | 14 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 14 | |
One-Variable Expressions and Equations | 0 | 6 | 0 | 3 | 2 | 3 | 0 | 0 | 0 | 14 | |
Rational Number System II | 0 | 4 | 0 | 2 | 3 | 2 | 0 | 0 | 0 | 11 | |
Ratios and Proportional Relationships | 0 | 12 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 13 | |
Statistics and Probability | 0 | 3 | 0 | 3 | 0 | 7 | 0 | 0 | 0 | 13 | |
7 | Algebraic Expressions and Equations | 0 | 9 | 0 | 2 | 2 | 0 | 0 | 0 | 0 | 13 |
Angles, Areas, and Volume | 0 | 8 | 0 | 1 | 0 | 2 | 0 | 0 | 0 | 11 | |
Equivalent Expressions | 0 | 7 | 0 | 2 | 1 | 0 | 0 | 0 | 0 | 10 | |
Geometric Figures | 0 | 8 | 0 | 1 | 0 | 2 | 0 | 0 | 0 | 11 | |
Ratios and Proportional Relationships | 0 | 7 | 0 | 4 | 1 | 1 | 0 | 0 | 0 | 13 | |
Statistics and Probability | 0 | 5 | 0 | 5 | 1 | 4 | 0 | 0 | 0 | 15 | |
The Number System | 0 | 7 | 0 | 4 | 1 | 1 | 0 | 1 | 0 | 14 | |
8 | Analyze and Solve Linear Equations | 0 | 8 | 0 | 3 | 0 | 1 | 0 | 0 | 0 | 12 |
Congruence and Similarity | 0 | 2 | 0 | 3 | 1 | 6 | 0 | 0 | 0 | 12 | |
Expressions and Equations II | 0 | 6 | 0 | 4 | 0 | 1 | 0 | 2 | 0 | 13 | |
Functions | 0 | 4 | 0 | 6 | 3 | 2 | 0 | 0 | 0 | 15 | |
Proportional Relationships, Lines, and Linear Equations | 0 | 6 | 0 | 4 | 0 | 0 | 0 | 0 | 0 | 10 | |
The Number System | 0 | 3 | 0 | 6 | 1 | 3 | 0 | 0 | 0 | 13 | |
Volume of Cylinders, Cones, and Spheres | 0 | 10 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10 | |
11 | Create Equations: Linear and Exponential | 0 | 10 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 12 |
Create Equations: Quadratic | 0 | 8 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 10 | |
Equations and Reasoning | 0 | 5 | 0 | 3 | 0 | 3 | 0 | 0 | 0 | 11 | |
Geometry and Right Triangle Trigonometry | 0 | 7 | 0 | 2 | 2 | 4 | 0 | 0 | 0 | 15 | |
Interpreting Functions | 0 | 2 | 0 | 5 | 1 | 6 | 0 | 0 | 0 | 14 | |
Number and Quantity | 0 | 0 | 0 | 10 | 1 | 4 | 0 | 0 | 0 | 15 | |
Seeing Structure in Expressions/Polynomial Expressions | 0 | 6 | 0 | 8 | 0 | 1 | 0 | 0 | 0 | 15 | |
Solve Equations and Inequalities: Linear and Exponential | 0 | 11 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 12 | |
Solve Equations and Inequalities: Quadratic | 0 | 6 | 0 | 4 | 0 | 0 | 0 | 0 | 0 | 10 | |
Statistics and Probability | 0 | 1 | 0 | 7 | 0 | 4 | 0 | 0 | 0 | 12 |
Grade | Claim | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | 1 | 2 | 0 | 2 | 10 | 0 | 0 | 0 | 0 | 0 | 14 |
2 | 0 | 0 | 1 | 4 | 1 | 0 | 0 | 0 | 2 | 8 | |
3 | 2 | 0 | 0 | 3 | 1 | 3 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 1 | 6 | 1 | 0 | 1 | 0 | 0 | 9 | |
4 | 1 | 2 | 0 | 1 | 10 | 3 | 0 | 0 | 0 | 0 | 16 |
2 | 0 | 0 | 0 | 6 | 0 | 0 | 0 | 0 | 2 | 8 | |
3 | 1 | 0 | 0 | 5 | 2 | 1 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 0 | 6 | 1 | 1 | 1 | 0 | 0 | 9 | |
5 | 1 | 6 | 0 | 2 | 5 | 3 | 0 | 0 | 0 | 0 | 16 |
2 | 0 | 0 | 1 | 5 | 0 | 0 | 0 | 0 | 2 | 8 | |
3 | 3 | 0 | 0 | 4 | 0 | 2 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 1 | 5 | 2 | 0 | 1 | 0 | 0 | 9 | |
6 | 1 | 2 | 0 | 3 | 8 | 2 | 0 | 2 | 0 | 0 | 17 |
2 | 0 | 0 | 0 | 3 | 2 | 0 | 1 | 0 | 2 | 8 | |
3 | 2 | 0 | 0 | 5 | 1 | 1 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 3 | 5 | 0 | 0 | 1 | 0 | 0 | 9 | |
7 | 1 | 3 | 0 | 4 | 7 | 1 | 0 | 2 | 0 | 0 | 17 |
2 | 0 | 0 | 0 | 4 | 1 | 0 | 1 | 0 | 2 | 8 | |
3 | 0 | 0 | 0 | 6 | 3 | 0 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 2 | 5 | 1 | 0 | 1 | 0 | 0 | 9 | |
8 | 1 | 4 | 0 | 3 | 6 | 2 | 0 | 1 | 0 | 0 | 16 |
2 | 0 | 0 | 0 | 3 | 2 | 0 | 1 | 0 | 2 | 8 | |
3 | 0 | 0 | 0 | 8 | 0 | 0 | 0 | 0 | 0 | 8 | |
4 | 0 | 0 | 3 | 5 | 0 | 0 | 1 | 0 | 0 | 9 | |
9 | 1 | 2 | 0 | 3 | 7 | 1 | 0 | 2 | 0 | 0 | 15 |
2 | 0 | 0 | 2 | 3 | 0 | 0 | 1 | 0 | 2 | 8 | |
3 | 0 | 0 | 0 | 6 | 2 | 1 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 0 | 8 | 0 | 0 | 1 | 0 | 0 | 9 | |
10 | 1 | 2 | 0 | 3 | 7 | 1 | 0 | 2 | 0 | 0 | 15 |
2 | 0 | 0 | 2 | 3 | 0 | 0 | 1 | 0 | 2 | 8 | |
3 | 0 | 0 | 0 | 6 | 2 | 1 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 0 | 8 | 0 | 0 | 1 | 0 | 0 | 9 | |
11 | 1 | 2 | 0 | 3 | 7 | 1 | 0 | 2 | 0 | 0 | 15 |
2 | 0 | 0 | 2 | 3 | 0 | 0 | 1 | 0 | 2 | 8 | |
3 | 0 | 0 | 0 | 6 | 2 | 1 | 0 | 0 | 0 | 9 | |
4 | 0 | 0 | 0 | 8 | 0 | 0 | 1 | 0 | 0 | 9 |
Grade | Claim | EBSR | EQ | HTQ | MC | MS | MI | SA | TI | WER | Total # Items |
---|---|---|---|---|---|---|---|---|---|---|---|
3 | 1 | 0 | 17 | 0 | 0 | 0 | 1 | 0 | 2 | 0 | 20 |
2 | 0 | 2 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 4 | |
3 | 0 | 0 | 0 | 3 | 1 | 2 | 2 | 0 | 0 | 8 | |
4 | 0 | 2 | 0 | 2 | 0 | 0 | 1 | 0 | 0 | 5 | |
4 | 1 | 0 | 13 | 0 | 2 | 0 | 5 | 0 | 0 | 0 | 20 |
2 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 1 | 0 | 4 | |
3 | 0 | 1 | 0 | 3 | 1 | 0 | 2 | 0 | 0 | 7 | |
4 | 0 | 3 | 0 | 1 | 0 | 0 | 1 | 0 | 0 | 5 | |
5 | 1 | 0 | 4 | 0 | 11 | 0 | 5 | 0 | 0 | 0 | 20 |
2 | 0 | 3 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 4 | |
3 | 0 | 1 | 0 | 3 | 2 | 0 | 2 | 0 | 0 | 8 | |
4 | 0 | 1 | 0 | 3 | 0 | 0 | 0 | 1 | 0 | 5 | |
6 | 1 | 0 | 12 | 0 | 1 | 2 | 4 | 0 | 0 | 0 | 19 |
2 | 0 | 5 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 6 | |
3 | 0 | 2 | 0 | 3 | 1 | 1 | 1 | 0 | 0 | 8 | |
4 | 0 | 1 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 3 | |
7 | 1 | 0 | 9 | 0 | 5 | 4 | 2 | 0 | 0 | 0 | 20 |
2 | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 4 | |
3 | 0 | 1 | 0 | 5 | 0 | 0 | 1 | 0 | 0 | 7 | |
4 | 0 | 0 | 0 | 3 | 0 | 0 | 1 | 2 | 0 | 6 | |
8 | 1 | 0 | 9 | 0 | 7 | 2 | 2 | 0 | 0 | 0 | 20 |
2 | 0 | 3 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 5 | |
3 | 0 | 0 | 0 | 6 | 0 | 0 | 2 | 0 | 0 | 8 | |
4 | 0 | 3 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 4 | |
9 | 1 | 0 | 8 | 0 | 9 | 0 | 4 | 0 | 0 | 0 | 21 |
2 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 2 | |
3 | 0 | 0 | 0 | 5 | 1 | 1 | 2 | 0 | 0 | 9 | |
4 | 0 | 3 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 5 | |
10 | 1 | 0 | 8 | 0 | 9 | 0 | 4 | 0 | 0 | 0 | 21 |
2 | 0 | 1 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 2 | |
3 | 0 | 0 | 0 | 5 | 1 | 1 | 2 | 0 | 0 | 9 | |
4 | 0 | 3 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 5 | |
11 | 1 | 0 | 5 | 0 | 11 | 0 | 5 | 0 | 0 | 0 | 21 |
2 | 0 | 2 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 3 | |
3 | 0 | 0 | 0 | 5 | 1 | 0 | 2 | 0 | 0 | 8 | |
4 | 0 | 2 | 0 | 0 | 1 | 1 | 2 | 0 | 0 | 6 |
4.6.3 Summary of Item Statistics
Summary information about the item response theory (IRT) parameters for items used in the IABs, FIABs, and ICAs are shown in Table 4.14 through Table 4.18. The tables display the mean and standard deviation of the IRT difficulty parameter (b-parameter) and discrimination parameter (a-parameter).
Grade | Interim Assessment Block Name | N items | Mean b parameter | SD b parameter | Mean a parameter | SD a parameter |
---|---|---|---|---|---|---|
3 | Brief Writes | 6 | 0.256 | 0.265 | 0.715 | 0.076 |
Performance Task | 5 | 0.302 | 1.111 | 0.852 | 0.171 | |
Read Informational Texts | 16 | -0.180 | 1.086 | 0.642 | 0.234 | |
Read Literary Texts | 15 | -0.678 | 0.710 | 0.896 | 0.156 | |
Research | 17 | -0.676 | 0.908 | 0.648 | 0.225 | |
Revision | 15 | -0.639 | 0.857 | 0.742 | 0.180 | |
4 | Brief Writes | 6 | 0.495 | 0.657 | 0.654 | 0.123 |
Performance Task | 5 | 0.497 | 0.804 | 0.900 | 0.083 | |
Read Informational Texts | 14 | 0.074 | 0.873 | 0.662 | 0.226 | |
Read Literary Texts | 15 | -0.123 | 1.040 | 0.708 | 0.274 | |
Research | 18 | -0.158 | 0.908 | 0.587 | 0.207 | |
Revision | 15 | -0.422 | 1.066 | 0.523 | 0.160 | |
5 | Brief Writes | 6 | 0.898 | 0.667 | 0.605 | 0.058 |
Performance Task | 5 | 0.512 | 0.454 | 0.887 | 0.269 | |
Read Informational Texts | 15 | 0.865 | 1.002 | 0.547 | 0.160 | |
Read Literary Texts | 14 | 0.806 | 0.749 | 0.616 | 0.255 | |
Research | 18 | 0.172 | 0.977 | 0.648 | 0.207 | |
Revision | 15 | -0.151 | 0.915 | 0.600 | 0.168 | |
6 | Brief Writes | 6 | 1.301 | 0.535 | 0.680 | 0.121 |
Performance Task | 4 | 0.607 | 1.029 | 0.999 | 0.247 | |
Read Informational Texts | 16 | 1.010 | 0.958 | 0.632 | 0.197 | |
Read Literary Texts | 12 | 0.257 | 0.988 | 0.606 | 0.162 | |
Research | 18 | 0.712 | 0.726 | 0.660 | 0.237 | |
Revision | 15 | 0.408 | 1.442 | 0.456 | 0.145 | |
7 | Brief Writes | 6 | 1.415 | 0.514 | 0.620 | 0.133 |
Performance Task | 5 | 1.415 | 1.435 | 0.943 | 0.201 | |
Read Informational Texts | 16 | 0.989 | 1.178 | 0.630 | 0.217 | |
Read Literary Texts | 15 | 0.561 | 1.218 | 0.724 | 0.241 | |
Research | 18 | 1.523 | 1.104 | 0.517 | 0.118 | |
Revision | 15 | 0.651 | 0.641 | 0.488 | 0.173 | |
8 | Brief Writes | 6 | 1.540 | 0.469 | 0.673 | 0.150 |
Edit/Revise | 14 | 0.401 | 1.043 | 0.570 | 0.218 | |
Performance Task | 5 | 1.348 | 1.529 | 0.756 | 0.131 | |
Read Informational Texts | 16 | 1.558 | 1.073 | 0.638 | 0.180 | |
Read Literary Texts | 16 | 0.700 | 1.174 | 0.703 | 0.259 | |
Research | 16 | 1.594 | 1.291 | 0.575 | 0.249 | |
11 | Brief Writes | 6 | 1.743 | 0.744 | 0.521 | 0.065 |
Performance Task | 4 | 1.260 | 0.467 | 0.627 | 0.076 | |
Read Informational Texts | 15 | 1.766 | 1.156 | 0.498 | 0.197 | |
Read Literary Texts | 16 | 1.351 | 1.166 | 0.546 | 0.228 | |
Research | 18 | 1.572 | 1.087 | 0.515 | 0.155 | |
Revision | 15 | 1.051 | 1.101 | 0.491 | 0.172 |
Grade | Interim Assessment Block Name | N items | Mean b parameter | SD b parameter | Mean a parameter | SD a parameter |
---|---|---|---|---|---|---|
3 | Measurement and Data | 15 | -1.201 | 0.851 | 0.878 | 0.267 |
Operations and Algebraic Thinking | 15 | -1.491 | 1.098 | 0.896 | 0.240 | |
Performance Task | 6 | -0.634 | 0.375 | 1.163 | 0.264 | |
4 | Measurement and Data | 15 | 0.340 | 0.885 | 0.760 | 0.285 |
Number and Operations - Fractions | 15 | -0.612 | 1.044 | 0.924 | 0.328 | |
Number and Operations in Base Ten | 15 | -0.723 | 0.943 | 0.705 | 0.187 | |
Operations and Algebraic Thinking | 16 | -0.489 | 0.816 | 0.824 | 0.330 | |
Performance Task | 6 | 0.147 | 0.528 | 0.731 | 0.175 | |
5 | Measurement and Data | 14 | 0.188 | 0.791 | 0.761 | 0.174 |
Number and Operations - Fractions | 15 | -0.019 | 0.994 | 0.746 | 0.327 | |
Number and Operations in Base Ten | 15 | -0.243 | 0.864 | 0.659 | 0.307 | |
Operations and Algebraic Thinking | 15 | 0.093 | 1.005 | 0.580 | 0.212 | |
Performance Task | 6 | 0.710 | 0.698 | 0.841 | 0.292 | |
6 | Expressions and Equations | 16 | 0.286 | 1.060 | 0.731 | 0.199 |
Performance Task | 6 | 1.259 | 0.720 | 0.833 | 0.074 | |
The Number System | 15 | 0.352 | 0.589 | 0.678 | 0.222 | |
7 | Expressions and Equations | 15 | 1.031 | 1.290 | 0.588 | 0.279 |
Geometry | 13 | 1.869 | 0.968 | 0.797 | 0.350 | |
Performance Task | 6 | 1.036 | 0.969 | 0.964 | 0.227 | |
8 | Expressions and Equations I | 14 | 1.260 | 1.561 | 0.508 | 0.212 |
Geometry | 14 | 1.507 | 0.986 | 0.508 | 0.175 | |
Performance Task | 6 | 0.808 | 1.233 | 0.713 | 0.144 | |
11 | Algebra and Functions I | 15 | 1.272 | 1.194 | 0.484 | 0.211 |
Algebra and Functions II | 15 | 2.548 | 1.461 | 0.442 | 0.249 | |
Geometry Congruence | 12 | 2.218 | 1.558 | 0.354 | 0.194 | |
Geometry Measurement and Modeling | 10 | 3.031 | 1.185 | 0.414 | 0.200 | |
Performance Task | 6 | 3.655 | 2.093 | 0.546 | 0.294 |
Grade | Interim Assessment Block Name | N items | Mean b parameter | SD b parameter | Mean a parameter | SD a parameter |
---|---|---|---|---|---|---|
3 | Editing | 15 | -0.470 | 1.213 | 0.668 | 0.250 |
Language and Vocabulary Use | 15 | -0.748 | 0.976 | 0.671 | 0.154 | |
Listen/Interpret | 15 | -0.710 | 0.658 | 0.633 | 0.146 | |
Research: Analyze Information | 10 | -1.019 | 0.437 | 0.609 | 0.195 | |
Research: Interpret and Integrate | 10 | -1.227 | 0.521 | 0.690 | 0.200 | |
Research: Use Evidence | 10 | -0.618 | 0.365 | 0.667 | 0.183 | |
Write and Revise Informational Texts | 10 | -0.767 | 1.288 | 0.626 | 0.124 | |
Write and Revise Narratives | 10 | -0.967 | 0.778 | 0.828 | 0.195 | |
Write and Revise Opinion Texts | 10 | -0.610 | 0.935 | 0.712 | 0.177 | |
4 | Editing | 15 | -0.073 | 1.378 | 0.549 | 0.191 |
Language and Vocabulary Use | 14 | -0.259 | 0.818 | 0.646 | 0.204 | |
Listen/Interpret | 14 | -0.511 | 0.933 | 0.526 | 0.160 | |
Research: Analyze Information | 10 | -0.610 | 0.525 | 0.673 | 0.193 | |
Research: Interpret and Integrate | 12 | -0.740 | 1.054 | 0.701 | 0.128 | |
Research: Use Evidence | 10 | -0.638 | 0.546 | 0.700 | 0.222 | |
Write and Revise Informational Texts | 10 | -0.257 | 0.829 | 0.626 | 0.148 | |
Write and Revise Narratives | 10 | -0.610 | 0.866 | 0.638 | 0.238 | |
Write and Revise Opinion Texts | 11 | -0.268 | 1.210 | 0.605 | 0.122 | |
5 | Editing | 14 | 0.124 | 0.928 | 0.602 | 0.239 |
Language and Vocabulary Use | 15 | 0.440 | 1.140 | 0.627 | 0.240 | |
Listen/Interpret | 14 | -0.039 | 1.017 | 0.568 | 0.142 | |
Research: Analyze Information | 10 | -0.257 | 0.535 | 0.651 | 0.263 | |
Research: Interpret and Integrate | 12 | 0.052 | 0.542 | 0.774 | 0.129 | |
Research: Use Evidence | 10 | -0.416 | 0.606 | 0.658 | 0.228 | |
Write and Revise Informational Texts | 10 | 0.146 | 1.082 | 0.577 | 0.138 | |
Write and Revise Narratives | 10 | 0.007 | 0.849 | 0.716 | 0.151 | |
Write and Revise Opinion Texts | 10 | -0.361 | 0.924 | 0.646 | 0.187 | |
6 | Editing | 14 | 0.639 | 1.694 | 0.559 | 0.197 |
Language and Vocabulary Use | 15 | 0.206 | 1.349 | 0.570 | 0.184 | |
Listen/Interpret | 15 | 0.593 | 0.794 | 0.618 | 0.157 | |
Research: Analyze and Integrate Information | 10 | 1.011 | 0.746 | 0.787 | 0.096 | |
Research: Evaluate Information and Sources | 12 | 0.637 | 0.676 | 0.670 | 0.116 | |
Research: Use Evidence | 10 | 0.552 | 0.503 | 0.689 | 0.235 | |
Write and Revise Explanatory Texts | 10 | 0.454 | 0.998 | 0.709 | 0.188 | |
Write and Revise Narratives | 11 | 0.575 | 0.836 | 0.656 | 0.123 | |
7 | Editing | 13 | 2.451 | 2.502 | 0.346 | 0.167 |
Language and Vocabulary Use | 15 | 1.045 | 1.275 | 0.570 | 0.206 | |
Listen/Interpret | 15 | 0.594 | 1.032 | 0.486 | 0.149 | |
Research: Analyze and Integrate Information | 11 | 0.772 | 0.437 | 0.550 | 0.157 | |
Research: Evaluate Information and Sources | 11 | 0.415 | 1.027 | 0.611 | 0.212 | |
Research: Use Evidence | 10 | 0.461 | 0.999 | 0.722 | 0.159 | |
Write and Revise Argumentative Texts | 10 | 1.274 | 0.822 | 0.634 | 0.136 | |
Write and Revise Explanatory Texts | 11 | 0.967 | 1.011 | 0.680 | 0.079 | |
Write and Revise Narratives | 10 | 0.844 | 0.871 | 0.614 | 0.152 | |
8 | Editing | 14 | 0.541 | 0.842 | 0.626 | 0.099 |
Language and Vocabulary Use | 14 | 0.229 | 0.514 | 0.600 | 0.149 | |
Listen/Interpret | 15 | 0.216 | 1.184 | 0.494 | 0.153 | |
Research: Analyze and Integrate Information | 11 | 0.538 | 0.654 | 0.683 | 0.141 | |
Research: Evaluate Information and Sources | 12 | 0.144 | 0.785 | 0.756 | 0.222 | |
Research: Use Evidence | 10 | 0.779 | 0.763 | 0.728 | 0.217 | |
Write and Revise Explanatory Texts | 12 | 1.309 | 1.093 | 0.665 | 0.165 | |
Write and Revise Narratives | 10 | 0.746 | 0.777 | 0.601 | 0.113 | |
11 | Editing | 15 | 1.376 | 1.231 | 0.431 | 0.125 |
Language and Vocabulary Use | 15 | 0.732 | 1.246 | 0.580 | 0.231 | |
Listen/Interpret | 15 | 0.426 | 1.178 | 0.480 | 0.081 | |
Research: Analyze and Integrate Information | 10 | 0.959 | 0.529 | 0.676 | 0.155 | |
Research: Evaluate Information and Sources | 10 | 1.212 | 1.152 | 0.700 | 0.147 | |
Research: Use Evidence | 12 | 1.184 | 0.779 | 0.646 | 0.089 | |
Write and Revise Argumentative Texts | 11 | 1.062 | 0.665 | 0.556 | 0.119 | |
Write and Revise Narratives | 10 | 0.966 | 0.806 | 0.648 | 0.118 |
Grade | Interim Assessment Block Name | N items | Mean b parameter | SD b parameter | Mean a parameter | SD a parameter |
---|---|---|---|---|---|---|
3 | Four Operations: Interpret, Represent, and Solve | 14 | -1.040 | 0.938 | 0.974 | 0.215 |
Geometry | 12 | -1.166 | 1.440 | 0.505 | 0.175 | |
Linear and Area Measurement | 12 | -0.829 | 0.573 | 0.750 | 0.232 | |
Multiplication and Division: Interpret, Represent, and Solve | 12 | -1.006 | 0.679 | 0.974 | 0.220 | |
Multiply and Divide within 100 | 14 | -1.162 | 0.450 | 1.019 | 0.150 | |
Number and Operations - Fractions | 14 | -1.131 | 0.994 | 0.688 | 0.267 | |
Number and Operations in Base Ten | 14 | -0.817 | 0.913 | 1.052 | 0.165 | |
Properties of Multiplication and Division | 11 | -1.133 | 0.537 | 0.714 | 0.273 | |
Time, Volume, and Mass | 13 | -0.911 | 0.613 | 1.035 | 0.271 | |
4 | Build Fractions from Unit Fractions | 14 | -0.427 | 0.517 | 0.777 | 0.183 |
Factors and Multiples | 11 | -0.682 | 0.528 | 0.765 | 0.184 | |
Four Operations: Interpret, Represent, and Solve | 14 | -0.635 | 0.678 | 1.089 | 0.223 | |
Fraction Equivalence and Ordering | 13 | -0.335 | 0.332 | 1.144 | 0.373 | |
Fractions and Decimal Notation | 13 | -0.262 | 0.597 | 0.752 | 0.208 | |
Generate and Analyze Patterns | 8 | -0.237 | 0.873 | 0.736 | 0.214 | |
Geometry | 11 | 1.090 | 1.417 | 0.578 | 0.297 | |
Multidigit Arithmetic: Place Value and Operations | 12 | -0.559 | 0.509 | 0.774 | 0.238 | |
Place Value and Multidigit Whole Numbers | 13 | -0.306 | 0.354 | 0.721 | 0.174 | |
5 | Add and Subtract with Equivalent Fractions | 15 | -0.055 | 0.349 | 0.830 | 0.332 |
Convert Measurements | 13 | 0.302 | 0.768 | 0.881 | 0.289 | |
Geometry | 13 | 0.029 | 1.473 | 0.438 | 0.140 | |
Numerical Expressions | 14 | 0.192 | 0.849 | 0.633 | 0.124 | |
Operations with Whole Numbers and Decimals | 12 | 0.002 | 0.546 | 0.772 | 0.175 | |
Place Value System | 11 | -0.042 | 0.443 | 0.797 | 0.193 | |
Volume Concepts | 11 | 0.254 | 0.568 | 0.824 | 0.117 | |
6 | Algebraic Expressions | 12 | 0.686 | 0.883 | 0.756 | 0.163 |
Dependent and Independent Variables | 11 | 0.193 | 1.308 | 0.819 | 0.241 | |
Divide Fractions by Fractions | 14 | 0.254 | 0.604 | 0.724 | 0.302 | |
Geometry | 14 | 1.176 | 0.684 | 0.889 | 0.189 | |
Multidigit Numbers, Factors, and Multiples | 14 | 0.422 | 0.486 | 0.686 | 0.168 | |
One-Variable Expressions and Equations | 14 | 0.395 | 0.605 | 0.698 | 0.187 | |
Rational Number System II | 11 | 0.655 | 1.010 | 0.730 | 0.209 | |
Ratios and Proportional Relationships | 13 | 0.075 | 0.877 | 0.851 | 0.192 | |
Statistics and Probability | 13 | 1.368 | 1.579 | 0.434 | 0.186 | |
7 | Algebraic Expressions and Equations | 13 | 0.768 | 0.445 | 0.717 | 0.234 |
Angles, Areas, and Volume | 11 | 1.060 | 0.710 | 0.797 | 0.258 | |
Equivalent Expressions | 10 | 0.628 | 0.691 | 0.762 | 0.238 | |
Geometric Figures | 11 | 1.098 | 0.946 | 0.925 | 0.296 | |
Ratios and Proportional Relationships | 13 | 1.214 | 0.750 | 0.611 | 0.291 | |
Statistics and Probability | 15 | 0.955 | 1.436 | 0.558 | 0.296 | |
The Number System | 14 | 1.000 | 0.978 | 0.603 | 0.233 | |
8 | Analyze and Solve Linear Equations | 12 | 1.189 | 0.377 | 0.710 | 0.189 |
Congruence and Similarity | 12 | 1.032 | 0.789 | 0.550 | 0.103 | |
Expressions and Equations II | 13 | 1.526 | 1.178 | 0.567 | 0.242 | |
Functions | 15 | 0.867 | 1.087 | 0.593 | 0.214 | |
Proportional Relationships, Lines, and Linear Equations | 10 | 1.094 | 0.881 | 0.734 | 0.274 | |
The Number System | 13 | 1.375 | 1.162 | 0.534 | 0.151 | |
Volume of Cylinders, Cones, and Spheres | 10 | 2.323 | 0.457 | 0.735 | 0.134 | |
11 | Create Equations: Linear and Exponential | 12 | 1.421 | 0.603 | 0.665 | 0.205 |
Create Equations: Quadratic | 10 | 2.430 | 1.380 | 0.674 | 0.298 | |
Equations and Reasoning | 11 | 1.189 | 1.052 | 0.766 | 0.375 | |
Geometry and Right Triangle Trigonometry | 15 | 2.011 | 1.053 | 0.623 | 0.214 | |
Interpreting Functions | 14 | 1.648 | 1.533 | 0.560 | 0.300 | |
Number and Quantity | 15 | 1.050 | 1.600 | 0.428 | 0.196 | |
Seeing Structure in Expressions/Polynomial Expressions | 15 | 1.128 | 1.160 | 0.500 | 0.157 | |
Solve Equations and Inequalities: Linear and Exponential | 12 | 1.312 | 0.507 | 0.741 | 0.198 | |
Solve Equations and Inequalities: Quadratic | 10 | 1.604 | 0.555 | 0.738 | 0.409 | |
Statistics and Probability | 12 | 2.359 | 3.434 | 0.348 | 0.159 |
Subject | Grade | N items | Mean b parameter | SD b parameter | Mean a parameter | SD a parameter |
---|---|---|---|---|---|---|
ela | 3 | 40 | -0.857 | 0.735 | 0.721 | 0.227 |
4 | 42 | -0.625 | 0.723 | 0.637 | 0.239 | |
5 | 42 | -0.129 | 0.803 | 0.671 | 0.217 | |
6 | 43 | 0.437 | 0.979 | 0.600 | 0.252 | |
7 | 43 | 0.460 | 0.950 | 0.558 | 0.217 | |
8 | 41 | 0.542 | 0.933 | 0.640 | 0.250 | |
9 | 41 | 0.705 | 0.972 | 0.559 | 0.197 | |
10 | 41 | 0.705 | 0.972 | 0.559 | 0.197 | |
11 | 41 | 0.705 | 0.972 | 0.559 | 0.197 | |
math | 3 | 37 | -1.086 | 0.808 | 0.901 | 0.292 |
4 | 36 | -0.459 | 0.770 | 0.835 | 0.251 | |
5 | 37 | 0.005 | 0.884 | 0.667 | 0.279 | |
6 | 36 | 0.510 | 0.909 | 0.780 | 0.214 | |
7 | 37 | 0.603 | 0.865 | 0.693 | 0.316 | |
8 | 37 | 0.860 | 0.864 | 0.579 | 0.215 | |
9 | 37 | 1.351 | 1.658 | 0.528 | 0.189 | |
10 | 37 | 1.351 | 1.658 | 0.528 | 0.189 | |
11 | 38 | 1.470 | 1.679 | 0.476 | 0.196 |
4.7 Content Alignment
The content alignment studies described in this section were performed using samples of tests delivered in the summative assessments. They are applicable to interim assessments because the interim assessments are created from the same item pool as the summative assessments, and their blueprints use the same content categories (e.g., claims, targets, and DOK) as summative assessments.
Content alignment addresses how well individual test items, test blueprints, and the tests themselves represent the intended construct and support appropriate inferences. With a computer adaptive test, a student’s test form is a sampling of items drawn from a much larger universe of possible items and tasks. The sampling is guided by a blueprint. Alignment studies investigate how well individual tests cover the intended breadth and depth of the underlying content standards. For inferences from test results to be justifiable, the sample of items in each student’s test has to be an adequate representation of the broad domain, providing strong evidence to support claims being made from the test results.
Four alignment studies have been conducted to examine the alignment between Smarter Balanced tests and the CCSS. The Human Resources Research Organization conducted the first alignment study (HumRRO, 2016b). HumRRO’s comprehensive study centered around the assumptions of evidence-centered design (ECD), which examined the connections in the evidentiary chain underlying the development of the Smarter Balanced foundational documents (test blueprints, content specifications, and item/task specifications) and the resulting summative assessments. Among those connections was the alignment between the Smarter Balanced content specifications, the alignment between the Smarter Balanced evidence statements and content specifications, and the alignment between the Smarter Balanced blueprint and the content specifications. Results from this study were favorable in terms of the intended breadth and depth of the alignment for each connection in the evidentiary chain.
In 2016, Doorey & Polikoff (2016) and HumRRO (2016a) investigated the quality of the Smarter Balanced assessments relative to Council of Chief State School Officers (CCSSO) criteria for evaluating high-quality assessments. In particular, the Smarter Balanced assessments were investigated to see if they place strong emphasis on the most important content for college and career readiness, as called for by the CCSS, and if they require that students demonstrate the range of thinking skills called for by those standards.
- Doorey & Polikoff (2016) reviewed grades 5 and 8 ELA and mathematics, and HumRRO (2016a) reviewed high school ELA and mathematics.
- Doorey & Polikoff (2016) rated Smarter Balanced grades 5 and 8 mathematics assessments as a good match to the CCSSO criteria for content, and a good match to the CCSSO criteria for depth.
- HumRRO (2016a) rated the Smarter Balanced high school ELA assessments an excellent match to the CCSSO criteria for content, and a good to excellent match for depth.
- HumRRO (2016a) rated the Smarter Balanced high school mathematics assessments a good to excellent match to the CCSSO criteria for content, and a good to excellent match for depth.
An additional external alignment study, completed by WestEd Standards, Assessment, and Accountability Services Program (2017), employed a modified Webb alignment methodology to examine the summative assessments for grades 3, 4, 6, and 7 using sample test events built using 2015–16 operational data. The WestEd alignment study provided evidence that the items within ELA/literacy and mathematics test events for grades 3, 4, 6, and 7 were well aligned to the CCSS in terms of both content and cognitive complexity.