References

Abedi, J. (2006). Language Issues in Item Development. In S. M. Downing & T. M. Haladyna (Eds.), Handbook of Test Development (pp. 377–398). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.

Abedi, J., & Ewers, N. (2013, February). Accommodations for English Language Learners and Students with Disabilities: A Research-Based Decision Algorithm. Retrieved from https://portal.smarterbalanced.org/library/accommodations-for-english-language-learners-and-students-with-disabilities-a-research-based-decision-algorithm/

Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14, 219–234.

Abedi, J., Lord, C., & Plummer, J. (1995). Language Background as a Variable in NAEP Mathematics Performance (CSE Technical Report 429). Los Angeles: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.

American Institutes for Research. (2013, September). Cognitive Laboratories Technical Report. Los Angeles, CA: Smarter Balanced Assessment Consortium.

American Institutes for Research. (2015). Hawaii Smarter Balanced Assessments 2014–15 Technical Report. Addendum to the Smarter Balanced Technical Report. Submitted to Hawaii Department of Education.

American Institutes for Research. (2017, August). 2017–18 Smarter Balanced Summative CAT Simulation Results. Retrieved from Smarter Balanced website upon approval for posting.

American Institutes for Research. (2018, August). 2018–19 Smarter Balanced Summative CAT Simulation Results. Retrieved from Smarter Balanced website upon approval for posting.

August, D., Carlo, M., Dressler, C., & Snow, C. (2005). The critical role of vocabulary development for English language learners. Learning Disability Research and Practice, 20(1), 50–57.

Bailey, A. L., Huang, B. H., Shin, H W., Farnsworth, T., & Butler, F. A., (2007). Developing Academic English Language Proficiency Prototypes for 5th Grade Reading: Psychometric and Linguistic Profiles of Tasks (CSE Technical Report 727). Los Angeles, CA: University of California, National Center for Research on Evaluation, Standards, and Student Testing.

Bernhardt, E. (2005). Progress and procrastination in second language reading. Annual Review of Applied Linguistics, 25, 133–150.

Bhola, D., Impara, J.C., & Buckendahl, C. (2003). Aligning Tests with States’ Content Standards: Methods and Issues. Educational Measurement: Issues and Practice, 22(3), 21–29.

Birnbaum, A. (1968). Some Latent trait models and their use in inferring an examinee’s ability. In Lord, F. M. and Novick, M. R. Statistical Theories of Mental Test Scores (pp. 395–479). Reading, MA: Addison-Wesley.

Borgioli, G. (2008). Equity for English language learners in mathematics classrooms. Teaching Children Mathematics, 15, 185–191.

Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.

Cizek, G. J., & Bunch, M. B. (2007). Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests. Thousand Oaks, CA: Sage.

Cohen, J., & Albright, L. (2014). Smarter Balanced adaptive item selection algorithm design report. Retrieved from http://www.smarterapp.org/specs/AdaptiveAlgorithm.html

Conley, D. T., Drummond, K. V., de Gonzalez, A., Rooseboom, J., & Stout, O. (2011). Reaching the Goal: The Applicability and Importance of the Common Core State Standards to College and Career Readiness. Eugene, OR: Educational Policy Improvement Center. Retrieved from https://eric.ed.gov/?id=ED537872

Connecticut State Department of Education. (2016, November). Developing Connecticut’s Growth Model for the Smarter Balanced Summative Assessments in English Language Arts (ELA) and Mathematics.

Connecticut State Department of Education. (2017, September). The Relationship Between the Smarter Balanced Grade 8 Assessments and the PSAT 8/9 Assessments.

Cronbach, L. J. (1971). Test validation. In R. L. Thorndike (Ed.), Educational Measurement (2nd ed.). Washington, DC: American Council on Education.

Cummins, D. D., Kintsch, W., Reusser, K., & Weimer, R. (1988). The role of understanding in solving word problems. Cognitive Psychology, 20, 405–438.

Dana, T. M., & Tippins, D. J. (1993). Considering alternative assessment for middle level learners. Middle School Journal, 25, 3–5.

Darling‐Hammond, L., & Pecheone, R. (2010). Developing an Internationally Comparable Balanced Assessment System that Supports High‐Quality Learning. Princeton, NJ: ETS Center for K-12 Assessment and Performance Management.

Doorey, N., & Polikoff, M. (2016, February). Evaluating the Content and Quality of Next Generation Assessments. Washington DC: Thomas B. Fordham Institute. Retrieved from https://eric.ed.gov/?id=ED565742

Dorans, N. J., & Kulick, E. (1983). Assessing Unexpected Differential Item Performance of Female Candidates on SAT and TSWE Forms Administered in December 1977: An Application of the Standardization Approach (Research Report No. RR-83-09). Princeton, NJ: Educational Testing Service.

Dorans, N. J., & Kulick, E. (1986). Demonstrating the utility of the standardization approach to assessing unexpected differential item performance on the Scholastic Aptitude Test. Journal of Educational Measurement, 23, 355–368.

Educational Testing Service. (2014, April). Pilot Test Data Analysis Results: Dimensionality Study and IRT Model Comparison. Princeton, NJ.

Educational Testing Service. (2015a). Study of the Relationship Between the Early Assessment Program and the Smarter Balanced Field Tests. Sacramento, CA: California Department of Education.

Educational Testing Service. (2015b, June). Linking Study Between Smarter Balanced Mathematics Field Test and CSU Entry Level Math test. A Memorandum Prepared for California State University. Princeton, NJ.

Fadel, C., Honey, M., & Pasnik, S. (2007, May). Assessment in the age of innovation. Education Week. May 18, 2007. Retrieved on July 2, 2012, from http://www.edweek.org/ew/articles/2007/05/23/38fadel.h26.html?print=1

Fedorchak, G. (2012). Access By Design—Implications for Equity and Excellence in Education. Draft paper prepared for the Smarter Balanced Assessment Consortium.

Forster, K. I., & Olbrei, I. (1973). Semantic heuristics and syntactic trial. Cognition, 2, 319–347.

Gaffney, T. (2015, October). Dimensionality of the SBAC: An Argument for Its Validity. Presentation for the CAASPP-CAHSEE Technical Advisory Group. California Department of Education.

Hansen, E. G., and Mislevy, R. J. (2008). Design Patterns for Improving Accessibility for Test Takers with Disabilities. ETS Research Report Series, 2008: i–32. DOI: 10.1002/j.2333-8504.2008.tb02135.x

HumRRO. (2016, November). Smarter Balanced Assessment Consortium Alignment Study Report. Retrieved from https://portal.smarterbalanced.org/library/smarter-balanced-assessment-consortium-alignment-study-report/

Kane, M. T. (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527–535.

Kane, M. T. (2006). Validation. In R. L. Brennan (Ed), Educational Measurement (4th ed., pp. 17–64). Washington, DC: American Council on Education/Praeger.

Kopriva, R. (2010, September). Building on student strengths or how to test ELs against challenging math (and science) standards when they don’t have the English yet. Paper presented at the Common Core State Standards Implementation Conference. Arlington, VA.

Kurlaender, M., Kramer, K.A., & Jackson, E.J. (2018, March). Predicting College Success: How Do Different High School Assessments Measure Up? Policy Analysis for California Education. Stanford, CA: Stanford Graduate School of Education.

Lewis, D. M., Mitzel, H. C., Mercado, R. L, & Schulz, E. M. (2012). The bookmark standard setting procedure. In G. J. Cizek (Ed.), Setting Performance Standards: Foundations, Methods, and Innovations. New York, NY: Routledge.

Mantel N., & Haenszel, W. (1959). Statistical aspects of the analysis of data from retrospective studies of disease. Journal of the National Cancer Institute, 22, 719–748.

Mantel, N. (1963). Chi-square tests with one degree of freedom; Extensions of the Mantel-Haenszel procedure. Journal of the American Statistical Association, 58, 690–700.

Martone, A., & Sireci, S. G. (2009). Evaluating alignment between curriculum, assessment, and instruction. Review of Educational Research, 79, 1–76.

Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational Measurement. (3rd ed.) Washington, DC: American Council on Education.

MetaMetrics. (2016a, September). Linking the Smarter Balanced English Language Arts/Literacy Summative Assessment with the Lexile Framework for Reading.

MetaMetrics. (2016b, September). Linking the Smarter Balanced Mathematics Summative Assessment with the Quantile Framework for Mathematics.

Michaelides, M. P. (2008). An illustration of a Mantel-Haenszel procedure to flag misbehaving common items in test equating. Practical Assessment, Research & Evaluation, 13(7).

Mislevy R., & Haertel G., (2006). Implications of Evidence-Centered Design for Educational Testing. Menlo Park, CA: SRI International.

Mislevy, R.J., Steinberg, L.S., & Almond, R.G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3–67.

Muraki, E. (1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.

Muraki, E., & Bock, R. D. (2003). PARSCALE 4.1: IRT-Based Item Analysis and Test Scoring for Rating-Scale Data. Chicago, IL: Scientific Software International, Inc.

National Center for Research on Evaluation, Standards, and Student Testing. (2016, May). External Validity: Analysis of Existing External Measures.

National Center for Research on Evaluation, Standards, and Student Testing. (2018, May). Longitudinal Analysis of SBAC Achievement Data (2015 and 2016). Retrievable from Smarter Balanced website upon approval for posting.

National Governors Association Center for Best Practices & Council of Chief State School Officers. (2016). Development Process. Washington, DC. Retrieved from http://www.corestandards.org/about-the-standards/development-process/

Pitoniak, M., Young, J. W., Martiniello, M., King, T., Buteux, A., & Ginsburgh, M. (2009). Guidelines for the Assessment of English Language Learners. Princeton, NJ: Educational Testing Service.

Rose, D., & Meyer, A. (2000). Universal design for learning, associate editor column. Journal of Special Education Technology, 15(1), 1–12.

Rothman, R, Slattery, J. B., Vranek, J. L., & Resnick, L. B. (2002, May). Benchmarking and Alignment of Standards and Testing. CSE Technical Report. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing.

Russell, M. (2011). Digital Test Delivery: Empowering Accessible Test Design to Increase Test Validity for All Students. Paper prepared for Arabella Advisors.

Schachter, P. (1983). On Syntactic Categories. Bloomington, IN: Indiana University Linguistics Club.

Schmeiser, C. B., & Welch, C. J. (2006). Test Development. In R. L. Brennan (Ed.), Educational Measurement (4th ed., pp. 307–353). Washington, DC: American Council on Education.

Schultz, S. R., Michaels, H. R., Dvorak, R. N., & Wiley, C. R. H. (2016). Evaluating the Content and Quality of Next Generation High School Assessments. Final Report. Alexandria, VA: Human Resources Research Organization.

Shafer W., L., & Rivera, C. (2011). Are EL needs being defined appropriately for the next generation of computer-based tests? AccELLerate, 3(2), 12–14.

Sireci, S. G. (1998). Gathering and analyzing content validity data. Educational Assessment, 5, 299–321.

Sireci, S. G. (2012). Smarter Balanced Assessment Consortium: Comprehensive Research Agenda. Los Angeles, CA: Smarter Balanced Assessment Consortium. Retrieved from http://www.smarterbalanced.org/assessments/development/additional-technical-documentation/

Sireci, S. G. (2013). Agreeing on validity arguments. Journal of Educational Measurement. 50(1), 99–104.

Smarter Balanced Assessment Consortium. (2010, June). Race to the Top Assessment Program Application for New Grants: Comprehensive Assessment Systems. CFDA Number: 84.395B. OMB Control Number 1810-0699.

Smarter Balanced Assessment Consortium. (2012a, April). General Accessibility Guidelines. Retrieved from https://portal.smarterbalanced.org/library/general-accessibility-guidelines/

Smarter Balanced Assessment Consortium. (2012b, April). Guidelines for Accessibility for English Language Learners. Retrieved from https://portal.smarterbalanced.org/library/guidelines-for-accessibility-for-english-language-learners/

Smarter Balanced Assessment Consortium. (2012c). Bias and Sensitivity Guidelines. Retrieved from https://portal.smarterbalanced.org/library/bias-and-sensitivity-guidelines/

Smarter Balanced Assessment Consortium. (2013a, April). Technical Report: Initial Achievement Level Descriptors. Retrieved from https://portal.smarterbalanced.org/library/technical-report-initial-achievement-level-descriptors/

Smarter Balanced Assessment Consortium. (2013b, April). ELA/Literacy ALDs and College Content-Readiness Policy. Retrieved from https://portal.smarterbalanced.org/library/elaliteracy-alds-and-college-content-readiness-policy/

Smarter Balanced Assessment Consortium. (2013c, April). Mathematics ALDs and College Content-Readiness Policy. Retrieved from https://portal.smarterbalanced.org/library/mathematics-alds-and-college-content-readiness-policy/

Smarter Balanced Assessment Consortium. (2014, August). Usability, Accessibility, and Accommodations Implementation Guide (UAAG). Retrieved from https://portal.smarterbalanced.org/library/usability-accessibility-and-accommodations-implementation-guide/

Smarter Balanced Assessment Consortium. (2015a, April). Style Guide. Retrieved from https://portal.smarterbalanced.org/library/style-guide-for-smarter-balanced-assessments/

Smarter Balanced Assessment Consortium. (2015b, June). End of Grant Report. Retrieved from https://portal.smarterbalanced.org/library/end-of-grant-report/

Smarter Balanced Assessment Consortium. (2015c). Item and Task Specifications. Retrieved from http://www.smarterbalanced.org/assessments/development/

Smarter Balanced Assessment Consortium. (2016a, January). 2013-2014 Technical Report. Retrieved from https://portal.smarterbalanced.org/library/2013-14-technical-report/

Smarter Balanced Assessment Consortium. (2016b, April). Administration and Registration Tools (ART) User’s Guide. Version 1.3. Retrieved from https://portal.smarterbalanced.org/library/administration-and-registration-tools-art-user-guide/

Smarter Balanced Assessment Consortium. (2016c, November). Accessibility and Accommodations Framework. Retrieved from https://portal.smarterbalanced.org/library/accessibility-and-accommodations-framework/

Smarter Balanced Assessment Consortium. (2016d, November). Item and Task Specifications Bibliography. Retrieved from https://portal.smarterbalanced.org/library/item-and-task-specifications-bibliography/

Smarter Balanced Assessment Consortium. (2016e, November). Test Administrator User Guide. Version 1.0. Retrieved from https://portal.smarterbalanced.org/library/en/v1.0/test-administrator-user-guide.docx

Smarter Balanced Assessment Consortium. (2016f, November). ELA/Literacy Summative Assessment Blueprint. Version 1. Retrieved from https://portal.smarterbalanced.org/library/elaliteracy-summative-assessment-blueprint/

Smarter Balanced Assessment Consortium. (2016g, November). Mathematics Summative Assessment Blueprint. Version 1. Retrieved from https://portal.smarterbalanced.org/library/mathematics-summative-assessment-blueprint/

Smarter Balanced Assessment Consortium. (2017a, January). English Language Arts/Literacy Content Specifications. Retrieved from https://portal.smarterbalanced.org/library/english-language-artsliteracy-content-specifications/

Smarter Balanced Assessment Consortium. (2017b, January). Mathematics Content Specifications. Retrieved from https://portal.smarterbalanced.org/library/mathematics-content-specifications/

Smarter Balanced Assessment Consortium. (2018c). Usability, Accessibility, and Accommodations Guidelines. Version 3. Retrieved from change log at: https://portal.smarterbalanced.org/library/usability-accessibility-and-accommodations-guidelines/

Smarter Balanced Assessment Consortium. (2017d, June). Enhanced CAT Blueprints for Students Participating in the 2016–17 Embedded Field Test of Performance Tasks. Retrieved from https://portal.smarterbalanced.org/library/enhanced-cat-blueprints-for-students-participating-in-the-2016-17-embedded-field-test-of-performance-tasks/

Smarter Balanced Assessment Consortium. (2017e, July). Achievement Level Setting Final Report. Retrieved from http://www.smarterbalanced.org/assessments/development/additional-technical-documentation/

Smarter Balanced Assessment Consortium. (2017f, July). Interpretation and Use of Scores and Achievement Levels. Retrieved from https://portal.smarterbalanced.org/library/interpretation-and-use-of-scores-and-achievement-levels/ [Available to members only.]

Smarter Balanced Assessment Consortium. (2018g). Member Procedures Manual. Version 3. Retrieved from change log at: https://portal.smarterbalanced.org/library/member-procedures-manual/

Smarter Balanced Assessment Consortium. (2017h, September). Braille Hybrid Adaptive Test (HAT). Retrieved from https://portal.smarterbalanced.org/library/braille-hybrid-adaptive-test/

Smarter Balanced Assessment Consortium. (2017j, November). Estimated Testing Times for Smarter Balanced Summative Assessments. Retrieved from https://portal.smarterbalanced.org/library/estimated-testing-times/

Smarter Balanced Assessment Consortium. (2018a, October). 2018-19 Paper-Pencil Test Administration Manual: ELA Form 4, Non-secure (Primary). Version 1.0. Retrieved from https://portal.smarterbalanced.org/library/p-p-tam-ela-form-3-non-secure/

Smarter Balanced Assessment Consortium. (2018b, November). 2018-19 Paper-Pencil Test Administration Manual: Math Form 4 (Primary). Version 1.0. Retrieved from https://portal.smarterbalanced.org/library/en/p-p-tam-math-form-3.docx

Smarter Balanced Assessment Consortium. (2018c, June). Reporting System User Guide. Version 3.4. Retrieved from https://portal.smarterbalanced.org/library/reporting-system-user-guide/

Smarter Balanced Assessment Consortium. (2018d, September). ELA/Literacy Summative Assessment Blueprint. Version 2.0. Retrieved from https://portal.smarterbalanced.org/library/elaliteracy-summative-assessment-blueprint/

Smarter Balanced Assessment Consortium. (2018e, September). Mathematics Summative Assessment Blueprint. Version 2.0. Retrieved from https://portal.smarterbalanced.org/library/mathematics-summative-assessment-blueprint/

Smarter Balanced Assessment Consortium. (2018f, September). Online Summative Test Administration Manual. Version 3.0. Retrieved from https://portal.smarterbalanced.org/library/en/v3.0/online-summative-test-administration-manual.docx

Smarter Balanced Assessment Consortium. (2019, April). Analysis of Blueprint Fidelity of the 2017–18 Smarter Balanced Summative Assessment. Retrievable from Smarter Balanced website when approved for posting.

Smarter Balanced Assessment Consortium. (2020a). Smarter Balanced Scoring Specifications. Retrieved from https://portal.smarterbalanced.org/library/en/v2.2/smarter-balanced-scoring-specifications.pdf

Smarter Balanced Assessment Consortium. (2020b, May). Analysis of Blueprint Fidelity of the 2018–19 Smarter Balanced Summative Assessment. Retrievable from Smarter Balanced website when approved for posting.

South Dakota Board of Regents. (2017). Revisions to BOR Policy 2:3: System Undergraduate Admissions (Second Reading). Retrieved from https://www.sdbor.edu/the-board/agendaitems/2014AgendaItems/2017%20Agenda%20Items/August1017/6_E_BOR0817.pdf

Thompson, S. J., Johnstone, C. J., & Thurlow, M. L. (2002). Universal Design Applied to Large Scale Assessments. Minneapolis, MN: University of Minnesota, National Center on Educational Outcomes.

Thurlow, M. L., Quenemoen, R. F., & Lazarus, S. S. (2011). Meeting the Needs of Special Education Students: Recommendations for the Race to the Top Consortia and States. Paper prepared for Arabella Advisors.

U.S. Department of Education. (2015, September). Peer Review of State Assessment Systems Non-Regulatory Guidance for States for Meeting Requirements of the Elementary and Secondary Education Act of 1965. Washington, DC.

Washington Office of Superintendent of Public Instruction. (2016). The Relationship between Smarter Balanced Test Scores and Grades in ELA and Mathematics Courses.

WestEd Standards, Assessment, and Accountability Services Program. (December, 2017). Evaluation of the Alignment Between the Common Core State Standards and the Smarter Balanced Assessment Consortium Summative Assessments for Grades 3, 4, 6, and 7 in English Language Arts/Literacy and Mathematics. Retrieved from https://portal.smarterbalanced.org/library/wested-alignment-evaluation/

Young, J. W. (2008, December). Ensuring Valid Content Tests for English Language Learners. R&D Connections, No. 8. Princeton, NJ: Educational Testing Service.

Zhang, T., Haertel, G., Javitz, H., Mislevy, R., Murray, E., & Wasson, J. (2009). A Design Pattern for a Spelling Bee Assessment for Students with Disabilities. Paper presented at the annual conference of the American Psychological Association, Montreal, Canada.