- - - - - - - - - - - - - - - - - - - - - -
  Academic Policy & Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     2012 HSA and Mod-HSA Technical Report
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Science Technical Reports
     MSA Technical Reports
     Staff and Student Publications
     State Test Administration and Security Committee Fact Sheet
  Career and College Readiness
  Communications, Partnerships, and Grants
  Curriculum, Assessment & Accountability
  Educator Effectiveness
  Early Childhood Development
  Information Technology
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions > Accountability, Assessment, and Data Systems
2010 MSA Science Technical Report

Maryland School Assessment (MSA)
Grades 5 and 8

Technical Report: 2010 Administration


Test Overview and Design



Test Overview

Purpose and Use

Test Content, Specifications and Design

MSA Science Item Types

MSA Science Test Blueprints
Table 1. Grade 5 MSA Science Standards Assessed
Table 2. Grade 8 MSA Science Standards Assessed

MSA Science 2010 Operational Test Construction

MSA Science 2010 Field Test Design
Table 3. 2010 MSA Science Test Form Design

Item Development and Review

Operational Item Analysis and Equating

Testing Population
Table 4. Demographic Characteristics of Grade 5 and Grade 8 Sample for Overall, Online, and Paper

Distribution of Students Across Forms
Table 5. Distribution of Forms by Grade

Key Check Analysis of Operational Test Data


Classical Item Analysis

IRT Calibration

Table 6. Operational Transformation Constants

Test Analysis, Operational Scaling and Scoring

Test Analysis

Defining Scale Ranges
Table 7. Target LOSS, HOSS, and Scaling Constants for Grades 5 and 8

ISE Pattern Scoring

Conditional Standard Errors for LOSS and HOSS

Test Score Reliability
Table 8. Reliability Estimate by Grade, Form, Gender and Ethnicity

Student Performance

Score Interpretation

Scale Scores

Performance Levels and Descriptions
Table 9. Scale Score Cut Scores for Grades 5 and 8 MSA Science
Table 10. Grades 5 Performance Level Percentages and Summary Statistics

Table 11. Grades 8 Performance Level Percentages and Summary Statistics

Field Test Item Analysis and Calibration

Key Check Analysis of Field Test Data

Classical Item Analysis

Field Test Calibration
Table 12. Field Test Transformation Constants

Differential Item Functioning (DIF) Analysis
Table 13. DIF Flag Summaries from all MSA Science Field Test Items

Data Review of the Field Test Items

Results of Data Review


Content-Related Evidence

Differential Item Functioning (DIF)
Table 14. Summary of Adjusted Point-Biserial Correlations

Inter-Correlations Among Standards
Table 15. Correlation Among MSA Science Content Standards

Confirmatory Factor Analysis
Table 16. Fit Indicators for Confirmatory Factor Analysis on MSA Science

Evidence for Scores From Accommodated Testing
Table 17. Fit Indicators for Accommodations/Non-Accommodations Based CFA



Appendix A Classical Item Statistics: Operational Forms
Appendix B Classical Item Statistics: Field Test Items

A complete copy of the 2010 MSA Science Technical Report is also available.

Contact Information
Carolyn Wood, Assistant State Superintendent
Division of Accountability, Assessment, and Data Systems
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE