- - - - - - - - - - - - - - - - - - - - - -
 Divisions
  Overview
  Academic Policy
  Academic Reform and Innovation
  Accountability, Assessment, and Data Systems
     2003-2004 Alternate Maryland School Assessment
     HSA Technical Reports
     Maryland Standard Setting Technical Reports
     Modified HSA Technical Reports
     MSA Technical Reports
     Overview
     Staff and Student Publications
  Career and College Readiness
  Certification and Accreditation
  Deputy Superintendent for Administration
  Early Childhood Development
  Finance
  Information Technology
  Instruction
  Library Services
  Office of the State Superintendent
  Rehabilitation Services
  Special Education and Early Intervention
  Student, Family, and School Support
Divisions
Divisions > Accountability, Assessment, and Data Systems > Docs > msa
2003 MSA Reading Technical Report

Maryland School Assessment
Reading
Grades 3, 5, and 8

Technical Report: 2003 Administration



TABLE OF CONTENTS

ACKNOWLEDGEMENTS

INTRODUCTION

1. Overview of the 2003 Maryland School Assessment-Reading


1.1
Overview of the 2003 MSA-Reading



Figure 1.1 Schematic of the 2003 MSA-Reading



Table 1.1 The 2003 MSA-Reading Field Test Design: Grades 3, 5, and 8

1.2
Purposes/Uses of the 2003 MSA-Reading

1.3
The Voluntary State Curriculum

1.4
Development and Review of the 2003 MSA-Reading



Table 1.2 The 2003 MSA-Reading Responsibility for the Test Development

1.5
Structure of the 2003 MSA-Reading

1.6
Test Administration



Table 1.3 The 2003 MSA-Reading Timing Sessions: Grades 3, 5, and 8

1.7
Scoring Procedures

1.8
Item Selection for Scoring Purposes



Table 1.4 The 2003 MSA-Reading Descriptive Statistics for Each Field Test Form (Common Items)

1.9
Linking, Equating, and Scaling Procedures



Figure 1.2 Example of Parameters Used to Link Items



Figure 1.3 True Score Equating

1.10
Standard Setting

1.11
Score Interpretation

1.12
Test Validity



Table 1.5 The 2003 MSA-Reading Eigenvalues between the First and the Second Components
1.13
Item Bank Construction

2. Current Results of the 2003 MSA-Reading




Table 2.1 The 2003 MSA-Reading Cut Scores: Grades 3, 5, and 8



Table 2.2 The 2003 MSA-Reading Pass Rates: Grades 3, 5, and 8

3. Overview of Statistical Summaries


3.1
Classical Descriptive Statistics

3.2
Scale Score Descriptive Statistics

3.3
Classical and IRT Item Parameters



Table 3.1 Criteria to Evaluate Mean-Square Fit Statistics

3.4
Inter-Rater Reliability

3.5
Correlations Among Reading Processes

3.6
Decision Accuracy and Consistency at the Cut Scores

3.7
Differential item Functioning



Table 3.2 2 x T Contigency Table at the kth Level



Table 3.3 DIF Classification for BCR Items



Table 3.4 DIF Classification for SR Items

3.8
Equating and Scaling



Figure 3.1 Item Characteristic Curve



Figure 3.2 Category Response Curves for a One-Step Item



Figure 3.3 Category Response Curves for a Two-Step Item

4. The 2003 MSA-Reading Statistical Summary




Table 4.1 The 2003 MSA-Reading Classical Descriptive Statistics: Grades 3, 5, and 8



Table 4.2 The 2003 MSA-Reading Scale Score Discriptive Statistics: Grades 3, 5, and 8



Table 4.3 The 2003 MSA-Reading Strand Correlations: Grade 3



Table 4.4 The 2003 MSA-Reading Strand Correlations: Grade 5



Table 4.5 The 2003 MSA-Reading Strand Correlations: Grade 8



Table 4.6 The 2003 MSA-Reading Decision Accuracy and Consistency Indices: Grade 3



Table 4.7 The 2003 MSA-Reading Decision Accuracy and Consistency Indices: Grade 5



Table 4.8 The 2003 MSA-Reading Decision Accuracy and Consistency Indices: Grade 8



Table 4.9 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 1



Table 4.10 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 2



Table 4.11 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 3



Table 4.12 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 4



Table 4.13 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 5



Table 4.14 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 6



Table 4.15 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 3 Form 7



Table 4.16 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 1



Table 4.17 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 2



Table 4.18 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 3



Table 4.19 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 4



Table 4.20 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 5



Table 4.21 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 6



Table 4.22 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 5 Form 7



Table 4.23 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 1



Table 4.24 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 2



Table 4.25 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 3



Table 4.26 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 4



Table 4.27 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 5



Table 4.28 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 6



Table 4.29 The 2003 MSA-Reading Raw Score to Scale Score Conversion Table: Grade 8 Form 7



Table 4.30 The 2003 MSA-Reading Score Difference between Rater 1 and Rater 2: Grade 3



Table 4.31 The 2003 MSA-Reading Score Difference between Rater 1 and Rater 2: Grade 5



Table 4.32 The 2003 MSA-Reading Score Difference between Rater 1 and Rater 2: Grade 8

REFERENCES

APPENDICES

A. The 2003 MSA-Reading Scale Score Histograms
B. The 2003 MSA-Reading Classical and IRT Item Parameters



Table B.1 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 1



Table B.2 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 2



Table B.3 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 3



Table B.4 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 4



Table B.5 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 5



Table B.6 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 6



Table B.7 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 3 Form 7



Table B.8 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 1



Table B.9 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 2



Table B.10 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 3



Table B.11 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 4



Table B.12 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 5



Table B.13 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 6



Table B.14 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 5 Form 7



Table B.15 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 1



Table B.16 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 2



Table B.17 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 3



Table B.18 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 4



Table B.19 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 5



Table B.20 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 6



Table B.21 The 2003 MSA-Reading Classical and IRT Item Parameters: Grade 8 Form 7
C. The 2003 MSA-Reading Blueprints



Table C.1 The 2003 MSA-Reading Blueprint: Grade 3



Table C.2 The 2003 MSA-Reading Blueprint: Grade 5



Table C.3 The 2003 MSA-Reading Blueprint: Grade 8


A complete copy of the 2003 Maryland School Assessment - Reading: Grades 3, 5, 8 Technical Report is also available.

Contact Information
Leslie Wilson, Assistant State Superintendent

Division of Accountability and Assessment
Maryland State Department of Education

200 West Baltimore Street
Baltimore, MD 21201
Maryland State Department of Education
200 West Baltimore Street
Baltimore, MD 21201
MSDE Privacy Statement Disclaimer  | Copyright © 2003 MSDE