National Assessment Program : ICT literacy 2011 : Year 6 and Year 10 : technical report
This report describes the technical aspects of the National Assessment Program – ICT Literacy (NAP – ICTL) 2011 sample assessment and summarises the main activities involved in the data collection, the data collection instruments and the analysis and reporting of the data. Chapter 2 summarises the development of the assessment domain and describes the process of item development and construction of the instruments. Chapter 3 reviews the sample design and describes the sampling process. It also describes the weighting procedures that were implemented to derive population estimates and calculation of participation rates. Chapter 4 summarises the field administration of the assessment. Chapter 5 deals with management procedures, including quality control and the cleaning and coding of the data. Chapter 6 describes the scaling model and procedures, item calibration, the creation of plausible values and the standardisation of student scores. It discusses the procedures used for vertical (Year 6 to Year 10) and horizontal (2011 to 2008 and 2005) equating with procedures for estimating equating errors. Chapter 7 outlines the proficiency levels and standards. Chapter 8 discusses the reporting of student results, including the procedures used to estimate sampling and measurement variance and the reporting of statistics for, and comparisons among, jurisdictions and designated groups of students over time.
Gebhardt, E., Fraillon, J., Schulz, W., O'Malley, K., Freeman, C., Murphy, M., & Ainley, J. (2012). National Assessment Program : ICT literacy 2011 : Year 6 and Year 10 : technical report. https://research.acer.edu.au/ict_literacy/4