Computer Adaptive Assessment (CAA) is an innovative, online form of assessment in which test items are presented in a sequence that is dependent on the examinees response to the preceding item. Through this process, each examinee is administered a unique set of test items that provides an accurate measure of his or her achievement level.
Castle Rock Research is currently collaborating with the province of Alberta to design, develop, and implement a large-scale on-demand CAA system for use by teachers and students from grades 3 to 12 in all core subject areas. The Alberta CAA system will be designed to provide curriculum-specific formative and summative assessments to students in order to help determine strengths and weaknesses in student learning.
More information about CAA.
If you have PowerPoint, please download a PowerPoint presentation file here.
If you would like to review the BC Formative Assessment system and have been provided a user id and password, please click here. To get a reviewer's user id and password contact Castle Rock Research at 1-866-882-8246.
The Ontario Formative Assessment System is a curriculum-specific online assessment tool that helps determine a students strengths and areas of growth in order to assist in the teaching and learning process. Through the system, educators will have access to a wide range of assessments all aligned to the Ontario curriculum. Advanced reporting functions allow results to be used by teachers to adapt their instructional practices.
Download the PDF for more information.
INTEGRITY is an online application that performs detailed analyses of multiple-choice assessments. The comprehensive, easy-to-use reports generated by INTEGRITY offer unique professional development opportunities to clients striving to create quality assessments for their students. INTEGRITY also provides leading-edge collusion (cheating) detection features allowing clients to investigate the academic INTEGRITY of students taking multiple-choice tests.
INTEGRITY is a secure online application designed to evaluate and improve multiple-choice tests and test items. INTEGRITY uses data files submitted by our clients to provide detailed item-level and test-level statistical information, as well as detailed statistical collusion detection reports. The item and test statistics produced by INTEGRITY are designed to help you evaluate and improve the performance of your tests and test items. The collusion detection reports produced by INTEGRITY are tools designed to help you detect potentially unscrupulous test-taking behavior (e.g., answer copying).
Detailed item level breakdowns are produced with textual summaries of what the statistical information means. Identifying problem items has never been easier and directions on how to improve the items are provided. Graphical, numerical, and textual summaries of the performance of your test questions are provided in a user friendly format.
View the Item Reports sample.
Detailed summaries of the overall test performance are provided with direction on how to use the information to improve assessments. Reports are produced to evaluate the performance of different groups of examinees (e.g., male versus female) on the test. Writing center reports allow for the easy performance comparison of different classes of students. Detailed subscale (curriculum strand) level reports are also produced to help identify what content areas students are struggling with.
View the Test Reports sample.
INTEGRITY utilizes five statistical collusion methods which are reported in a straightforward, easy to interpret manner. Pairs of examinees that have similar response patterns on their tests are flagged graphically as being statistically rare. By scientifically investigating cases of test collusion you will have the information you need to conduct a fair inquiry.
View the Collusion Detection sample.
Computer Adaptive Assessment