Looking at a new assessment? Ask these questions first.

Questions to ask before adopting a computer-based test system
Assessments, like all things, are moving online. While this saves paper and creates possibilities for data and reporting, you are changing one set of problems for another. Before saying yes, make sure your vendor can work with you to answer the following questions.
Strategic
  • How well does this test fit with our district strategy?
  • How well will this help us realize our strategy?
  • How well will this fit with our existing IT infrastructure?
Accounts management
  • How will users be added and deleted?
  • Is it possible to extract user data from the SIS to set up accounts automatically?
  • What is the unique identifier for students within the system?
  • What is the unique identifier for teachers within the system?
  • How will the district manage user accounts?
  • How will teachers manage student accounts? Will they be able to print, access, and reset student passwords?
  • How hard is it to switch students to a different teacher the day of the test?
  • Can teacher/administrative users be associated with multiple schools within the assessment system?
  • What is the process for managing accommodations? Who can enter and manage students’ test accommodations? How many users per school will be able to do this?
IT Infrastructure
  • Is a secure browser available?
  • If no secure browser is available, which browser versions are supported?
  • When and how are regular system updates scheduled?
  • How are users notified of system downtime?
  • How do students begin a test session? Will they be able to switch computers mid-test?
  • For a recording component, how will teachers be trained to troubleshoot microphones?
  • Will schools need to purchase more computers to accommodate this test?
Interface
  • Does the teacher interface display the same way in all major browsers?
  • How will students be accommodated? Is there a built-in screen reader? Adjustable contrast and font size? Volume control?
  • If there is an audio component, will students be able to adjust volume during the test?
  • If there is a recording component, is there a scrubber so students can replay and re-record?
  • What tools will students be able to use within the interface? Highlighting? Flagging? Note-taking? Reference sheets? Calculators?
Data
  • What is the objective for this data?
  • Get we get large-scale data extracts or dumps? In what formats?
  • How will teachers access test results? District administrators? Students? Parents?
  • How soon the test results be ready?
  • Once the test results are ready, what is the plan or strategy for reporting on them or making use of them?
  • What user roles are available and what access to data does each role have?
Implementation and Training
  • How will employees be trained on this system? How many training opportunities before a live session?
  • What opportunities will students have to interact with this system before a live testing session?
  • How accessible is the Test Administration Manual to teachers?
  • Are user tutorials available within the system?
Cost
  • What is the cost per student? Per administration window?
  • What is the cost of related equipment: headphones, microphones, etc?
  • What is the cost of training and professional development?

Leave a Reply