Ensuring Test Integrity and Security

The following important considerations for testing at Florida State University should be reviewed by all teaching faculty and other instructors.

Test Development

Ensure that your test measures the course objectives and content consistently over time and across students, and determine the level of test security based on the test’s impact on the student’s overall grade.

• Validity. Expert review to ensure test questions are aligned with course objectives and content.
• Reliability. Conduct item analysis and analyze reliability coefficients.

Purpose of the Test

The level of security required during test administration depends on the purpose of the test.

• Low-stakes tests. Generally, low-stakes tests count 20% or less of the final grade and are used to take attendance, encourage continuous studying, check progress, and flag for possible problems. They require less security.
• High-stakes tests. Generally, high-stakes tests count more than 20% of the final grade and are administered at the end of units, mid-term, or as final exams. They require more security.

Use of Resources

Decide whether students should have access to resources based on the purpose of the assessment and the type and amount of information tested.

• Recall of information: Examinees typically do not have access to any resources. Appropriate security measures should ensure that unauthorized resources are not used.
• Application of concepts: Examinees typically have access to limited resources. Appropriate security measures should ensure that unauthorized resources are not used.
• Analysis and discussion: Examinees typically have access to any number of resources. No security measures are necessary to control access to resources.

Time Limits

Set appropriate time limits with the following considerations:

• Average time required to answer questions.
• Reduced time discourages excessive use of materials in non- proctored test administrations. (e.g. low-stakes online quiz)

Test Availability and Locations

Consider when and where students should be tested.

• Synchronous testing. All students are tested at the same time, which minimizes the possibility of sharing information about the test.
• Asynchronous testing. Students test at different times (e.g. when using a testing center), which is more convenient for the student but requires additional measures such as question banks and groups to keep peers from sharing information about the test.
• Seating. Consider using different versions of a test especially if students will be sitting close together.
• Proctoring. Ensure that students’ identities are verified and that they are adequately supervised during the test.

Use of Canvas for Testing

There are many advantages to administering your tests through Canvas.

• Randomization. Enhance test security with randomized test versions drawing from question banks.
• Instant grading. Multiple-choice exams are graded instantly and students can receive feedback about their performance on the test.
• Automatic feedback. Specific feedback can be associated with items and options to help increase learning through quizzes and self-assessments.
• Question banks. When testing asynchronously you can create individualized test versions by using question groups to pull items from question banks.
• Save paper. Online tests require no paper copies.

Online Testing Issues

There are a number of security issues to consider when administering tests online to students in different locations.

• False identity. How can you ascertain the test-taker’s identity?
• Unauthorized collaboration. How can you prevent unauthorized collaboration among online students during testing?
• Using materials. How can you ensure that the students are not referring to materials or resources that are not authorized?
• Copying items. How can you prevent students from copying test items and distributing them to peers?
• One solution is to use a remote proctoring solution for high-stakes tests. Exams are not live-proctored, but you are able to review exam footage after the exam is over. For more information, please visit Honorlock Resources for Instructors.

Levels of Security

The table below distinguishes different levels of test security based on the amount of technology and human measures taken to increase security.

For high-stakes tests, levels 2 or 3 are recommended, depending on whether students will be tested on site or off site.

*Levels 0-1 are unsupervised. Level 2 is supervised off-site. Level 3 is supervised on-site.