Skip to ContentSkip to Navigation
University of Groningenfounded in 1614  -  top 100 university
EDU Support Blackboard Instructor Assignments, Assessments & Exams Step 4: After the exam Exam analysis

Exam analysis

For exams containing MC questions there is the option to create analyses to provide you with insights into the validity and reliability of individual questions. The exam analysis tool provides you with an overview of statistics on test performance, overall and per question. It contains detailed information per question and can help you to possibly improve questions. This can either be repairs to the current exam or when you intend to reuse questions for future exams.

How to get your exam analysis

Under certain conditions we always perform an exam analysis of MC questions. These conditions are:

  • At least 25 students took the MC questions

  • The MC questions were not presented through question sets where only a selection of all questions in the set was presented to students

  • Exam took place in an exam course supported by Team Assessment Support

If your exam does not meet these requirements then we will not automatically create an exam analysis. In case you would still like to receive one please contact your exam facilitator through the exam management.


Where can you find the analysis

When an analysis has been performed it will be placed in the exam course. In the menu look for the Analysis item. 


What is in the analysis

The exam analysis contains multiple sections. We will discuss them briefly here. Note that the exam analysis contains a detailed explanation of all the items.

When you see an item with a small question mark icon next to an item in the analysis you can hover over it with your mouse for an explanation pop up to show up.

And below each section is a clickable Explanation or Readers guide.

Results of the Analysis

Provides an overview of the entire exam. This includes:

  • General information (number of questions and alternatives, number of students)

  • Score indications(Highest score, scores at cut off rates)

  • Statistical data (mean score, p-value)

This can give you a quick impression of how well the exam was made and an indication of reliability and validity.

Frequency distribution of scores

This provides a list of all the scores that could be obtained by students, it indicates how many students achieved a certain score. It also indicates what the score percentage and real knowledge rate(adjusted for guessing) are for that score.

Note: This overview works best if students can get 1 or 2 points per question, otherwise you will have large gaps between obtained scores.


The item analysis provides statistical data per question and given answers expressed in percentages. The percentage marked in bold is the correct answer option. Click on a question for more detailed information about the question, including the text of the question and answer options.

You can use this information per question to spot potentially suspicious questions that you need to investigate further. Questions can be classified based on:

  • Difficulty: A question marked as difficult is one that most students did not answer correctly 

  • Discrimination: how well the item predicts overall performance on the test. A non discriminating item does not differentiate between stronger and weaker students.

For a more detailed classification switch to the Graphical view.

Also note the given answers: If an answer option was never chosen, you may consider using less or better alternatives in the next exam.

We also advise that you look at the data critically. It could for example be that two answer options of a question were selected equally. Further investigation may be necessary to check if both options could be correct. 

You can switch between the Graphical View and the Data view depending on your preference.


Chart of difficulty versus item-test correlation (RIT)

The Chart of difficulty versus item-test correlation (RIT) section contains a graph to visualize the data that is presented in the Item Analysis section. Color coding is used to provide you with a quick overview: 

  • Blue = Easy questions

  • Purple = Difficult questions

  • Grey = Not discriminating questions

  • Overlap grey and purple = suspicious question

  • White = No irregularities – “Good question” 

Questions are presented as a dot with the question number next to it. Hover your mouse over the dot to see the question text.


Adjustments to the exam results and analysis

After inspecting the exam analysis, the questions and answer options, you may conclude that the answer key to a question was implemented incorrectly. Or that multiple answers of a multiple choice question are correct. Or perhaps a question needs to be removed. In such a case we can reanalyze the exam for you, implementing adjustments. Doing this we will also provide you with a new score column in the Grade Center of the exam course.

Note: A reanalysis of a test does not change the contents of the test. It does not change the original answer keys and scores. So during a review of the test students will not see the implemented adjustments of the reanalysis.

Grading

If an exam analysis has been performed for your exam, there is also the option that we run the grading for your exam. In this case let the facilitator know that you would like him/her to run the grading and which cut off point or knowledge percentage should be applied. This can be either a score (e.g. 21 points) or a knowledge rate (e.g. 55%). Also indicate whether you prefer 1 decimal or 2 decimals or none.

The grade is calculated using the following formula:

  • Grade at or above the cut-off point = 5,5 + ((score – cut-off point) * (4,5/ (max – cut- off point)))
    Grade below the cut-off point = 1 + 4,5 * (score - guessing score) / (cut-off point - guessing score)


Whom to contact? 

For further information about exams and the help we can provide, please email our team at digitaaltoetsen@rug.nl


Last modified: 19 November 04:29 PM
In need of immediate support? 050 - 363 82 82
Follow Nestorsupportfacebook twitter youtube