Test Scoring FAQ

What reports will I receive?

You do not need to request reports. You will receive all available reports electronically that you can locate by clicking on or copying and pasting the link from your e-mail notification. You only need to request reports that you would like to print on paper.

What should I do if I am having problems accessing the reports online?

When you receive the e-mail message that provides you with the report location, the link will be in the third line of the message. You can either click on this link, or copy and paste it into the address bar of your Web browser.

If you are on campus, a list of the report files (.pdf files) and results file (.xls file) should display when the link opens in the browser.

If you are off campus, you must make a connection to the IUP Virtual Private Network (VPN) before accessing the files. See Virtual Private Network (VPN) for instructions on setting up the VPN connection. If you are connected to the VPN, you will be prompted for your username and password. You will likely have to select the option to use another account. For username, enter iupmsd\username, and for the password, enter your network password.

The next question also addresses an issue that may occur with Adobe Reader when trying to open the reports.

I tried to open one of the reports and nothing happened. What should I do?

The reports are in portable document format, or PDF, and require Adobe Reader (or Adobe Acrobat) to view them. Sometimes updates to Adobe products require that you accept the new license agreement the first time you run the program after the update. The dialog box for the license agreement may be in the background. To resolve this, open Adobe Reader (or Adobe Acrobat) from the Start Menu. If the license agreement dialog box appears, accept the license agreement. Then try to open the report again.

When do I need more than one answer key?

Multiple answer keys are needed only when you are scoring an exam with multiple versions that you would like scored as one exam. Each version of the exam must have its own answer key.

What does the formula scoring option do?

Formula scoring is also called penalty scoring, and it penalizes students for guessing. If a student marks an incorrect response, a deduction is made from their overall score. If the student does not respond to a question, no points are added or deducted. If the student answers correctly, one point is added to his score.

What is the subtest option, and when would I use it?

A subtest allows you to evaluate learning objectives on an exam. For example, questions 1 through 10 on your exam deal with mammals, 11-20 deal with reptiles, and 21-40 deal with amphibians. You can use subtests to obtain a score for each learning objective for each student. These scores are only available on the Student Statistics Report. On the individual Student Grade Report, only a total score is provided. They are not included in the results file.

If a weekly exam is given, are my students permitted to re-use their GPAS?

Yes, the students are able to use the same GPAS. The first week they would fill out their name and create a unique ID in the "Student ID Number" grid. Then, if giving a 10-point exam, they would darken in their answers from numbers 1-10. The second week, return their GPAS to them and have them continue to fill in the bubbles, now starting with the numbers 11-20, etc. The trick for the professor, however, is during the first week when you turn in the exams for processing, you would submit one key sheet with only the answers for numbers 1-10 darkened in. The second week you would have to create a completely different key sheet with the answers for numbers 11-20 darkened in.

Which report should I request if I want to give each of my students a copy of their own results, including each question and answer?

This is report 301 Student Grade Report.

How can I use the item analysis reports?

The item analysis reports provide response information about each individual question to evaluate the difficulty of the question. For example, 201 Detailed Item Analysis shows frequencies and percentages for each response, while 204 Condensed Item Analysis uses color-coded bar graphs to show correct and incorrect answers, as well as incorrect responses that were selected more than the correct response. These reports help to identify questions or topics that may have been more difficult for the students.

What is the proper sequence for the forms when I put them into the envelope?

  1. Test Header
  2. Answer Key Sheet (using the GPAS)
  3. All the Student's Answer sheets (GPAS)

Attach the completed Test Scoring Request Form to the outside of the envelope.

I have different versions of an exam (with questions and/or answers in different orders). I would like to submit them all at the same time, in the same envelope. Can I do this?

I created an exam that I have assigned different point values for certain questions. What are the correct steps I need to follow to complete the forms?

Can I include one or more bonus questions on an exam with multiple versions?

Yes, you can include one or more bonus questions on an exam with multiple versions, with these limitations:

  1. The bonus question(s) must be the same question(s) on each version of the exam. For example, if the exam has 52 questions with two bonus questions, the bonus questions should be 51 and 52 on each version of the exam.
  2. The point value for all questions on the exam must be the same. In other words, all questions, including the bonus questions, could be worth two points. On an exam with 52 questions, where two of those are bonus questions, if each question is worth two points, a student with 52 correct responses could get 104 points out of 100.

Can an exam be processed with the test scoring system if it only has bonus questions (to give extra credit)?

No. At least one question on the exam must be scored. This is because percentages are based on number correct divided by the number of possible points. If all questions are bonus questions, the number of possible points is zero, and you can't divide by zero.

How do I eliminate a question from the scoring?

Complete the answer key as you normally would, but do not fill in an answer for the question(s) you wish to eliminate. In the student ID field, enter 1 in the first column, skip the second column, enter the last item number which has a completed answer, and fill in the corresponding bubbles.

Example: If the exam originally had 50 questions and you skip question 6, you will enter "1 50" in the student ID field, but the scores will be based on 49 possible points.

As for the drop-off/pick-up procedures, what do I need to bring or send with someone if I am having another person pick up the results for me?

Where can I obtain the forms needed for the test scoring service?

These forms are available from Central Stores with the exception of the request form. Department secretaries can order these items by entering a reservation into SAP using the following material numbers:

Why can't I edit any of the files in the folder created for my exam?

This is by design. This prevents you from accidentally deleting or modifying the exam data. If you wish to update the results file, you will need to copy it to a secure location where you have write access, and then make the desired changes.

How do I backup the files in the exam results folder?

How long will exam data remain in the exam results folder?

The exam results folder is organized by term, and it will be purged by term as well, on a cycle similar to the project directory. When fall 2012 is about to begin, the Fall 2011 folder will be deleted. When the spring 2013 term is about to begin, the Spring 2012 folder will be deleted. This cycle will allow you to backup files from past semesters even after the grade appeal deadline for a given semester.

Do any of the reports aid in determining the reliability of a question?

The test scoring system uses point biserial and p value statistics to determine question reliability. The point biserial value is shown on Report 207 - Test Item Statistics Report, and it indicates if a question was a good discriminator between the students who did well on the test and the students who did poorly on the test.

Point biserial ranges from -1 to 1. A positive value indicates that the students who did well on the test answered the question correctly (that is desired). .2 is considered a good value.