Scoring the SP Performance Assessment Part

When evaluating SP performance, in addition to the Inter-Rater Agreement Score, the assessment comes from the SP Performance Assessment (SPPA) section of a Case, to be filled out by Observers.
The SPPA section of the questionnaire asks how the SP performed during a specific learner encounter.


As with agreement scores, a score is calculated for each observation, and then the average score across all observations of the SP is computed.

SP Performance Evaluation Value

The SP Performance Evaluation Value refers to a specific encounter and is calculated in a similar way to the learner scores. Still, in this case, the SP is scored, not the learner:
The SP gets as many points for each section of a certain part of the Case as the answer selected by the observer is worth.
Then, the system calculates the percentage score for each section of this part and obtains the SP Performance Evaluation Value for this observation by taking the weighted average of the section percentage scores using the section weights set in the Case Manager.



ss = section score of an SP for each section of the SPPA part of one particular Case
ws = section weight belonging to each section within the SPPA part of the Case, defined in the Case Manager
n = number of sections in the SPPA part of the Case

SP Performance Evaluation Score

The reported SP Performance Evaluation Score is the average of the SP Performance Evaluation Values, which represent observations of the SP performing the Case in the Activity.



eo = SP Performance Evaluation Value of an SP, for one particular encounter for each observation the SP has for a certain Case
n = number of encounters that have been observed for the SP in the Case


For further information, see the Reports - How to pages and the Reports Module Training Videos.