Individual View: Ratings

Individual View: Ratings

Notes
Relevant for: Normal observers, Lead observers, Moderators (see "User Roles")

To view the individual results of all candidates, click on the "Details" button below the consolidated matrix (whether viewing the rating or the ranking) under the values of the candidates.

At the top, you will see the name of the candidate. You can export and save the tables and the graph by clicking on the "Download Table" and "Download Chart" button on the far right respectively.

InfoThese icons are only visible to you if you have been granted permission by the (workspace) Administrator to export files from the assessment. Further information on the authorizations of the user roles can be found here.

At the bottom, you can choose between "Rating", "Notes", and "Reports".


Rating

If you click "Rating" in the bottom row, you can choose between "Rating" and "Observer Rating" in the consolidated matrix.

Rating

Under "Rating", you see the consolidated values or the finalized values from the conference for each competency per exercise for a candidate. Here, you will either see the consolidated or finalized numerical values or the consolidated or finalized symbols/characters if this feature has been activated in the administration interface. Additionally, you can view the candidates' self assessment in competencies if this option is enabled in the administration interface (see "Self-Assessment") and the candidates have completed it in the Candidate Portal (see "Questionnaires, Tests & Self-Assessment").

On the left side of this matrix, all competencies observed and evaluated in the exercises are listed individually. In the header, you will see all exercises of the assessment. If you have set up competency clusters in the administration interface, logically related competencies will be categorized by clusters in the matrix.

Additionally, various averages are calculated. 
  1. On the right side, you will see the automatically calculated averages of the consolidated ratings for each competency for the respective candidate.
  2. In the bottom row, you will see the competency averages of the rating in each exercise.
  3. Bottom right, the average of all competencies for a candidate across all exercises is calculated.
  4. If you have set up competency clusters in the administration interface, you will also see the average of the consolidated evaluations of all competencies within a cluster for each exercise in the cluster row.
Here, too, the various values are shown either as numerical values or with the individually set symbols/characters. More information on the alternative scale labels instead of numbers can be found here.

The various values in the table are displayed in different colors. Competency levels that fall within the previously defined target range are shown in green. Competency levels outside the target range are displayed in yellow. An orange color indicates that the competency level of the candidate is more than one scale point outside the target range. The averages of each competency across all exercises and the target profiles are displayed in the same color pattern. Next to the average of the consolidated ratings for each competency, you will see the Target column showing your settings for the target profile.

InfoIf you have chosen to use symbols or characters instead of numbers for the scale labels, the target profile column will not be displayed here.

In the column on the far right, you have the option to set a final value for each competency of the candidate, both for the numerical scales and the symbols/characters. The column is marked with a Flag at the top. By default, this column shows the calculated average of the consolidated ratings for each competency. By clicking the Pencil next to the value, you can adjust the final value. A pop-up window will open where you can make the final consolidation for the competency.
Move the slider left to decrease the number and right to increase it. You can set the final value to be between one scale point smaller or larger than the average competency value. If you select a final value that deviates more than half a scale point from the consolidated average, a notice will appear at the bottom of the pop-up indicating a large deviation from the average.
You can adjust the final value in 0.1 steps. As you move the slider, the corresponding value will be displayed in a gray tooltip above it to facilitate setting the value.

If you have chosen scale labels with symbols or characters instead of numbers, you can only set a final value that is one scale point larger or smaller than the consolidated average. No further intermediate steps are possible. For more information about the symbol/character scale labels, see here.

Click "Confirm" to adopt the set value. Click "Cancel" to abort the process, and the pop-up window will close.

InfoOnly as a Moderator of an assessment can you make the final consolidation in the conference. If you are assigned the role of an observer, you cannot view or make changes to this column in the conference, even if this feature has been activated in the administration interface for this assessment. However, you will see the finalized values in the conference once they have been set by a Moderator. More information on activating final consolidation can be found here.

The color coding of the final values for each competency also follows the previously set target profile. The finalized values are displayed in the conference in the consolidated matrix of all candidates. Accordingly, all averages in the conference are calculated based on the final values you set. More information about the conference can be found here.

Additionally, the self-assessments of the candidates are shown in the matrix, if you activated this option in the administration interface beforehand. Depending on your setting, you will see two different rows/columns with values in the matrix. These are marked by the Person and List icons, respectively. More information on the different settings for candidate self-assessment can be found here.
  1. If the candidates were to assess themselves globally across competencies, i. e. regardless of the exercises, their assessments will be displayed in the far-right column of the consolidated matrix. Here, you see the candidates' self-assessment for each competency in the relevant row. (Not yet) submitted values are marked with "N/A". 
  1. If the candidates completed exercise-specific self-assessments in the Candidate Portal, you will see the assessments in the competencies for each exercise on the right. Additionally, self-assessment per exercise across competencies is displayed in the row below the consolidated matrix. (Not yet) submitted values are marked with "N/A". 
Table cells are grayed out when the exercise is not evaluable for the respective competency based on the previously assigned or set requirements-exercise matrix, meaning the competency is not assessed in the exercise. If a cell is white with the "N/A" label, there are still un-consolidated values for the exercise or competency.

By clicking on an exercise (in the header), you can sort the values and thus the competencies for that exercise in ascending or descending order, allowing you to more easily identify the strengths and weaknesses of individual candidates. You can also do this with the averages.

InfoThe table is scrollable sideways.


Observer Rating

Under "Observer Rating", you see the observers’ ratings for each competency per exercise for a candidate in the consolidated matrix.
On the left side of this matrix, all competencies observed and evaluated in the exercises are listed individually. If you have set up competency clusters in the administration interface, logically related competencies will be categorized by clusters in the matrix. In the header, you will see all exercises of the assessment. In the row below, you will see the initials of the first and last names of the respective observers who have provided the ratings for each exercise. For example, "OO" stands for observer Olivia Observer. If no observer ratings have yet been provided, you will see a corresponding notice instead of the initials of the observers' names.

Additionally, various averages are calculated. 
  1. On the right side, you will see the automatically calculated averages of the observers’ ratings for each competency for the respective candidate across all observers and exercises.
  2. If you use competency clusters, you will also see the average for the entire cluster. If you have set up competency clusters in the administration interface, you will also see the average of the observers’ ratings for all competencies within a cluster for each exercise and per observer in the cluster row.
  3. In the bottom row, you will see the competency averages of the rating for each exercise and per observer.
  4. Bottom right, the average of all competency ratings for a candidate, regardless of exercises and observers, is calculated.
Here, too, the various averages are shown either as numerical values or with the individually set symbols/characters. More information on the alternative scale labels instead of numbers can be found here.

If the numbers are outlined with a white dashed line, it indicates a deviation of more than 20 % of the maximum scale value. On a 5-point scale, a deviation of more than 20 % corresponds to more than one scale point. Ratings that differ by more than one scale point will have a white dashed line.

Table cells are grayed out when the exercise is not evaluable for the respective competency, meaning the competency is not assessed in the exercise. If a cell is white with the "N/A" label, the observer has not yet provided a rating for the competency in this exercise.

InfoThe table is scrollable sideways.


Competency Profiles

Further down the page under "Competency Profiles", you can see a graphical representation of the candidate’s ratings in the various competencies. Additionally, the previously defined target profile ist shown to quickly compare the candidates’ competency levels with the defined requirements. The candidates' self-assessment is shown as a dashed line. The ratings for each skill are indicated by diamonds. This line is only visible if you have activated self-assessment for candidates in the administration interface (see "Self-Assessment") and if the candidates have completed it (see "Questionnaires, Tests & Self-Assessment").
At the top, you will see the legend of the chart. In this case, it is the name of the selected candidate, the target profile minimum, the target profile maximum, and the self-assessment. Click on the name to toggle the evaluation profile on or off in the graph. The name will appear crossed out when the profile is hidden.
You can also view exercise-specific competency profiles. The competency profiles for individual exercises are hidden by default. By clicking on the respective exercise in the legend, you can toggle the profiles on or off.

Export the graphic by clicking on "Download Chart" in the upper right corner.

InfoThis icon is only visible to you if you have been granted permission by the (workspace) Administrator to export files from the assessment. Further information on the authorizations of the user roles can be found here.

On the vertical axis, the individual competencies observed in the exercises are shown.
On the horizontal axis, the rating scale is displayed. Here, either numerical values are shown or, if you have activated this feature in the administration interface, the individually set symbols/characters.

In the diagram, you will see the profile line and points (consolidated ratings or finalized ratings from the conference) in the candidate-specific color. Additionally, you will see the points and dashed profile line in the candidate-specific color representing the candidates' self-assessment in the various competencies. Clicking on individual profile points will show the legend: the full name of the competency and the consolidated value (either from the consolidation or the finalized ratings from the conference) of the candidate in the respective competency, as well as the values of the target profile and the self-assessment.

InfoIf you use symbols/characters as individual scale labels, this legend will not be displayed when clicking on individual profile points.

    • Related Articles

    • Single View: Rating

      Relevant for: Normal observers, lead observers, moderators (see "User roles") To view the individual results of all candidates, click on the “Details Button” below the consolidated matrix (whether viewing the rating or the ranking) under the values ...
    • Consolidate: Ratings

      Relevant for: Normal observers, Lead observers, Moderators (see "User Roles") Under "Ratings" you can view your own ratings for each candidate in the respective exercise. These cannot be changed, only viewed. If scale labels have been assigned to ...
    • Individual View: Notes

      Relevant for: Normal observers, Lead observers, Moderators (see "User Roles") When you click on "Notes" in the bottom row, you can view the candidate-specific notes. As a Moderator, you can optionally view the notes from all observers for different ...
    • Individual View: Reports

      Relevant for: Moderators (see "User Roles") The "Reports" tab in the candidate single view is visible only if you are a Moderator of the assessment. If you click on the "Reports" tab in the bottom line, you will see an overview of the report ...
    • How can I view the individual results of the candidates?

      To view the individual results of all candidates, click on the “Details button” below the consolidated matrix (whether viewing the rating or the ranking) under the values of the candidates. At the top, you will see the name of the candidate. At the ...