Single View: Rating

Single View: Rating

Relevant for: Normal observers, lead observers, moderators (see "User roles")
To view the individual results of all candidates, click on the “Details Button” below the consolidated matrix (whether viewing the rating or the ranking) under the values of the candidates.

At the top, you will see the name of the candidate. You can export and save the tables and the graph by clicking on the “Save Icon” on the far right.
This icon is only visible to you if you have been granted permission by the (workspace) administrator to export files from the assessment. Further information on the authorizations of the user roles can be found here.
You can also click on the “Exercise assessments” button to view the observers' assessments of the individual skills and exercises in detail.

At the bottom, you can choose between “Rating,” “Notes,” and “Reports.”


Rating

When you click on “Rating” in the bottom row, you can choose between “Rating” and “Observer Rating” in the consolidated matrix.

Rating

Under “Rating,” you see the consolidated values or the finalized values from the conference for each competency per exercise for a candidate. Here, you will either see the consolidated or finalized numerical values or the consolidated or finalized symbols/characters if this feature has been activated in the administration interface. Additionally, you can view the candidates' self assessment in competencies if this option is enabled in the administration interface (see “Self Assessment”) and the candidates have completed it in the Candidate Portal (see “Questionnaires, Tests & Self Assessment”).
On the left side of this matrix, all competencies observed and evaluated in the exercises are listed individually. In the header, you will see all exercises of the assessment. If you have set up competency clusters in the administration interface, logically related competencies will be categorized by clusters in the matrix.

Additionally, various averages are calculated. 
  1. On the right side, you will see the automatically calculated averages of the consolidated ratings for each competency for the respective candidate. 
  2. In the bottom row, you will see the competency averages of the rating in each exercise. 
  3. Bottom right, the average of all competencies for a candidate across all exercises is calculated. 
  4. If you have set up competency clusters in the administration interface, you will also see the average of the consolidated evaluations of all competencies within a cluster for each exercise in the cluster row.
Here, too, the various values are shown either as numerical values or with the individually set symbols/characters. More information on the alternative scale labels instead of numbers can be found here.

The various values in the table are displayed in different colors. Competency levels that fall within the previously defined target range are shown in green. Competency levels outside the target range are displayed in yellow. An orange color indicates that the competency level of the candidate is more than one scale point outside the target range. The averages of each competency across all exercises and the target profiles are displayed in the same color pattern. Next to the average of the consolidated ratings for each competency, you will see the “Target” column showing your settings for the target profile.
If you have chosen to use symbols or characters instead of numbers for the scale labels, the target profile column will not be displayed here.

In the column on the far right, you have the option to set a final value for each competency of the candidate – both for the numerical scales and the symbols/characters. The column is marked with a “flag” at the top. By default, this column shows the calculated average of the consolidated ratings for each competency. By clicking the “pencil” next to the value, you can adjust the final value. A pop-up window will open where you can make the final consolidation for the competency. Move the slider left to decrease the number and right to increase it. You can set the final value to be between one scale point smaller or larger than the average competency value. If you select a final value that deviates more than half a scale point from the consolidated average, a notice will appear at the bottom of the pop-up indicating a large deviation from the average.
You can adjust the final value in 0.1 steps. As you move the slider, the corresponding value will be displayed in a gray tooltip above it to facilitate setting the value.
If you have chosen scale labels with symbols or characters instead of numbers, you can only set a final value that is one scale point larger or smaller than the consolidated average. No further intermediate steps are possible. For more information about the symbol/character scale labels, see here.
Click “OK” to adopt the set value. Click “Cancel” to abort the process, and the pop-up window will close. Additionally, by clicking “Reset,” you have the option to reset your individual settings. The automatically calculated average will be displayed again in the far-right column, and the pop-up window will close automatically.

Only as a moderator of an assessment can you make the final consolidation in the conference. If you are assigned the role of an observer, you cannot view or make changes to this column in the conference, even if this feature has been activated in the administration interface for this assessment. However, you will see the finalized values in the conference once they have been set by a moderator. More information on activating final consolidation can be found here.

The color coding of the final values for each competency also follows the previously set target profile. The finalized values are displayed in the conference in the consolidated matrix of all candidates. Accordingly, all averages in the conference are calculated based on the final values you set. More information about the conference can be found here.





Additionally, the self assessments of the candidates are shown in the matrix – if you activated this option in the administration interface beforehand. Depending on your setting, you will see two different rows/columns with values in the matrix. These are marked by the “person” and “list” icons, respectively. More information on the different settings for candidate self assessment can be found here.
  1. If the candidates were to assess themselves globally across competencies, i.e., regardless of the exercises, their assessments will be displayed in the far-right column of the consolidated matrix. Here, you see the candidates' self assessment for each competency in the relevant row. (Not yet) submitted values are marked with “N/A.”

  1. If the candidates completed exercise-specific self assessments in the Candidate Portal, you will see the assessments in the competencies for each exercise on the right. Additionally, self assessment per exercise across competencies is displayed in the row below the consolidated matrix. (Not yet) submitted values are marked with “N/A.”


Table cells are grayed out when the exercise is not evaluable for the respective competency based on the previously assigned or set requirements-exercise matrix, meaning the competency is not assessed in the exercise. If a cell is white with the “N/A” label, there are still un-consolidated values for the exercise or competency.

By clicking on an exercise (in the header), you can sort the values and thus the competencies for that exercise in ascending or descending order, allowing you to more easily identify the strengths and weaknesses of individual candidates. You can also do this with the averages.

The table is scrollable sideways.



Observer Rating

Under “Observer Rating,” you see the observers’ ratings for each competency per exercise for a candidate in the consolidated matrix.
On the left side of this matrix, all competencies observed and evaluated in the exercises are listed individually. If you have set up competency clusters in the administration interface, logically related competencies will be categorized by clusters in the matrix. In the header, you will see all exercises of the assessment. In the row below, you will see the initials of the first and last names of the respective observers who have provided the ratings for each exercise. For example, “AA” stands for observer Anna Assessor. If no observer ratings have yet been provided, you will see a corresponding notice instead of the initials of the observers' names.

Additionally, various averages are calculated. 
  1. On the right side, you will see the automatically calculated averages of the observers’ ratings for each competency for the respective candidate across all observers and exercises. 
  2. If you use competency clusters, you will also see the average for the entire cluster. If you have set up competency clusters in the administration interface, you will also see the average of the observers’ ratings for all competencies within a cluster for each exercise and per observer in the cluster row. 
  3. In the bottom row, you will see the competency averages of the rating for each exercise and per observer. 
  4. Bottom right, the average of all competency ratings for a candidate, regardless of exercises and observers, is calculated.
Here, too, the various averages are shown either as numerical values or with the individually set symbols/characters. More information on the alternative scale labels instead of numbers can be found here.

If cells are outlined with a white dashed border, it indicates a deviation of more than 20% of the maximum scale value. On a 5-point scale, a deviation of more than 20% corresponds to more than one scale point. Ratings that differ by more than one scale point will have a white dashed border.

Table cells are grayed out when the exercise is not evaluable for the respective competency, meaning the competency is not assessed in the exercise. If a cell is white with the “N/A” label, the observer has not yet provided a rating for the competency in this exercise.

The table is scrollable sideways.



At the top right, you will see the “Exercise ratings” button, regardless of whether you are in the “Rating” or “Observer Rating” tab. 
Click on it to open a new page on which all competencies are listed. Click on the name of a competency or on the “arrow” on the right to open a detailed view with the individual exercise ratings. Here you will see the average ratings for this competency in the individual exercises for the candidate. In addition, the average value for the competency across all exercises is displayed in the far right column. If the target profile is activated, the color scheme is based on the target profile. 
Below the exercises, you will also see the individual behavioral anchors for this competency, as well as the average rating of the individual behavioral anchors across all observers for this candidate. Click on the behavioral anchor or the “arrow” to view the list of all observers with the respective ratings for the behavioral anchor in a drop-down menu. Click again in the field or on the “arrow” to close the detailed list of individual ratings.
Click on the competency or on the “arrow” on the right to collapse the information again.
Click on the “arrow” at the top left of the candidate's name to return to the page with the consolidated matrix and the competency profile for the candidate.


Competency Profiles

Further down the page under “Competency Profiles,” you can see a graphical representation of the candidate’s performance in the various competencies. Additionally, the previously defined target profiles are shown to quickly compare the candidates’ competency levels with the defined requirements. The candidates' self assessment is shown as a dashed line. This line is only visible if you have activated self assessment for candidates in the administration interface (see “Self Assessment”) and if the candidates have completed it (see “Questionnaires, Tests & Self Assessment”).
At the top, you will see the legend of the chart. In this case, it is the name of the selected candidate, the target profile, and the self assessment. Click on the name to toggle the evaluation profile on or off in the graph. The name will appear in gray when the profile is hidden. You can also view exercise-specific competency profiles. The competency profiles for individual exercises are hidden by default. By clicking on the respective exercise in the legend, you can toggle the profiles on or off.

Export the graphic by clicking on the “Save Icon” in the upper right corner.
This icon is only visible to you if you have been granted permission by the (workspace) administrator to export files from the assessment. Further information on the authorizations of the user roles can be found here.

On the vertical axis, the individual competencies observed in the exercises are shown. Particularly long competencies are abbreviated. Click on the abbreviated competencies to view the full competency names in a tooltip.

On the horizontal axis, the rating scale is displayed. Here, either numerical values are shown or, if you have activated this feature in the administration interface, the individually set symbols/characters.

In the diagram, you will see the profile line and points (consolidated ratings or finalized ratings from the conference) in the candidate-specific color. Additionally, you will see the points and dashed profile line in the candidate-specific color representing the candidates' self assessment in the various competencies. Clicking on individual profile points will show the legend: the full name of the competency and the consolidated value (either from the consolidation or the finalized ratings from the conference) of the candidate in the respective competency, as well as the values of the target profile and the self assessment.

If you use symbols/characters as individual scale labels, this legend will not be displayed when clicking on individual profile points.


estoriginalRemove

    • Related Articles

    • Single view files

      You are on the homepage and you can see the files that are shared with you. Clicking on the preview of the desired file will open it in a single view. Please note that you can only open files that are shared with you. You cannot take a closer look at ...

    • Single View: Reports

      Relevant for: Normal observers, lead observers, moderators (see "User roles") The "Reports" tab in the candidate single view is visible only if you are a moderator of the assessment. When you click on the “Reports” tab in the bottom line, you will ...

    • Single View: Notes

      Relevant for: Normal observers, lead observers, moderators (see "User roles") When you click on "Notes" in the bottom row, you can view the candidate-specific notes. As a moderator, you can optionally view the notes from all observers for different ...

    • How can I view the individual results of the candidates?

      To view the individual results of all candidates, click on the “Details button” below the consolidated matrix (whether viewing the rating or the ranking) under the values of the candidates. At the top, you will see the name of the candidate. At the ...

    • Can I cancel my rating?

      If you have already selected a scale point as a rating for a competency, it is not possible to remove the rating completely. However, you can adjust the rating as you wish and select a different scale point. You can find more information about ...