Consolidate

Consolidate

Notes
Relevant for: Regular Observers, Lead Observers, Moderators (see “User Roles”)

Under "Consolidate" (on the left side of the screen), the ratings of the various observers can be viewed and consolidated into overall ratings.

On the “Consolidate” page, you’ll see a message at the top (“Automatic consolidation is enabled. Disable consolidation to consolidate manually”) if automatic consolidation is enabled for an assessment (see “Features”). You can also click “Use Average Ratings” below to average the ratings submitted by observers into consolidated scores (for lead observers and moderators only).  

Click "Refresh Consolidation" to synchronize or refresh the page.

On this page, you will also find the "Competencies" assessed in the respective exercise, the corresponding scales or sliders for the "Consolidated Values", and under "Consolidated", a box with either the consolidated value as a number/symbol or a question mark if the exercise has not yet been consolidated.

InfoFor scales with numeric labels, you can set the consolidated value in 0.25 increments.

InfoHere, you will see either the scale labels with numbers or - if you have previously enabled this option in the administration interface - the custom scale labels with symbols/characters. You can also consolidate these. To select the consolidated value, you can choose from all scale points with their assigned symbolic labels. However, values in between cannot be selected as consolidated values. Further information can be found here.

Click "Finalize Consolidation" to complete the consolidation. The slider will then be displayed in grey, and the boxes with the consolidated value next to them will be filled with a checkmark.

Below that, in the "Status of ratings" section, you'll see an overview of which observers have submitted ratings and how many they've submitted. The yellow "exclamation mark" indicates that not all observers have submitted their ratings yet. If you see a green checkmark there, it means that all observers have submitted their ratings. 

Alert[Screenshot Consolidate Landscape]

Depending on the observer role(s) assigned to you, you can use different functions of the observer interface (see "User roles in the observer interface"). The differences between roles are most significant during consolidation, so they are explained individually below.

Normal Observer

If you are a normal observer (not a lead observer or moderator), you can initially only see your own ratings during consolidation (on all pages).

Once the lead observer has entered consolidated values into the observer interface and synchronized the rating, you can also see these values on the scale. To do this, click "Refresh Consolidation" at the top. However, you still cannot see the ratings of other observers.

Under "Status of ratings," you can only see the status of your own rating and not the status of other observers.

Alert[Screenshot Consolidate & Profile Consolidated Landscape]

Silent Observer

If you are a silent observer, you cannot initially see any ratings during consolidation.

Once the lead observer has entered consolidated values into the observer interface and synchronized the rating, you can see these values on the scale. To do this, click "Refresh Consolidation" at the top. However, you cannot see the ratings of other observers at any time.

Under "Status of ratings" you will see your own name and a greyed-out circle in the status display, as you cannot submit ratings yourself. You cannot view the rating status of other observers.

Alert[Screenshot Consolidate & Profile Consolidated Landscape]

Lead Observer & Moderator

If you are a lead observer (only possible with the Scheduler activated) or moderator, you can see both your own ratings and the ratings of all observers during the consolidation of the respective exercise and consolidate these values. Depending on the set scale labels, you will consolidate for numeric values or alternatively for custom symbolic/character labels.
Moderators can do this across exercises and candidates, while lead observers can only do this for the exercise(s) and candidate(s) they have been assigned to.

In general: For lead observers or moderators to correctly consolidate individual exercises, all observers should have submitted and synchronized their ratings and notes made during the assessment. If not all observers have submitted their ratings, an "Exclamation Mark" will appear next to "Status of ratings". If you see a green checkmark there, all observers have submitted their ratings. You can update the status of ratings at any time by clicking "Update".

  • For competencies that have not yet been consolidated, the slider under "Consolidated Value" will appear in the assessment-specific color, and under "Consolidated," a grey box will appear next to either a question mark or a consolidation value as a number/symbol.

    InfoOn the "Profile" page, the values are displayed with grey circles.

  • For competencies that have already been consolidated, the slider under "Consolidated Value" will appear in green, under "Consolidated" a green check-marked box will appear, and next to it the consolidated value as a number/symbol.

    InfoOn the "Profile" page, they are displayed with green circles.

Alert[Screenshot Consolidate Landscape - both]

If competencies are not yet consolidated, you have three options to set the consolidated value:

  • Click on "Use Average Ratings" at the top to calculate the average of your observers' ratings. The values can still be manually adjusted afterward.

  • Alternatively, you can use the "Slider" under "Consolidated Value" to set any value. This will then appear as a number/symbol under "Consolidated".

    Info
    For scales with numeric labels, you can set the consolidated value in 0.25 increments. If you have activated the symbolic scale labels in the administration interface, you can choose a scale point with the desired expression during consolidation, but you cannot set intermediate values as consolidated values.

  • If the "automatic consolidation" feature has been enabled (see "Features"), you will see the note "Results are consolidated automatically" at the top, and consolidated values will be automatically set. These values can, of course, still be individually adjusted.

InfoIf you want to make changes, click the box next to the corresponding competency so that it turns grey. You can now move the slider again. To fix the values, proceed as described above.

Once you have agreed on a value for a specific competency, you have two options to finalize the consolidated values:

  • Click the checkbox for the relevant competency.

  • Alternatively, you can click "Finalize Consolidation" to immediately lock in all the consolidation values you have agreed upon for the competencies.

    Once the consolidation has been finalized, the checkbox is highlighted in color and checked. The slider turns gray and can no longer be moved. 

InfoOnce an assessment is completed, the slider and consolidated values will be displayed in grey and can no longer be changed.

Alert[Screenshot Consolidate Landscape - fully consolidated]


    • Related Articles

    • Consolidate: Overview

      Relevant for: Normal observers, lead observers, moderators (see "User roles") In the assessment overview within the schedule, click "Consolidate" on an exercise, and a new page will open. If the assessment is still in draft status, you cannot ...
    • Consolidate: Profile

      Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Profile," the rating profiles of the individual observers as well as the consolidated rating profile can be displayed graphically. At the same time, you can also ...
    • Consolidate: Finalize values

      Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Consolidate" (on the left side of the screen), the ratings of the various observers can be viewed and consolidated into overall ratings. In the web-based observer ...
    • Consolidate: Results

      Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Assess. Results" you can view your own ratings for each candidate in the respective exercise. These cannot be changed, only viewed. If scale labels have been ...
    • Consolidate: Notes

      Relevant for: Regular Observers, Lead Observers, Moderators (see “User Roles”) Under "Notes," you can view your own notes (handwritten notes, text notes, and competency notes) for each candidate in the respective exercise. You also have the option to ...