Consolidate: Finalize Consolidation
Relevant for: Normal observers, Lead observers, Moderators (see "User Roles")
Under "Profile" on the right side of the screen, you can view the ratings from the various observers, and on the left side of the screen, under "Consolidate", you can consolidate them into overall ratings.
On the "Consolidate" page, you’ll see a message at the top ("Automatic consolidation is enabled. Remove the consolidation to manually consolidate."), if automatic consolidation is enabled for an assessment (see "Features"). You can also click "Use Average Rating" below to average the ratings submitted by observers into consolidated scores (for Lead observers and Moderators only).
Click "Refresh" to synchronize or refresh the page.
On this page, you will also find the "Competencies" assessed in the respective exercise, the corresponding scales or sliders for the "Consolidated Values", and under "Consolidate", a box with either the consolidated value as a number/symbol or a question mark if the exercise has not yet been consolidated.
For scales with numeric labels, you can set the consolidated value in 0.25 increments.Here, you will see either the scale labels with numbers or - if you have previously enabled this option in the administration interface - the custom scale labels with symbols/characters. You can also consolidate these. To select the consolidated value, you can choose from all scale points with their assigned symbolic labels. However, values in between cannot be selected as consolidated values. Further information can be found here.Click "Finalize Consolidation" to complete the consolidation. The slider will then be displayed in grey, and the boxes with the consolidated value next to them will be filled with a checkmark.
Below that, in the "Status of Ratings" section, you'll see an overview of which observers have submitted ratings and how many they've submitted. The yellow "Exclamation Mark" indicates that not all observers have submitted their ratings yet. If you see a green checkmark there, it means that all observers have submitted their ratings.
Normal observer
Relevant for: Normal observers (see "User Roles")If you are a Normal observer (not a Lead observer or Moderator), you can initially only see your own ratings during consolidation (on all pages).
Once the Lead observer has entered consolidated values into the observer interface and synchronized the rating, you can also see these values on the scale. To do this, click "Refresh" at the top. However, you still cannot see the ratings of other observers.
Under "Status of Ratings," you can only see the status of your own rating and not the status of other observers.
Silent observer
Relevant for: Silent observers (see "User Roles")
If you are a Silent observer, you cannot initially see any ratings during consolidation.
Once the Lead observer has entered consolidated values into the observer interface and synchronized the rating, you can see these values on the scale. To do this, click "Refresh" at the top. However, you cannot see the ratings of other observers at any time.
Under "Status of Ratings" you will see your own name and a grayed out circle in the status display, as you cannot submit ratings yourself. You cannot view the rating status of other observers.
Lead observer & Moderator
Relevant for: Lead observers, Moderator (see "User Roles")If you are a Lead observer (only possible with the Scheduler activated) or Moderator, you can see both your own ratings and the ratings of all observers during the consolidation of the respective exercise and consolidate these values. Depending on the set scale labels, you will consolidate for numeric values or alternatively for custom symbolic/character labels.
Moderators can do this across exercises and candidates, while Lead observers can only do this for the exercise(s) and candidate(s) they have been assigned to.
Moderators can do this across exercises and candidates, while Lead observers can only do this for the exercise(s) and candidate(s) they have been assigned to.
In general: For Lead observers or Moderators to correctly consolidate individual exercises, all observers should have submitted and synchronized their ratings and notes made during the assessment. If not all observers have submitted their ratings, an "Exclamation Mark" will appear next to "Status of Ratings". If you see a green checkmark there, all observers have submitted their ratings.
- For competencies that have not yet been consolidated, the slider under "Consolidate" will appear in the assessment-specific color, accompanied on the right by a gray box containing either a consolidation value (as a number or symbol) or an empty field.
On the "Profile" page, the values are displayed with gray circles.
- For competencies that have already been consolidated, the slider appears grayed out; under "Consolidate", the consolidation value is displayed as a number or symbol, and next to it is a colored, checked box.
On the "Profile" page, they are displayed with green circles.
If competencies are not yet consolidated, you have three options to set the consolidated value:
- Click on "Use Average Rating" at the top to calculate the average of your observers' ratings. The values can still be manually adjusted afterward.
- Alternatively, you can use the slider under "Consolidate" to set any value. This will then appear as a number/symbol under "Consolidate".
For scales with numeric labels, you can set the consolidated value in 0.25 increments. If you have activated the symbolic scale labels in the administration interface, you can choose a scale point with the desired expression during consolidation, but you cannot set intermediate values as consolidated values.
- If the "Automatic Consolidation" feature has been enabled (see "Features"), you will see the note "Automatic consolidation is enabled. Remove the consolidation to manually consolidate." at the top, and consolidated values will be automatically set. These values can, of course, still be individually adjusted.
If you want to make changes, click the box next to the corresponding competency so that it turns gray. You can now move the slider again. To fix the values, proceed as described above.Once you have agreed on a value for a specific competency, you have two options to finalize the consolidated values:
- Click the checkbox for the relevant competency.
- Alternatively, you can click "Finalize Consolidation" to immediately lock in all the consolidation values you have agreed upon for the competencies.
Once the consolidation has been finalized, the checkbox is highlighted in color and checked. The slider turns gray and can no longer be moved.
Once an assessment is completed, the slider and consolidated values will be displayed in gray and can no longer be changed.Related Articles
Consolidate: Finalize values
Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Consolidate" (on the left side of the screen), the ratings of the various observers can be viewed and consolidated into overall ratings. In the web-based observer ...Consolidate: Overview
Relevant for: Normal observers, lead observers, moderators (see "User roles") In the assessment overview within the schedule, click "Consolidate" on an exercise, and a new page will open. If the assessment is still in draft status, you cannot ...Consolidate: Overview
Relevant for: Normal observers, Lead observers, Moderators (see "User Roles") In the assessment overview within the schedule, click "Consolidate" on an exercise, and a new page will open. If the assessment is still in draft status, you cannot ...Consolidate: Profile
Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Profile," the rating profiles of the individual observers as well as the consolidated rating profile can be displayed graphically. At the same time, you can also ...Consolidate: Profile
Relevant for: Normal observers, Lead observers, Moderators (see "User Roles") Under "Profile", the rating profiles of the individual observers as well as the consolidated rating profile can be displayed graphically. At the same time, you can also ...