Consolidate
Relevant for: Normal observers, lead observers, moderators (see "User roles")Under "Consolidate" (on the left side of the screen), the ratings of the various observers can be viewed and consolidated into overall ratings.
In the web-based observer interface, you typically work in landscape mode and can follow the screenshots' illustrations 1:1. In the native iPad app, you can work in either landscape or portrait mode. Depending on which format you choose, the view differs here. However, the explanations and screenshots can also be easily applied to the portrait format.
- In landscape mode, the "Consolidate" page is always visible on the left side, regardless of what is selected on the right side in the lower row, i.e., "Profile," "Assess. Results," or "Notes."
- In portrait mode, you can choose between "Consolidate," "Profile," "Assess. Results," and "Notes" in the lower row, and then only the selected page is displayed on the entire screen.
On the "Consolidate" page, you will see a note at the top ("Values are automatically consolidated") if automatic consolidation is activated for an assessment (see "Features"). Also, you can click on "Use Average Ratings" at the top left to average the ratings given by the observers into consolidation values (only for Lead Observers & Moderators).
Click "Refresh Consolidation" to synchronize or refresh the page.
On this page, you will also find the "Competencies" assessed in the respective exercise, the corresponding scales or sliders for the "Consolidated Values", and under "Consolidated", a box with either the consolidated value as a number/symbol or a question mark if the exercise has not yet been consolidated.
For scales with numeric labels, you can set the consolidated value in 0.25 increments.
You will either see the numeric labels or - if you previously activated this option in the administration interface - the custom symbolic labels. These can also be consolidated. To select the consolidated value, all scale points with the associated symbolic labels are available. However, you cannot choose intermediate values as consolidated values. More information on activating this feature can be found here.Click "Finalize Consolidation" to complete the consolidation. The slider will then be displayed in green, and the boxes with the consolidated value next to them will be filled with a green checkmark.
The "Status of ratings" section can be expanded by clicking, showing an overview of how many ratings each observer has submitted. Click "Refresh" to synchronize the status. The "Exclamation Mark" next to it indicates that not all observers have submitted their ratings. If you see a green checkmark there, all observers have submitted their ratings.
Depending on the observer role(s) assigned to you, you can use different functions of the observer interface (see "User roles in the observer interface"). The differences between roles are most significant during consolidation, so they are explained individually below.
Normal Observer
Relevant for: Normal observer (see "User roles")If you are a normal observer (not a lead observer or moderator), you can initially only see your own ratings during consolidation (on all pages).
Once the lead observer has entered consolidated values into the observer interface and synchronized the rating, you can also see these values on the scale. To do this, click "Refresh Consolidation" at the top. However, you still cannot see the ratings of other observers.
Under "Status of ratings," you can only see the status of your own rating and not the status of other observers.
Silent Observer
Relevant for: Silent observer (see "User roles")If you are a silent observer, you cannot initially see any ratings during consolidation.
Once the lead observer has entered consolidated values into the observer interface and synchronized the rating, you can see these values on the scale. To do this, click "Refresh Consolidation" at the top. However, you cannot see the ratings of other observers at any time.
Under "Status of ratings" you will see your own name and a greyed-out circle in the status display, as you cannot submit ratings yourself. You cannot view the rating status of other observers.
Lead Observer & Moderator
Relevant for: Lead observer, moderator (see "User roles")If you are a lead observer (only possible with the Scheduler activated) or moderator, you can see both your own ratings and the ratings of all observers during the consolidation of the respective exercise and consolidate these values. Depending on the set scale labels, you will consolidate for numeric values or alternatively for custom symbolic/character labels.
Moderators can do this across exercises and candidates, while lead observers can only do this for the exercise(s) and candidate(s) they have been assigned to.
In general: For lead observers or moderators to correctly consolidate individual exercises, all observers should have submitted and synchronized their ratings and notes made during the assessment. If not all observers have submitted their ratings, an "Exclamation Mark" will appear next to "Status of ratings". If you see a green checkmark there, all observers have submitted their ratings. You can update the status of ratings at any time by clicking "Update".
- For competencies that have not yet been consolidated, the slider under "Consolidated Value" will appear in the assessment-specific color, and under "Consolidated," a grey box will appear next to either a question mark or a consolidation value as a number/symbol.On the "Profile" page, the values are displayed with grey circles.
- For competencies that have already been consolidated, the slider under "Consolidated Value" will appear in green, under "Consolidated" a green check-marked box will appear, and next to it the consolidated value as a number/symbol.On the "Profile" page, they are displayed with green circles.
If competencies are not yet consolidated, you have three options to set the consolidated value:
- Click on "Use Average Ratings" at the top to calculate the average of your observers' ratings. The values can still be manually adjusted afterward.
- Alternatively, you can use the "Slider" under "Consolidated Value" to set any value. This will then appear as a number/symbol under "Consolidated".For scales with numeric labels, you can set the consolidated value in 0.25 increments. If you have activated the symbolic scale labels in the administration interface, you can choose a scale point with the desired expression during consolidation, but you cannot set intermediate values as consolidated values.
- If the "automatic consolidation" feature has been enabled (see "Features"), you will see the note "Results are consolidated automatically" at the top, and consolidated values will be automatically set. These values can, of course, still be individually adjusted.
If you want to make changes, click the box next to the corresponding competency so that it turns grey. You can now move the slider again. To fix the values, proceed as described above.
Once you have agreed on a value for a specific competency, you have two options to finalize the consolidated values:
- Click the box under "Consolidated" for the respective competency. The box will then be green and checked. The slider will also turn green and can no longer be moved.
- Alternatively, you can click "Finalize Consolidation" to directly fix all consolidated values you have agreed on for the competencies. The boxes and sliders will then turn green.
Once an assessment is completed, the slider and consolidated values will be displayed in grey and can no longer be changed.
Related Articles
Consolidate: Overview
Relevant for: Normal observers, lead observers, moderators (see "User roles") In the assessment overview within the schedule, click "Consolidate" on an exercise, and a new page will open. If the assessment is still in draft status, you cannot ...Consolidate: Notes
Relevant for: Normal observers, lead observers, moderators (see "User roles") Under "Notes," you can view your own notes (handwritten notes, text notes, and competency notes) for each candidate in the respective exercise. You also have the option to ...What access options do I have as a Lead Observer?
As a lead observer, you have similar functions as the moderators, but only in relation to individual exercises that are assigned to you. In this exercise, you can then view all the ratings and consolidate them. You can learn more about the different ...What access options do I have as a moderator?
As a moderator, you work in the observer interface . You can view your own ratings and those of all other observers and consolidate them. You can also complete the assessment. You can learn more about the different user roles in the observer ...User roles in the observer interface
The Applysia observer interface can be used either as a web-based application or as a native iPad app. Here, you can assess and compare candidates during the assessment. Not every Applysia user has access to the observer interface; access depends on ...