Consolidate

Consolidate

Relevant for: Normal Observers, Lead Observers, Moderators (see "Observer roles in the App")
Under "Consolidate" (on the left side of the screen), the ratings of the various Observers can be viewed and consolidated into overall ratings. 

The view differs depending on whether you are working in landscape or portrait format.

If you use the Web-App, there is no distinction between landscape and portrait format. Here you work in landscape format by default and you can follow the representations in the screenshot 1 to 1.
  1. In landscape mode, the "Consolidate" page is always visible on the left side, regardless of what is selected on the right side in the bottom row, i.e. "Profile", "Assess. Results" or "Notes". 
  2. In portrait mode, you can choose between "Consolidate", "Profile", "Assess. Results" and "Notes" and then only see the selected page on the entire screen. 

The following explanations and screenshots refer to landscape format, but can be transferred almost 1 to 1 to portrait format.


On the "Consolidate" page, you will see a note ("Results are consolidated automatically") at the top if Automatic Consolidation is enabled for an Assessment (see "Features"). In addition, you can click on "Use Average Ratings" in the upper left corner to average the ratings given by the Observers into consolidated values (only for Lead Observers & Moderators). 

Click “Refresh Consolidation” to synchronize or refresh the page. 


On the page you will also find the "Competency" assessed in the respective exercise, the corresponding scales or sliders of the "Consolidated Value" as well as under "Consolidated" a box and either the consolidated value as a number/symbol or a question mark if the exercise has not been consolidated yet. 

For numbers as scale labels, you can set the consolidation value in increments of 0.25.
Here you are shown either the scale labels with numbers, or - if you have previously activated this option in the Cockpit - the individual scale labels with symbols/characters. You can also consolidate these. To select the consolidated value, all scale points with the assigned symbolic label are available. Characteristics in between, however, cannot be selected as consolidated values. For more information on how to activate this feature, click here.

Click "Finalize Consolidation" to complete the Consolidation.


You can click on "Status of ratings" to see an overview of which Observers have given how many ratings. Click "Refresh" to synchronize the status. The "exclamation mark" next to it indicates that not all Observers have submitted their ratings yet. If you see a green check mark there, the ratings of all Observers have been submitted. 




Depending on which Observer role(s) you have been assigned, you can use different functions of the App (see "Observer roles in the App"). Consolidation is where the difference between the various roles is greatest, so these are listed and explained individually below.

Normal Observer 

Relevant for: Normal Observer (see "Observer roles in the App")

If you are a Normal Observer (i.e. not a Lead Observer or Moderator), you can only see your own ratings (on all pages) during Consolidation. 


As soon as the Lead Observer has entered consolidated values into the App and synchronized the rating, you will also be able to see these values in the scale. To do this, click on "Refresh Consolidation" at the top. However, you still cannot see the ratings of the other Observers. 


Under "Status of ratings" you can also only see the status of your own rating and not the status of the other Observers. 



Silent Observer

Relevant for: Silent Observer (see "Observer roles in the App")

If you are a silent Observer, you will not be able to see ratings initially during Consolidation.


Once the Lead Observer has entered consolidated values into the App and synchronized the rating, you can see these values in the scale. To do this, click on "Refresh consolidation" at the top. However, you will not be able to see the ratings of the other Observers at any time.


Under "Status of ratings" you will see your own name and a circle crossed out in gray in the status display, as you cannot make any ratings yourself. You cannot see the status of the ratings of the other Observers.



Lead Observer & Moderator 

Relevant for: Lead Observer, Moderator (see "Observer roles in the App")
If you are a Lead Observer (only possible if the Scheduler is activated) or a Moderator, you can see your own and also all Observers' ratings when consolidating the respective exercise and consolidate these values. Depending on the scale labeling set, you make the consolidation here for numerical values or alternatively for individually stored symbol/character labels.

Moderators can do this across exercises and Candidates, Lead Observers only for the exercise(s) and Candidate(s) to which they have been assigned. 


Basically, in order for Lead Observers or Moderators to correctly consolidate the individual exercises, all Observers should have submitted and synchronized their ratings and notes made during the Assessment. If not all Observers have submitted their ratings yet, an "exclamation mark" appears next to "Status of ratings". If you see a green check mark, the ratings of all Observers have been submitted. You can update the status of the ratings at any time by clicking "Refresh". 

  1. For competencies that have not yet been consolidated, the slider under "Consolidated Value" appears in the assessment-specific color, as well as a gray box under "Consolidated" and either a question mark or a consolidated value as a number/symbol next to it. 

On the "Profile" page, the values are displayed with gray circles.

  1. For competencies that have already been consolidated, the slider under "Consolidated Value" will appear in green, and under "Consolidated" there will be a green check box and next to it the consolidated value as a number/symbol. 

On the "Profile" page they are displayed with green circles.




If the competencies are not yet consolidated, you have three options for setting the consolidated value: 

  1. Click on "Use Average Ratings" above to average the ratings of your Observers. The values can also be changed manually afterwards. 
  2. Alternatively, you can use the "slider" under "Consolidated Value" to set any value you like. Then it also appears as a number/symbol
  3. under "Consolidated".
  4. If the "Automatic Consolidation" function has been switched on (see "Features"), the note "Results are consolidated automatically " will be displayed at the top and consolidated values will be defined automatically. Of course, these values can still be adjusted individually. 

If you still want to make changes, click on the box next to the corresponding competency so that it turns gray. Now you can move the slider again. To fix the values, proceed as described above. 


Once you have agreed on a value for a particular competency, you have two options for finalizing the consolidated values: 

  1. Click in the box under "Consolidated" for the respective competency. The box is then green and checked off. The slider also turns green and can then no longer be moved. 
  2. Alternatively, you can also click "Finalize consolidation" to directly fix all consolidated values you have agreed on for the competencies. The boxes and sliders will then turn green.

Once an Assessment is complete, the slider and the consolidated values are displayed in gray and can no longer be changed.





    • Related Articles

    • Consolidate overview

      Relevant for: Normal Observers, Lead Observers, Moderators (see "Observer roles in the App") In the Assessment overview, click on "Consolidate" in the Schedule for an exercise and a new page opens. If the Assessment is still in Draft status, you ...

    • Notes (Consolidate)

      Relevant for: Normal Observers, Lead Observers, Moderators (see "Observer roles in the App") Under "Notes" you can see your own notes (handwritten notes, text notes and competency notes) for each Candidate in the respective exercise. You also have ...

    • What access options do I have as a Lead Observer?

      As a Lead Observer, you have similar functions as the Moderators, but only in relation to individual exercises that are assigned to you. In this exercise, you can then view all the ratings and consolidate them. You can learn more about the different ...

    • What access options do I have as a Moderator?

      As a Moderator, you work in the App. You can view your own ratings and those of all other Observers and consolidate them. You can also complete the Assessment. You can learn more about the different User roles in the App here.

    • Observer Roles in the App

      The Applysia App can be used either as a Web-App or as an iPad App. During an Assessment, you work exclusively in the App to evaluate and compare Candidates. Not every Applysia User has access to the App, this depends on the User role you have been ...