Benchmarks

Benchmarks

Relevant for: Organisation Administrators, Administrators (see "User Roles in the Cockpit").

You have clicked on "Insights" in the header of the Cockpit and selected specific filter options. The "Benchmarks" evaluate across all Assessments, Candidates and Observers based on the filters set. 

Here you can see a Benchmark of the distribution of all Competency Clusters as well as a Benchmark of the distribution of all individual competencies. In addition, you will see a Benchmark of the Clusters and Competencies by Exercise.


Benchmark - Competency Cluster

Under "Benchmark - Competency Cluster" you can see in the radar chart the mean and standard deviation of the rated Competency Clusters in the completed Assessments. The mean value of the individual Competency Clusters is shown in blue. In the gray shaded area to the right and left of it you can see the standard deviation, i.e. the spread of all the ratings of the Competency Clusters. This display is cross-exercise


When you move your cursor over the profile points, tooltips appear that show the respective Competency Clusters as well as the corresponding values (mean value for blue profile points / standard deviation for gray profile points).


Distribution - Competency Cluster

Under "Distribution - Competency Cluster" you can see the distribution and the exact number of ratings of a selected Competency Cluster. The number of ratings does not necessarily correspond to the Observers, since the individual competencies of a Cluster can be rated in several exercises in an Assessment. Accordingly, this representation is also cross-exercise


Select the Competency Cluster for which you want to display the distribution in the drop-down menu at the top right next to "Competency Cluster".


When you move your cursor over the bars, tooltips appear showing the respective scale point or rating and the number of ratings.




Benchmark - Competencies 

Under "Benchmark - Competencies" you see the mean value of the rated competencies in blue in the completed Assessments. In the gray shaded area to the right and left of it, you can see the standard deviation, i.e. the spread of all the ratings of the competencies. This representation is cross-exercise.


When you move your cursor over the profile points, tooltips appear showing the respective competency and the associated values (mean value for blue profile points / standard deviation for gray profile points).


For each of the filter settings, it is possible to display how the individual competencies were rated on average. Or in other words: the competency profile of the average Candidate. At the same time, the standard deviation of the scores is also displayed to visualize the spread of the scores. The spread therefore indicates whether the mean value is the result of all Candidates always receiving the same rating or whether the ratings are very different. In the graphic "Distribution - Competencies" the spread of the values for the individual competencies is broken down again. 


Distribution - Competencies

Under "Distribution - Competencies" you can see the distribution and the exact number of ratings of a selected competency. The number of ratings does not necessarily correspond to the number of Observers, since a competency can be rated in several exercises in an Assessment. Accordingly, this representation is also cross-exercise.


In the drop-down menu at the top right next to "Competency", select the competency for which you want to display the distribution.


When you move your cursor over the bars, tooltips appear showing the respective scale point or rating and the number of ratings. 


The values of these two Benchmarks ("Benchmark - Competencies" and "Distribution - Competencies") alone provide exciting insights. For example, when evaluating future Candidates, the Benchmarks can be used to assess how they have performed in comparison to other Candidates. This evaluation is important because it could well be that all Candidates in a competency were rated on a scale of one to five with an average of 1.5. If you now have a Candidate with a rating of 2.5 in front of you, this rating is exactly in the middle of the scale, but compared to the average rating of the previous Candidates, it is already an above-average expression of this competency.


At the same time, the reflection of the Competency Model follows almost automatically. Perhaps it is not intended that all Candidates perform so "badly" and the exercise could be adjusted. It is also interesting to look at the standard deviation. If the standard deviation is very low, this indicates that all Candidates always receive the same rating. This is rarely desirable, especially in personnel selection processes, since it is a matter of selecting Candidates from a larger group and it is important to determine the differences between the Candidates.




Benchmark - Clusters and Competencies by Exercise

Under "Benchmark - Clusters and Competencies by Exercise" you can see a table with the mean values (standard deviations in parentheses behind) of all Competency Clusters and all individual competencies in the different exercises. Accordingly, this representation is both exercise-wide and exercise-specific.


On the left side the "Competency Clusters" and the "Competencies" are listed individually that were observed and rated in the exercises in the completed Assessments. The header lists the exercises individually that were performed and observed.


In addition, further mean values (standard deviations) are formed in each case. 

  1. On the right side you can see the values of each individual Competency Cluster and each individual competency across all exercises (cross-exercise). These values are visualized in blue above in the graphs "Benchmark - Competency Cluster" and "Benchmark - Competencies".
  2. In the bottom row you can see the values of each exercise across all competencies (exercise specific). 
  3. At the bottom right, the mean values (standard deviation) of all ratings given in the Assessment are calculated, regardless of competencies and exercises (across exercises).

On the far right of the table, you can click on "Details" to access a competency- and exercise-specific evaluation of the ratings. 



    • Related Articles

    • Insights overview

      Relevant for: Organisation Administrators, Administrators (see "User Roles in the Cockpit"). With Applysia Insights, we enable insights into your Assessment processes without the tedious collection and evaluation of data. Initially, we focus ...
    • User roles in the Cockpit

      In the browser-based Cockpit you can manage your Assessments & Templates, the Users of the Software as well as your Workspace. Not every Applysia User has access to the Cockpit, this depends on the User role you have been assigned (for many Users the ...
    • Landing Page overview

      Welcome to the Applysia Support Portal! This is where you can get Support in using our services as well as answers to your questions about our Software. For this purpose, we have created articles on a variety of topics and functions. Applysia ...