# US 2019/0244153 A1 · Method and System for Automated and Integrated Assessment Rating and Reporting

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0244153 A1
- Document ID: US20190244153A1
- Status: Published application
- Kind: A1
- Application number: 16/388,183
- Filed: 2019-04-18
- Published: 2019-08-08
- Earliest claimed: 2015-06-09
- Assignees: Development Dimensions International, Inc.
- Applicants: Development Dimensions International, Inc.
- Inventors: William C. Byham; Audrey B. Smith; Douglas H. Reynolds; Paul R. Bernthal; Ryan Heinl; Sudhir Thaikootathil; Alexander R. Schwall
- Web page: https://patentgrep.com/patent/US20190244153A1

## CPC

- G06Q 10/06398: {Performance of employee with respect to a job function}
- G09B 7/02: of the type wherein the student is expected to construct an answer to the question which is presented or wherein the machine gives an answer to the question presented by a student
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)

## Abstract

An automated assessment process for rating, integrating, and reporting for assessment centers, based upon research is described, that takes the place of the traditional manual, clinical process, and corrects for potential human biases present using traditional assessment processes. The automated assessment process includes providing an assessment to a participant and receiving behavior ratings for one or more associated behaviors demonstrated by the participant during the assessment. The automated process also includes determining an initial competency rating based upon the behavior ratings. Each initial competency rating is combined with non-simulation assessment results and a final competency rating is determined for each competency being assessed. A report is then automatically generated that includes the final competency rating for each competency being assessed. The report may additionally include a listing of one or more topics for a feedback discussion between the assessment participant and an assessment administrator.

## Claims

### Claim 1

A method of providing an automated assessment center, the method comprising:
receiving behavior rating data relating to a plurality of behaviors assessed from one or more simulations provided to an assessment participant, the simulations comprising tasks designed to measure each of the plurality of behaviors;
associating the behavior rating data with one or more competencies of the assessment participant based upon the plurality of behaviors assessed;
automatically aggregating the behavior rating data into a plurality of overall behavior ratings for each behavior associated with the one or more competencies;
automatically aggregating the overall behavior ratings for each behavior of the plurality of behaviors into one or more competency-associated sets of overall behavior ratings, for each of the one or more competencies, and based on the one or more competencies associated with the behavior data;
weighting, for each of the one or more of the competencies, each overall behavior rating associated with the one or more competencies;
automatically generating an initial competency rating for each of the one or more competencies based at least partially on the weighted overall behavior ratings aggregated into each of the one or more competency-associated sets;
automatically generating a final competency rating for each of the one or more competencies by combining the initial competency rating with one or more non-simulation assessment results; and
automatically compiling a report based at least partially on the final competency rating.

### Claim 2 (depends on 1)

The method of claim 1, further comprising automatically aggregating at least a portion of the behavior rating data based upon an associated simulation.

### Claim 3 (depends on 1)

The method of claim 1, further comprising determining one or more competencies to assess for an assessment participant; and determining a plurality of associated behaviors for each of the one or more competencies to assess.

### Claim 4 (depends on 1)

The method of claim 1, wherein combining the initial competency rating with at least one non-simulation assessment result for each competency comprises automatically generating at least one roll-up table for each of the one or more non-simulation assessment results.

### Claim 5 (depends on 4)

The method of claim 4, wherein the at least one roll-up table comprises a data structure representing the initial competency rating for each competency as combined with the one or more non-simulation assessment results.

### Claim 6 (depends on 4)

The method of claim 4, combining the initial competency rating with at least one non-simulation assessment result for each competency further comprises iteratively combining the initial competency rating for each competency with a plurality of non-simulation assessment results by generating a plurality of roll-up tables for each of the one or more non-simulation assessment results and sequentially combining the results of a previous roll-up table with a sequential roll-up table.

### Claim 7 (depends on 1)

The method of claim 1, wherein the one or more non-simulation assessment results comprise at least one of personality assessment instrument ratings, experience inventory ratings, motivational fit inventory ratings, and multi-rater evaluations ratings.

### Claim 8 (depends on 1)

The method of claim 1, wherein each of the one or more competencies comprises three or more associated behaviors.

### Claim 9 (depends on 8)

The method of claim 8, wherein at least one behavior is shared by a plurality of competency ratings.

### Claim 10

A system for providing an automated assessment center, the system comprising:
a processor; and
a non-transitory, processor-readable storage medium in communication with the processor, wherein the non-transitory processor-readable storage medium contains one or more programming instructions that, when executed, cause the processor to:
receive behavior rating data relating to a plurality of behaviors assessed from one or more simulations provided to an assessment participant, the simulations comprising tasks designed to measure each of the plurality of behaviors;
associate the behavior rating data with one or more competencies of the assessment participant based upon the plurality of behaviors assessed;
automatically aggregate the behavior rating data into a plurality of overall behavior ratings for each behavior associated with the one or more competencies;
automatically aggregate the overall behavior ratings for each behavior of the plurality of behaviors into one or more competency-associated sets of overall behavior ratings, for each of the one or more competencies, and based on the one or more competencies associated with the behavior data;
weight, for each of the one or more of the competencies, each overall behavior rating associated with the one or more competencies;
automatically generate an initial competency rating for each of the one or more competencies based at least partially on the weighted overall behavior ratings aggregated into each of the one or more competency-associated sets;
automatically generate a final competency rating for each of the one or more competencies by combining the initial competency rating with one or more non-simulation assessment results; and
automatically compile a report based at least partially on the final competency rating.

### Claim 11 (depends on 10)

The system of claim 10, further comprising one or more programming instructions that, when executed, cause the processor to automatically aggregate at least a portion of the plurality of behavior ratings based upon an associated simulation.

### Claim 12 (depends on 10)

The system of claim 10, further comprising one or more programming instructions that, when executed, cause the processor to determine one or more competencies to assess for an assessment participant and determine a plurality of associated behaviors for each of the one or more competencies to assess.

### Claim 13 (depends on 10)

The system of claim 10, wherein the one or more programming instructions that, when executed, cause the processor to combine the initial competency rating with at least one non-simulation assessment result for each competency result, further comprise one or more additional programming instructions that, when executed, cause the processor to automatically generate at least one roll-up table for each of the one or more non-simulation assessment result.

### Claim 14 (depends on 13)

The system of claim 13, wherein the at least one roll-up table comprises a data structure representing the initial competency rating for each competency as combined with the one or more non-simulation assessment result.

### Claim 15 (depends on 10)

The system of claim 10, wherein the one or more non-simulation assessment results comprise at least one of personality assessment instrument ratings, experience inventory ratings, motivational fit inventory ratings, and multi-rater evaluations ratings.

### Claim 16 (depends on 10)

The system of claim 10, wherein each of the one or more competencies comprises three or more associated behaviors.

### Claim 17 (depends on 16)

The system of claim 16, wherein at least one behavior is shared by a plurality of competency ratings.

### Claim 18

A method of providing an automated assessment center, the method comprising:
determining, by a processing device, one or more competencies to assess for an assessment participant;
determining, by the processing device, a plurality of associated behaviors for each of the one or more competencies to assess;
providing, by the processing device, one or more assessments to the assessment participant, wherein the one or more assessments comprise tasks designed to express each of a plurality of behaviors associated with one or more competencies to be assessed as demonstrated by the assessment participant when completing the one or more assessments;
receiving, by the processing device, a plurality of behavior ratings from a plurality of assessors, wherein each behavior rating comprises a rating for an associated behavior as demonstrated by the assessment participant when completing the one or more assessments;
determining, by the processing device, an initial competency rating for each of the one or more competencies to assess based upon the plurality of behavior ratings;
for each competency, combining, by the processing device, an initial competency rating with one or more non-simulation assessment results;
determining, by the processing device, a final competency rating for each of the one or more competencies to assess based upon a combined initial competency rating and the at least one non-simulation assessment result; and
generating, by the processing device, a report including at least the final competency rating for each of the one or more competencies to assess, wherein the report further includes a listing of one or more topics for a feedback discussion between the assessment participant and an assessment administrator.

### Claim 19 (depends on 18)

The method of claim 18, further comprising aggregating, by the processing device, at least a portion of the plurality of behavior ratings based upon an associated simulation.

### Claim 20 (depends on 19)

The method of claim 19, further comprising aggregating, by the processing device, the plurality of behavior ratings based upon an associated competency.
