# US 11,030,214 B2 · System for identification of outlier groups > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,030,214 B2 - Document ID: US11030214B2 - Status: Granted - Kind: B2 - Application number: 16/391,188 - Filed: 2019-04-22 - Published: 2020-10-22 - Granted: 2021-06-08 - Earliest claimed: 2019-04-22 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Aleksey Ashikhmin; Sanjay H Ramaswamy; Andrew C. Owen; Aaron Harrison; Sreeram Nivarthi; Vindana Madhuwantha; Umashree Narayanaswamy; Brian Quistorff; Eric Radtke; Omar Mustafa; Di Li - Web page: https://patentgrep.com/patent/US11030214B2 ## CPC - G06F 16/26: Visual data mining; Browsing structured data - G06Q 10/06393: {Score-carding, benchmarking or key performance indicator [KPI] analysis} - G06F 9/451: Execution arrangements for user interfaces - G06F 16/2465: {Query processing support for facilitating data mining operations in structured databases} - G06Q 10/0639: Performance analysis of employees; Performance analysis of enterprise or organisation operations - G06F 2216/03: Data mining - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract A method may include retrieving metric data on a plurality of groups of users, the metric data including: a value of a performance metric for each of the plurality of groups; and an indication that a first group of the plurality of groups is anomalous with respect to a value of the performance metric of a control group of the plurality of groups; and presenting a user interface, the user interface including: a first portion including a visualization of a comparison of the value of the performance metric for the first group and values of the performance metric of other groups in the plurality of groups; and a second portion including a visualization of trend data of the performance metric for the first group over a period of time. ## Claims ### Claim 1 A system comprising: a processing unit; and a storage device comprising instructions, which when executed by the processing unit, configure the processing unit to: retrieve metric data on a plurality of groups of users, the metric data including a value of a performance metric for each of the plurality of groups; determine a control group of the plurality of groups utilizing a model based on a distance metric to calculate alikeness between users; determine that a first group of the plurality of groups is anomalous with respect to a value of the performance metric of the control group, wherein determining that the first group is anomalous includes determining that a difference, between a median value of the performance metric for the plurality of users and a median value of the performance metric for the control group, exceeds a threshold value; and present a user interface, the user interface including: a first portion including a visualization of a comparison of the value of the performance metric for the first group and values of the performance metric of other groups in the plurality of groups, and an indication of the determined anomaly with reference to the determined control group; and a second portion including a visualization of trend data of the performance metric for the first group over a period of time. ### Claim 2 (depends on 1) The system of claim 1, wherein each of the users in the plurality of users is associated with attribute values for a plurality of attributes. ### Claim 3 (depends on 2) The system of claim 2, wherein the users in the plurality of groups are selected based on sharing a value of a selected attribute of the plurality of attributes. ### Claim 4 (depends on 3) The system of claim 3, wherein users in the control group are selected based on attributes other than the selected attribute. ### Claim 5 (depends on 3) The system of claim 3, wherein the selected attribute is a reporting attribute with respect to an organization. ### Claim 6 (depends on 1) The system of claim 1, wherein the user interface further includes a selection element configured to change the performance metric, wherein determining the control group includes selecting data items of the metric data that influence the performance metric. ### Claim 7 (depends on 6) The system of claim 6, wherein the instructions, which when executed by the processing unit, configure the processing unit to: receive selection of a new metric via the selection element; access further metric data on the plurality of groups of users, the further metric data including: a value for the new metric for each of the plurality of groups; and an indication that a second group of the plurality of groups is anomalous with respect to a control group of the plurality of groups for the new metric; and update the user interface based on the further metric data. ### Claim 8 (depends on 1) The system of claim 1, wherein the instructions, which when executed by the processing unit, configure the processing unit to: receive a selection in the first portion of a second group of the plurality of groups; and in response to the selection, update the second portion to include a visualization of trend data of the performance metric for the second group. ### Claim 9 A storage device comprising instructions, which when executed by a processing unit, configure the processing unit to: retrieve metric data on a plurality of groups of users, the metric data including a value of a performance metric for each of the plurality of groups; determine a control group of the plurality of groups utilizing a model based on a distance metric to calculate alikeness between users; determine that a first group of the plurality of groups is anomalous with respect to a value of the performance metric of the control group, wherein determining that the first group is anomalous includes determining that a difference, between a median value of the performance metric for the plurality of users and a median value of the performance metric for the control group, exceeds a threshold value; and present a user interface, the user interface including: a first portion including a visualization of a comparison of the value of the performance metric for the first group and values of the performance metric of other groups in the plurality of groups, and an indication of the determined anomaly with reference to the determined control group; and a second portion including a visualization of trend data of the performance metric for the first group over a period of time. ### Claim 10 (depends on 9) The storage device of claim 9, wherein each of the users in the plurality of users is associated with attribute values for a plurality of attributes. ### Claim 11 (depends on 10) The storage device of claim 10, wherein the users in the plurality of groups are selected based on sharing a value of a selected attribute of the plurality of attributes. ### Claim 12 (depends on 11) The storage device of claim 11, wherein users in the control group are selected based attributes other than the selected attribute. ### Claim 13 (depends on 11) The storage device of claim 11, wherein the selected attribute is a reporting attribute with respect to an organization. ### Claim 14 (depends on 9) The storage device of claim 9, wherein the user interface further includes a selection element configured to change the performance metric, wherein determining the control group includes selecting data items of the metric data that influence the performance metric. ### Claim 15 (depends on 9) The storage device of claim 9, wherein the instructions, which when executed by the processing unit, configure the processing unit to: receive selection of a new metric via the selection element; access further metric data on the plurality of groups of users, the further metric data including: a value for the new metric for each of the plurality of groups; and an indication that a second group of the plurality of groups is anomalous with respect to a control group of the plurality of groups for the new metric; and update the user interface based on the further metric data. ### Claim 16 (depends on 9) The storage device of claim 9, wherein the instructions, which when executed by the processing unit, configure the processing unit to: receive a selection in the first portion of a second group of the plurality of groups; and in response to the selection, update the second portion to include a visualization of trend data of the performance metric for the second group. ### Claim 17 A method comprising: retrieving metric data on a plurality of groups of users, the metric data including a value of a performance metric for each of the plurality of groups; determining a control group of the plurality of groups utilizing a model based on a distance metric to calculate alikeness between users; determining that a first group of the plurality of groups is anomalous with respect to a value of the performance metric of the control group, wherein determining that the first group is anomalous includes determining that a difference, between a median value of the performance metric for the plurality of users and a median value of the performance metric for the control group, exceeds a threshold value; and presenting a user interface, the user interface including: a first portion including a visualization of a comparison of the value of the performance metric for the first group and values of the performance metric of other groups in the plurality of groups, and an indication of the determined anomaly with reference to the determined control group; and a second portion including a visualization of trend data of the performance metric for the first group over a period of time. ### Claim 18 (depends on 17) The method of claim 17, wherein each of the users in the plurality of users is associated with attribute values for a plurality of attributes. ### Claim 19 (depends on 1) The system of claim 1, wherein the instructions, which when executed by the processing unit, configure the processing unit to: determine a selection of a first dimension from a plurality of dimensions of the metric data; and form the first group to include users having a same value of the first dimension. ### Claim 20 (depends on 9) The storage device of claim 9, wherein determining that the first group is anomalous with respect to the control group of the plurality of groups is based on a difference between a median value of the performance metric for the plurality of users and a median value of the performance metric for the control group exceeding a threshold.