# US 2022/0036610 A1 · Visualization of a model selection process in an automated model selection system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0036610 A1 - Document ID: US20220036610A1 - Status: Published application - Kind: A1 - Application number: 16/942,284 - Filed: 2020-07-29 - Published: 2022-02-03 - Earliest claimed: 2020-07-29 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Dakuo Wang; Bei Chen; Ji Hui Yang; Abel Valente; Arunima Chaudhary; Chuang Gan; John Dillon Eversman; Voranouth Supadulya; Daniel Karl I. Weidele; Jun Wang; Jing James Xu; Dhavalkumar C. Patel; Long Vu; Syed Yousaf Shah; Si Er Han - Web page: https://patentgrep.com/patent/US20220036610A1 ## CPC - G06T 11/26: Drawing of charts or graphs - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06N 5/00: Computing arrangements using knowledge-based models - G06N 20/00: Machine learning - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS ## Abstract Systems, computer-implemented methods, and computer program products to facilitate visualization of a model selection process are provided. According to an embodiment, a system can comprise a memory that stores computer executable components and a processor that executes the computer executable components stored in the memory. The computer executable components can comprise an interaction backend handler component that obtains one or more assessment metrics of a model pipeline candidate. The computer executable components can further comprise a visualization render component that renders a progress visualization of the model pipeline candidate based on the one or more assessment metrics. ## Claims ### Claim 1 A system, comprising: a memory that stores computer executable components; and a processor that executes the computer executable components stored in the memory, wherein the computer executable components comprise: an interaction backend handler component that obtains one or more assessment metrics of a model pipeline candidate and second model pipeline candidate; and a visualization render component that concurrently renders a progress visualization of the model pipeline candidate and a second progress visualization of the second model pipeline candidate based on the one or more assessment metrics, and wherein the progress visualization and the second visualization comprises a tree based visualization. ### Claim 2 (depends on 1) The system of claim 1, wherein the one or more assessment metrics are selected from a group consisting of an optimization metric, a performance metric, a data allocation metric, a training data used metric, and a build time metric. ### Claim 3 (depends on 1) The system of claim 1, wherein the visualization render component further renders the progress visualization in at least one of a progress map, a relationship map, or a leaderboard. ### Claim 4 (depends on 1) The system of claim 1, wherein the progress visualization comprises a visual representation of the one or more assessment metrics. ### Claim 5 (depends on 1) The system of claim 1, wherein the progress visualization comprises an interactive progress visualization, and wherein the visualization render component renders a tooltip visualization comprising at least one of a textual representation or a numerical representation of the one or more assessment metrics based on selection of the interactive progress visualization. ### Claim 6 (depends on 1) The system of claim 1, wherein the visualization render component renders a ranking of the model pipeline candidate and the second model pipeline candidate based on assessment metrics of the model pipeline candidate and the second model pipeline candidate. ### Claim 7 (depends on 1) The system of claim 1, wherein the computer executable components further comprise: an action component that performs at least one of a stop operation, a save operation, or a discard operation individually corresponding to the model pipeline candidate or the second model pipeline candidate based on a determination that a defined maximum build time has been met with respect to the model pipeline candidate or the second model pipeline candidate that is being evaluated , thereby facilitating at least one of improved selection of a model in a model selection process, improved performance of the processor in executing the model selection process, or reduced computational costs of the processor in executing the model selection process. ### Claim 8 A computer-implemented method, comprising: obtaining, by a system operatively coupled to a processor, one or more assessment metrics of a plurality of model pipeline candidates; and rendering, by the system, a progress visualization of the plurality of model pipeline candidates based on the one or more assessment metrics, wherein the progress visualization comprises rendering as solid black dots to indicate that various operations have been completed and rendering in various colors or dots inside of other dots to indicate evaluation or training is in progress. ### Claim 9 (depends on 8) The computer-implemented method of claim 8, wherein the one or more assessment metrics are selected from a group consisting of an optimization metric, a performance metric, a data allocation metric, a training data used metric, and a build time metric. ### Claim 10 (depends on 8) The computer-implemented method of claim 8, further comprising: rendering, by the system, the progress visualization is also at least one of a progress map, a tree based visualization, a relationship map, or a leaderboard. ### Claim 11 (depends on 8) The computer-implemented method of claim 8, wherein the progress visualization comprises a visual representation of the one or more assessment metrics. ### Claim 12 (depends on 8) The computer-implemented method of claim 8, wherein the progress visualization comprises an interactive progress visualization, and further comprising: rendering, by the system, a tooltip visualization comprising at least one of a textual representation or a numerical representation of the one or more assessment metrics based on selection of the interactive progress visualization. ### Claim 13 (depends on 8) The computer-implemented method of claim 8, further comprising: rendering, by the system, a ranking of the plurality of model pipeline candidates based on assessment metrics of the plurality of model pipeline candidates. ### Claim 14 (depends on 8) The computer-implemented method of claim 8, further comprising: performing, by the system, at least one of a stop operation, a save operation, or a discard operation corresponding to only one of the plurality of model pipeline candidates based on input from an entity, thereby facilitating at least one of improved selection of a model in a model selection process, improved performance of the processor in executing the model selection process, or reduced computational costs of the processor in executing the model selection process. ### Claim 15 A computer program product facilitating a visualized model selection process, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to: obtain, by the processor, one or more assessment metrics of a model pipeline candidate and a second model pipeline candidate; and render, by the processor, a progress visualization of the model pipeline candidate and a progress visualization of the second model pipeline candidate based on the one or more assessment metrics. ### Claim 16 (depends on 15) The computer program product of claim 15, wherein the one or more assessment metrics are selected from a group consisting of an optimization metric, a performance metric, a data allocation metric, a training data used metric, and a build time metric, and wherein the progress visualization comprises a visual representation of the one or more assessment metrics. ### Claim 17 (depends on 15) The computer program product of claim 15, wherein the program instructions are further executable by the processor to cause the processor to: render, by the processor, the progress visualization in at least one of a progress map, a tree based visualization, a relationship map, or a leaderboard. ### Claim 18 (depends on 15) The computer program product of claim 15, wherein the progress visualization comprises an interactive progress visualization, and wherein the program instructions are further executable by the processor to cause the processor to: render, by the processor, a tooltip visualization comprising at least one of a textual representation or a numerical representation of the one or more assessment metrics based on selection of the interactive progress visualization. ### Claim 19 (depends on 15) The computer program product of claim 15, wherein the program instructions are further executable by the processor to cause the processor to: render, by the processor, a ranking of the model pipeline candidate and the second model pipeline candidate based on assessment metrics of the model pipeline candidate and the second pipeline candidate. ### Claim 20 (depends on 15) The computer program product of claim 15, wherein the program instructions are further executable by the processor to cause the processor to: perform, by the processor, at least one of a stop operation, a save operation, or a discard operation corresponding to the model pipeline candidate and the second model pipeline candidate based on input from an entity, thereby facilitating at least one of improved selection of a model in a model selection process, improved performance of the processor in executing the model selection process, or reduced computational costs of the processor in executing the model selection process.