# US 12,216,990 B2 · Voice activated clinical reporting systems and methods thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,990 B2 - Document ID: US12216990B2 - Status: Granted - Kind: B2 - Application number: 17/521,375 - Filed: 2021-11-08 - Published: 2022-05-12 - Granted: 2025-02-04 - Earliest claimed: 2020-11-06 - Assignees: Clickview Corporation - Applicants: Clickview Corporation - Inventors: David A. Martinez; David K. Martinez - Web page: https://patentgrep.com/patent/US12216990B2 ## CPC - G06F 40/186: Templates - G06F 40/20: Natural language analysis (semantic analysis of natural language G06F40/30) - G10L 15/18: using natural language modelling - G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof - G16H 40/63: for local operation - G16H 40/67: for remote operation - G10L 2015/088: {Word spotting} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract A method for automatically generating clinical structured reports based on templates using voice recognition, the method implemented by a computing device and includes applying a natural language processing algorithm to a captured voice input from a client to identify one or more keywords or phrases. At least one of a plurality of clinical structured report templates are identified based on the identified one or more keywords or phrases correlated to medical examination data points associated with each of the templates. A clinical structured report is automatically prepared based on the identified clinical structured report templates without a non-voice input and without an explicit separate voice command directed to manage a report generation operation. The clinical structured report includes modifications to the clinical structured report template based on the identified one or more keywords or phrases. The clinical structured report is provided to the client. ## Claims ### Claim 1 A method of automatically generating clinical structured reports based on clinical structured report templates using voice recognition, the method implemented by one or more report management computing devices and comprising: identifying one or more key words or phrases in a voice input comprising natural language speech; identifying at least one clinical structured report template associated with medical data comprising medical examination data points based on the identified one or more key words or phrases; determining an action category for the one or more key words or phrases in the voice input, wherein the action category comprises navigation that comprises a navigation action that navigates active focus external to the clinical structured report without a separate explicit voice command for the navigation externally; automatically generating a clinical structured report based on the clinical structured report template, wherein the generated clinical structured report includes modifications to the clinical structured report template based on the identified one or more key words or phrases; and generating and outputting executable instructions for graphical user interface display of the clinical structured report. ### Claim 2 (depends on 1) The method of claim 1, wherein the action category further comprises one or more of dictation or macros, wherein the modifications to the clinical structured report are based on the determined action category. ### Claim 3 (depends on 2) The method of claim 2, wherein the determined action category is dictation, the method further comprising: identifying a focus area of the one or more key words or phrases, wherein the focus area comprises one of a text area of the clinical structured data report or a smart finding associated with the medical examination points; and modifying the clinical structured report based on the identified focus area. ### Claim 4 (depends on 3) The method of claim 3, wherein the identified focus area is a text area, the method further comprising: placing the one or more key words or phrases in the text area of the clinical structured data report. ### Claim 5 (depends on 3) The method of claim 3, wherein the identified focus area is a smart finding associated with the medical examination points, the method further comprising: determining a finding category of the smart finding, wherein the finding category comprises one or more of a medical finding or a characteristic. ### Claim 6 (depends on 5) The method of claim 5, wherein the finding category is a medical finding, the method further comprising: determining whether the medical finding comprises an abnormal finding; and modifying the clinical report to identify the abnormal finding when the medical finding comprises the abnormal finding. ### Claim 7 (depends on 5) The method of claim 5, wherein the finding category is a medical finding, the method further comprising: determining whether the medical finding comprises an identifying keyword; and inserting the medical finding into the clinical structured report based on the identifying keyword. ### Claim 8 (depends on 5) The method of claim 5, wherein the finding category is a characteristic, the method further comprising: determining a characteristic type of the characteristic, wherein the characteristic type comprises one of an anatomy item, a text item, or a display item; and adjusting the clinical structured report based on the determined characteristic type. ### Claim 9 (depends on 2) The method of claim 2, wherein the determined category is the navigation, the method further comprising: determining another navigation action within the clinical structured report based on the one or more keywords; and outputting executable instructions to adjust the graphical user interface display of the clinical structured report based on the another navigation action. ### Claim 10 (depends on 9) The method of claim 9, wherein the another navigation action comprises focusing on a section of the clinical structured report. ### Claim 11 (depends on 10) The method of claim 10, wherein the another navigation action comprises the focusing on a section of the clinical structured report, the method further comprising: determining whether the focusing relates to a smart finding associated with the medical examination points; and outputting executable instructions to adjust the graphical user interface display of the clinical structured report to open the smart finding when the focusing relates to the smart finding. ### Claim 12 (depends on 2) The method of claim 2, wherein the determined action category is macros, wherein the method further comprises: identifying one or more macros based on the one or more keywords; modifying the clinical structured report based on the identified one or more macros. ### Claim 13 A voice activated clinical structured reporting device, comprising memory comprising programmed instructions stored thereon and one or more processors configured to execute the stored programmed instructions to: identifying one or more key words or phrases in a voice input comprising natural language speech; identify at least one clinical structured report template associated with medical data comprising medical examination data points based on the identified one or more key words or phrases; determine an action category for the one or more key words or phrases in the voice input, wherein the action category comprises navigation that comprises a navigation action that navigates active focus external to the clinical structured report without a separate explicit voice command for the navigation externally; automatically generate a clinical structured report based on the clinical structured report template, wherein the generated clinical structured report includes modifications to the clinical structured report template based on the identified one or more key words or phrases; and generate and output executable instructions for graphical user interface display of the clinical structured report. ### Claim 14 (depends on 13) The device of claim 13, wherein the action category further comprises one or more of dictation, or macros, wherein the modifications to the clinical structured report are based on the determined action category. ### Claim 15 (depends on 14) The device of claim 14, wherein the determined action category is dictation, wherein the processors are further configured to execute the stored programmed instructions: identify a focus area of the one or more key words or phrases, wherein the focus area comprises one of a text area of the clinical structured data report or a smart finding associated with the medical examination points; and modify the clinical structured report based on the identified focus area. ### Claim 16 (depends on 15) The device of claim 15, wherein the identified focus area is a text area, wherein the processors are further configured to execute the stored programmed instructions to: place the one or more key words or phrases in the text area of the clinical structured data report. ### Claim 17 (depends on 15) The device of claim 15, wherein the identified focus area is a smart finding associated with the medical examination points, wherein the processors are further configured to execute the stored programmed instructions to: determine a finding category of the smart finding, wherein the finding category comprises one or more of a medical finding or a characteristic. ### Claim 18 (depends on 17) The device of claim 17, wherein the finding category is a medical finding, wherein the processors are further configured to execute the stored programmed instructions to: determine whether the medical finding comprises an abnormal finding; and modify the clinical report to identify the abnormal finding when the medical finding comprises the abnormal finding. ### Claim 19 (depends on 17) The device of claim 17, wherein the finding category is a medical finding, wherein the processors are further configured to execute the stored programmed instructions to: determine whether the medical finding comprises an identifying keyword; and insert the medical finding into the clinical structured report based on the identifying keyword. ### Claim 20 (depends on 17) The device of claim 17, wherein the finding category is a characteristic, wherein the processors are further configured to execute the stored programmed instructions to: determine a characteristic type of the characteristic, wherein the characteristic type comprises one of an anatomy item, a text item, or a display item; and adjust the clinical structured report based on the determined characteristic type. ### Claim 21 (depends on 14) The device of claim 14, wherein the determined category is the navigation, wherein the processors are further configured to execute the stored programmed instructions to: determine another navigation action within the clinical structured report based on the one or more keywords; and output executable instructions to adjust the graphical user interface display of the clinical structured report based on the another navigation action. ### Claim 22 (depends on 21) The device of claim 21, wherein the another navigation action comprises focusing on a section of the clinical structured report. ### Claim 23 (depends on 22) The device of claim 22, wherein the another navigation action comprises the focusing on a section of the clinical structured report, wherein the processors are further configured to execute the stored programmed instructions to rising: determine whether the focusing relates to a smart finding associated with the medical examination points; and output executable instructions to adjust the graphical user interface display of the clinical structured report to open the smart finding when the focusing relates to the smart finding. ### Claim 24 (depends on 14) The device of claim 14, wherein the determined action category is macros, wherein the processors are further configured to execute the stored programmed instructions to: identify one or more macros based on the one or more keywords; modify the clinical structured report based on the identified one or more macros. ### Claim 25 A non-transitory machine readable medium having stored thereon instructions for voice activate clinical structured reporting comprising executable code that, when executed by one or more processors, causes the processors to: identify one or more key words or phrases in a voice input comprising natural language speech; identify at least one clinical structured report template associated with medical data comprising medical examination data points based on the identified one or more key words or phrases; determine an action category for the one or more key words or phrases in the voice input, wherein the action category comprises navigation that comprises a navigation action that navigates active focus external to the clinical structured report without a separate explicit voice command for the navigation externally; automatically generate a clinical structured report based on the clinical structured report template, wherein the generated clinical structured report includes modifications to the clinical structured report template based on the identified one or more key words or phrases; and generate and output executable instructions for graphical user interface display of the clinical structured report. ### Claim 26 (depends on 25) The medium of claim 25, wherein the action category further comprises one or more of dictation or macros, wherein the modifications to the clinical structured report are based on the determined action category. ### Claim 27 (depends on 26) The medium of claim 26, wherein the determined action category is dictation, wherein the executable code, when executed by the processors, further causes the processors to: identify a focus area of the one or more key words or phrases, wherein the focus area comprises one of a text area of the clinical structured data report or a smart finding associated with the medical examination points; and modify the clinical structured report based on the identified focus area. ### Claim 28 (depends on 27) The medium of claim 27, wherein the identified focus area is a text area, wherein the executable code, when executed by the processors, further causes the processors to: place the one or more key words or phrases in the text area of the clinical structured data report. ### Claim 29 (depends on 27) The medium of claim 27, wherein the identified focus area is a smart finding associated with the medical examination points, wherein the executable code, when executed by the processors, further causes the processors to: determine a finding category of the smart finding, wherein the finding category comprises one or more of a medical finding or a characteristic. ### Claim 30 (depends on 29) The medium of claim 29, wherein the finding category is a medical finding, wherein the executable code, when executed by the processors, further causes the processors to: determine whether the medical finding comprises an abnormal finding; and modify the clinical report to identify the abnormal finding when the medical finding comprises the abnormal finding. ### Claim 31 (depends on 29) The medium of claim 29, wherein the finding category is a medical finding, wherein the executable code, when executed by the processors, further causes the processors to: determine whether the medical finding comprises an identifying keyword; and insert the medical finding into the clinical structured report based on the identifying keyword. ### Claim 32 (depends on 29) The medium of claim 29, wherein the finding category is a characteristic, wherein the executable code, when executed by the processors, further causes the processors to: determine a characteristic type of the characteristic, wherein the characteristic type comprises one of an anatomy item, a text item, or a display item; and adjust the clinical structured report based on the determined characteristic type. ### Claim 33 (depends on 26) The medium of claim 26, wherein the determined category is the navigation, wherein the executable code, when executed by the processors, further causes the processors to: determine the another navigation action for the clinical structured report based on the one or more keywords; and output executable instructions to adjust the graphical user interface display of the clinical structured report based on the another navigation action. ### Claim 34 (depends on 33) The medium of claim 33, wherein the another navigation action comprises focusing on a section of the clinical structured report. ### Claim 35 (depends on 34) The medium of claim 34, wherein the another navigation action comprises the focusing on a section of the clinical structured report, wherein the executable code, when executed by the processors, further causes the processors to: determine whether the focusing relates to a smart finding associated with the medical examination points; and output executable instructions to adjust the graphical user interface display of the clinical structured report to open the smart finding when the focusing relates to the smart finding. ### Claim 36 (depends on 26) The medium of claim 26, wherein the determined action category is macros, wherein the executable code, when executed by the processors, further causes the processors to: identify one or more macros based on the one or more keywords; modify the clinical structured report based on the identified one or more macros.