# US 2021/0243412 A1 · Automated Clinical Documentation System and Method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243412 A1 - Document ID: US20210243412A1 - Status: Published application - Kind: A1 - Application number: 17/210,253 - Filed: 2021-03-23 - Published: 2021-08-05 - Earliest claimed: 2017-08-10 - Applicants: Nuance Communications, Inc. - Inventors: Donald E. Owen; Garret N. Erskine; Mehmet Mert Öz; Uwe Helmut Jost; Daniel Paulino Almendro Barreda; Dushyant Sharma; Guido Remi Marcel Gallopyn; Amr Nour-Eldin; Patrick A. Naylor - Web page: https://patentgrep.com/patent/US20210243412A1 ## CPC - G06F 40/174: Form filling; Merging - G10L 15/26: Speech to text systems (G10L15/08 takes precedence) - G06F 21/6218: {to a system of files or objects, e.g. local or distributed file system or database} - G06F 40/106: Display of layout of documents; Previewing - G06F 40/131: Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces - G06F 40/169: Annotation, e.g. comment data or footnotes - G06F 40/197: Version control (for software G06F8/71) - G06F 40/247: Thesauruses; Synonyms - G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] - G06N 5/027: {Frames} - G06N 5/04: Inference or reasoning models - G06Q 30/0201: Market modelling; Market analysis; Collecting market data - G06V 40/103: {Static body considered as a whole, e.g. static pedestrian or occupant recognition} - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G16H 10/20: for electronic clinical trials or questionnaires - G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring - H04L 51/214: using selective forwarding - H04L 51/222: using geographical location information, e.g. messages transmitted or received in proximity of a certain spot or area - H04R 3/005: {for combining the signals of two or more microphones (specially adapted for hearing aids H04R25/407)} - G06F 21/6245: {Protecting personal data, e.g. for financial or medical purposes} - G06N 20/00: Machine learning - G06Q 30/018: Certifying business or products - G16H 10/60: for patient-specific data, e.g. for electronic patient records - G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms - H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission} - H04N 7/181: {for receiving images from a plurality of remote sources} - H04R 1/08: Mouthpieces; {Microphones;} Attachments therefor - H04R 1/406: {microphones} - H04R 3/12: for distributing signals to two or more loudspeakers {(specially adapted for hearing aids H04R25/407)} - H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04S: STEREOPHONIC SYSTEMS ## Abstract A computer-implemented method, computer program product, and computing system for rendering content is executed on a computing device and includes receiving a request to render content during a user encounter. If it is determined that the content includes sensitive content, a complete version of the content is rendered on a first device (wherein the complete version of the content includes the sensitive content) and a limited version of the content on a second device (wherein the limited version of the content excludes the sensitive content). A modular ACD system is configured to automate clinical documentation and includes a machine vision system configured to obtain machine vision encounter information concerning a user encounter. An audio recording system is configured to obtain audio encounter information concerning the user encounter. A compute system is configured to receive the machine vision encounter information and the audio encounter information. A computer-implemented method, computer program product, and computing system for automating diarization is executed on a computing device and includes obtaining encounter information of a user encounter. The encounter information is processed to: associate a first portion of the encounter information with a first encounter participant, and associate at least a second portion of the encounter information with at least a second encounter participant. An encounter transcript is generated based, at least in part, upon the first portion of the encounter information and the at least a second portion of the encounter information. A computer-implemented method, computer program product, and computing system for automating role assignment is executed on a computing device and includes obtaining encounter information of a user encounter. The encounter information is processed to associate a first portion of the encounter information with a first encounter participant. A first role is assigned to the first encounter participant. ## Claims ### Claim 1 A computer-implemented method for rendering content, executed on a computing device, comprising: receiving a request to render content during a user encounter; determining if the content includes sensitive content; and if the content includes sensitive content, rendering: a complete version of the content on a first device, wherein the complete version of the content includes the sensitive content, and a limited version of the content on a second device, wherein the limited version of the content excludes the sensitive content). ### Claim 2 (depends on 1) The computer-implemented method of claim 1 wherein the user encounter includes one or more of: a financial encounter; a life coach encounter; a legal encounter; a telecom encounter; a retail encounter; and a business encounter. ### Claim 3 (depends on 1) The computer-implemented method of claim 1 wherein the content includes one or more of: financial content; life coach content; legal content; telecom content; retail content; and business content. ### Claim 4 (depends on 1) The computer-implemented method of claim 1 wherein the computer-implemented method is executed within one or more of: a financial environment; a life coach environment; a legal environment; a telecom environment; a retail environment; and a business environment. ### Claim 5 (depends on 1) The computer-implemented method of claim 1 wherein the first device is a private device available only to one or more professionals of the user encounter. ### Claim 6 (depends on 5) The computer-implemented method of claim 5 wherein the private device is a visual private device. ### Claim 7 (depends on 5) The computer-implemented method of claim 5 wherein the private device is an audible private device. ### Claim 8 (depends on 1) The computer-implemented method of claim 1 wherein the second device is a public device available to all encounter participants of the user encounter. ### Claim 9 (depends on 1) The computer-implemented method of claim 1 wherein the second device is a visual public device. ### Claim 10 A modular ACD system, configured to automate clinical documentation, comprising: a machine vision system configured to obtain machine vision encounter information concerning a user encounter; an audio recording system is configured to obtain audio encounter information concerning the user encounter; and a compute system is configured to receive the machine vision encounter information and the audio encounter information. ### Claim 11 (depends on 10) The computer-implemented method of claim 10 wherein the user encounter includes one or more of: a financial encounter; a life coach encounter; a legal encounter; a telecom encounter; a retail encounter; and a business encounter. ### Claim 12 (depends on 10) The computer-implemented method of claim 10 wherein the encounter information includes one or more of: financial information; life coach information; legal information; telecom information; retail information; and business information. ### Claim 13 (depends on 10) The modular ACD system of claim 10 wherein the modular ACD system is installed within: a financial environment; a life coach environment; a legal environment; a telecom environment; a retail environment; and a business environment. ### Claim 14 (depends on 10) The modular ACD system of claim 10 wherein the audio recording system includes: a directional microphone array that includes a plurality of discrete microphone assemblies. ### Claim 15 (depends on 10) The modular ACD system of claim 10 wherein the machine vision system includes one or more of: an RGB imaging system; an infrared imaging system; an ultraviolet imaging system; a laser imaging system; an X-ray imaging system; a SONAR imaging system; a RADAR imaging system; and a thermal imaging system. ### Claim 16 (depends on 10) The modular ACD system of claim 10 wherein the audio recording system includes: a plurality of discrete audio acquisition devices. ### Claim 17 (depends on 16) The modular ACD system of claim 16 wherein the modular ACD system is configured to form one or more audio recording beams via the discrete audio acquisition devices included within the audio recording system. ### Claim 18 A computer-implemented method for automating diarization, executed on a computing device, comprising: obtaining encounter information of a user encounter; processing the encounter information to: associate a first portion of the encounter information with a first encounter participant, and associate at least a second portion of the encounter information with at least a second encounter participant; and generating an encounter transcript based, at least in part, upon the first portion of the encounter information and the at least a second portion of the encounter information. ### Claim 19 (depends on 18) The computer-implemented method of claim 18 wherein the user encounter includes one or more of: a financial encounter; a life coach encounter; a legal encounter; a telecom encounter; a retail encounter; and a business encounter. ### Claim 20 (depends on 18) The computer-implemented method of claim 18 wherein the encounter information includes one or more of: financial information; life coach information; legal information; telecom information; retail information; and business information. ### Claim 21 (depends on 18) The computer-implemented method of claim 18 wherein the computer-implemented method is executed within one or more of: a financial environment; a life coach environment; a legal environment; a telecom environment; a retail environment; and a business environment. ### Claim 22 (depends on 18) The computer-implemented method of claim 18 wherein the encounter information includes: machine vision encounter information obtained via one or more machine vision systems. ### Claim 23 (depends on 22) The computer-implemented method of claim 22 wherein the one or more machine vision systems includes one or more of: an RGB imaging system; an infrared imaging system; an ultraviolet imaging system; a laser imaging system; an X-ray imaging system; a SONAR imaging system; a RADAR imaging system; and a thermal imaging system. ### Claim 24 (depends on 18) The computer-implemented method of claim 18 wherein the encounter information includes: audio encounter information obtained via one or more audio sensors. ### Claim 25 A computer-implemented method for automating role assignment, executed on a computing device, comprising: obtaining encounter information of a user encounter; processing the encounter information to associate a first portion of the encounter information with a first encounter participant; and assigning a first role to the first encounter participant. ### Claim 26 (depends on 25) The computer-implemented method of claim 25 wherein the user encounter includes one or more of: a financial encounter; a life coach encounter; a legal encounter; a telecom encounter; a retail encounter; and a business encounter. ### Claim 27 (depends on 25) The computer-implemented method of claim 25 wherein the encounter information includes one or more of: financial information; life coach information; legal information; telecom information; retail information; and business information. ### Claim 28 (depends on 25) The computer-implemented method of claim 25 wherein the computer-implemented method is executed within one or more of: a financial environment; a life coach environment; a legal environment; a telecom environment; a retail environment; and a business environment. ### Claim 29 (depends on 25) The computer-implemented method of claim 25 wherein the encounter information includes machine vision encounter information obtained via one or more machine vision systems. ### Claim 30 (depends on 29) The computer-implemented method of claim 29 wherein processing the encounter information to associate the first portion of the encounter information with the first encounter participant includes: processing the encounter information to associate a first portion of the machine vision encounter information with the first encounter participant. ### Claim 31 (depends on 29) The computer-implemented method of claim 29 wherein the one or more machine vision systems includes one or more of: an RGB imaging system; an infrared imaging system; an ultraviolet imaging system; a laser imaging system; an X-ray imaging system; a SONAR imaging system; a RADAR imaging system; and a thermal imaging system.