# US 11,309,081 B2 · Telemedicine system with dynamic imaging > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,309,081 B2 - Document ID: US11309081B2 - Status: Granted - Kind: B2 - Application number: 16/666,230 - Filed: 2019-10-28 - Published: 2020-02-27 - Granted: 2022-04-19 - Earliest claimed: 2010-10-13 - Applicants: Gholam A. Peyman - Inventors: Gholam A. Peyman - Web page: https://patentgrep.com/patent/US11309081B2 ## CPC - G16H 40/67: for remote operation - A61B 5/0066: {Optical coherence imaging} - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 5/0095: {by applying light and detecting acoustic waves, i.e. photoacoustic measurements} - A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20) - A61B 5/1112: {Global tracking of patients, e.g. by using GPS} - A61B 5/1172: using fingerprinting - A61B 5/1176: {Recognition of faces} - A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety} - A61B 5/441: {Skin evaluation, e.g. for skin disorder diagnosis} - A61B 5/4836: {Diagnosis combined with treatment in closed-loop systems or methods (A61B5/0036 takes precedence)} - A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems} - A61B 5/7275: {Determining trends in physiological measurement data; Predicting development of a medical condition based on physiological measurements, e.g. determining a risk factor} - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 20/00: Machine learning - G06V 30/36: {Matching; Classification} - G06V 40/13: Sensors therefor - G06V 40/1365: {Matching; Classification} - G06V 40/1371: {Matching features related to minutiae or pores} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - G06V 40/172: {Classification, e.g. identification} - G16H 10/60: for patient-specific data, e.g. for electronic patient records - G16H 20/40: relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - A61B 2562/0204: Acoustic sensors - G06N 3/044: Recurrent networks, e.g. Hopfield networks - G06N 3/045: Combinations of networks - G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88) - G06V 40/14: Vascular patterns - G06V 2201/03: Recognition of patterns in medical or anatomical images - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A telemedicine system with dynamic imaging is disclosed herein. In some embodiments, the telemedicine system comprises a laser imaging and treatment apparatus, and associated systems and methods that allow a physician (e.g., a surgeon) to perform laser surgical procedures on an eye structure or a body surface with a laser imaging and treatment apparatus disposed at a first (i.e. local) location from a control system disposed at a second (i.e. remote) location, e.g., a physician's office. Also, in some embodiments, communication between the laser imaging and treatment apparatus and control system is achieved via the Internet®. Further, in some embodiments, the telemedicine system includes a dynamic imaging system and/or a facial recognition system that verifies the identity of a patient, and is capable of being used for other important applications, such as tracking and analyzing trends in a disease process. ## Claims ### Claim 1 A telemedicine system with dynamic imaging, comprising: a local control system disposed at a first location and a central control system disposed at a remote site, said remote site being at a second location, said local control system being operatively coupled to said central control system by means of a computer network; said local control system including a first computing device with a first processor, a local control module, and a dynamic imaging system; said central control system including a second computing device with a second processor and a remote control module; said dynamic imaging system including an imaging device operatively coupled to said first computing device, said imaging device configured to capture images of a body portion of a patient over a predetermined duration of time so that a displacement of said body portion of said patient is capable of being tracked during said predetermined duration of time, said captured images including an initial captured image containing first image data that is produced without requesting said patient to perform any task, and said captured images further including a subsequent captured image containing second image data that is produced as a result of said patient being instructed to perform a task that induces one or more detectable physical and physiological changes in said body portion of said patient, said first computing device being programmed to determine said displacement of said body portion of said patient over said predetermined duration of time using said captured images, and to compare said displacement of said body portion of said patient over said predetermined duration of time to a reference displacement of said body portion of said patient acquired prior to said displacement so that a plurality of induced physical and physiological dynamic changes in said body portion of said patient are capable of being assessed for the purpose of identifying said patient or evaluating physiological changes in said body portion, and said first computing device being further programmed to compare using a subtraction algorithm said plurality of induced physical and physiological dynamic changes to said body portion of said patient captured by said imaging device at a first time to said plurality of induced physical and physiological dynamic changes to said body portion of said patient captured by said imaging device at a second subsequent time, and to determine if said plurality of induced physical and physiological dynamic changes captured by said imaging device at said first time substantially matches said plurality of induced physical and physiological dynamic changes to said body portion of said patient captured by said imaging device at said second subsequent time so as to verify the identity of said patient; wherein the body portion is a face and the subtraction algorithm eliminates unchanged parts of the face, while maintaining changed parts of the face to enhance the processing speed. ### Claim 2 (depends on 1) The telemedicine system according to claim 1, wherein said imaging device of said dynamic imaging system is in the form of a light field camera. ### Claim 3 (depends on 1) The telemedicine system according to claim 1, wherein said dynamic imaging system is in the form of a dynamic facial recognition system, and wherein the face or a portion of the face of said patient is imaged in a two-dimensional or three-dimensional manner. ### Claim 4 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is further programmed to reconstruct a complete face from the portion of the face captured by the dynamic facial recognition system using artificial intelligence and/or a machine learning algorithm. ### Claim 5 (depends on 3) The telemedicine system according to claim 3, wherein said dynamic imaging system further comprises a fingerprint sensor configured to capture multispectral images of a finger of said patient, said first computing device being specially programmed to determine surface features and subsurface features of said finger of said patient using said multispectral images. ### Claim 6 (depends on 3) The telemedicine system according to claim 3, wherein said dynamic imaging system further comprises a handwriting recognition sensor configured to capture handwriting of said patient, said first computing device being specially programmed to determine an identity of said patient based upon said handwriting of said patient captured by said handwriting recognition sensor. ### Claim 7 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is further programmed to utilize a fuzzy logic mathematical algorithm in order to differentiate an identity of two similar images captured by said dynamic facial recognition system. ### Claim 8 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is further programmed to add or subtract features from the face of said patient captured by said dynamic facial recognition system in order to facilitate the identity recognition of said patient when an appearance of said patient changes over time, said added or subtracted features selected from the group consisting of addition of hair, removal of hair, addition of facial hair, removal of facial hair, addition of jewelry, removal of jewelry, addition of eyewear, and removal of eyewear. ### Claim 9 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is further programmed to change features of the face of said patient captured by said dynamic facial recognition system in order to facilitate the identity recognition of said patient when an appearance of said patient changes over time, said changed features selected from the group consisting of skin color, hair color, eye color, presence or absence of hair, presence or absence of facial hair, presence or absence of jewelry, and presence or absence of eyewear. ### Claim 10 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is programmed to compare one or more first reference digital images of said patient captured by said imaging device of said dynamic facial recognition system at a first time to one or more second digital images of said patient captured by said imaging device of said dynamic facial recognition system at a second subsequent time using stable features of the face of said patient, and to determine if said one or more second digital images of said patient substantially matches said one or more first reference digital images of said patient, said stable features selected from the group consisting of a nose position, an eye position, a mouth position, spacing between eyes, spacing between the nose and one or more of the eyes, spacing between the nose and the mouth, eye features, nose features, mouth features, ear features, and geometric facial features. ### Claim 11 (depends on 3) The telemedicine system according to claim 3, wherein said first computing device is further programmed to change emotionally affected features on an image of the face of said patient captured by said dynamic facial recognition system in order to facilitate the identity recognition of said patient when an emotional state of said patient is different. ### Claim 12 (depends on 1) The telemedicine system according to claim 1, wherein said changed parts of said face of said patient for which said displacement is determined comprises a mouth of said patient; and wherein said telemedicine system further comprises a voice recognition sensor configured to capture speech waveforms generated by said patient so that said speech waveforms are capable of being correlated with a mouth configuration of said patient generated from said captured images acquired using said imaging device, thereby enabling both audial and visual attributes of said patient to be taken into account for identification purposes. ### Claim 13 (depends on 1) The telemedicine system according to claim 1, wherein said imaging device of said dynamic imaging system is in the form of a multispectral camera or hyperspectral camera configured to capture multispectral or hyperspectral images of said body portion of said patient so that surface features and subsurface features of said body portion of said patient are capable of being analyzed. ### Claim 14 (depends on 13) The telemedicine system according to claim 13, wherein said first computing device is operatively coupled to a visual display device and one or more speakers, said first computing device being programmed to display a range of images and/or videos on said visual display device and/or play a variety of different sounds on said one or more speakers to evoke different emotional states of said patient, and said first computing device being further programmed to record dynamic changes in said body portion of said patient with said multispectral camera or hyperspectral camera while evoking the different emotional states of said patient so that a response of said patient to said different emotional states is able to be analyzed. ### Claim 15 A telemedicine system with dynamic imaging, comprising: a local control system disposed at a first location and a central control system disposed at a remote site, said remote site being at a second location, said local control system being operatively coupled to said central control system by means of a computer network; said local control system including a first computing device with a first processor, a local control module, and a facial recognition system; said central control system including a second computing device with a second processor and a remote control module; said facial recognition system including an imaging device operatively coupled to said first computing device, said imaging device configured to capture one or more images of a face of a patient, said captured images including an initial captured image containing first image data that is produced without requesting said patient to perform any task, and said captured images further including a subsequent captured image containing second image data that is produced as a result of said patient being instructed to perform a task that induces one or more detectable physical and physiological changes in said face of said patient, said first computing device being programmed to compare using a subtraction algorithm said plurality of induced physical and physiological dynamic changes to said face of said patient captured by said imaging device of said facial recognition system at a first time to said plurality of induced physical and physiological dynamic changes to said face of said patient captured by said imaging device of said facial recognition system at a second subsequent time, and to determine if said plurality of induced physical and physiological dynamic changes captured by said imaging device at said first time substantially matches said plurality of induced physical and physiological dynamic changes to said face of said patient captured by said imaging device at said second subsequent time so as to verify the identity of said patient; wherein the subtraction algorithm eliminates unchanged parts of the face, while maintaining changed parts of the face to enhance the processing speed. ### Claim 16 (depends on 15) The telemedicine system according to claim 15, wherein said first computing device is further programmed to receive consent from said patient for telemedicine communication by receipt of verbal confirmation, a confirmatory head motion, a confirmatory hand motion, a confirmatory eye motion, and/or by receipt of a fingerprint from said patient.