# US 12,183,457 B2 · Diagnostic device for remote consultations and telemedicine

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,183,457 B2
- Document ID: US12183457B2
- Status: Granted
- Kind: B2
- Application number: 17/215,044
- Filed: 2021-03-29
- Published: 2022-01-06
- Granted: 2024-12-31
- Earliest claimed: 2020-07-04
- Assignees: Medentum Innovations Inc.
- Applicants: Medentum Innovations Inc.
- Inventors: Nicholas Cox; Grayson Martin; Christopher Owens; David Owens; Starla Kiser; Nicolle Corner; Vivek Ranjit Shinde Patil
- Web page: https://patentgrep.com/patent/US12183457B2

## CPC

- A61B 7/003: {Detecting lung or respiration noise}
- G16H 40/67: for remote operation
- A61B 1/00: Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes (examination of body cavities or body tracts using ultrasonic, sonic or infrasonic waves A61B8/12; endoscopic instruments for taking cell samples or for biopsy A61B10/04); Illuminating arrangements therefor (for the eyes A61B3/00)
- A61B 5/0013: {Medical image data (A61B1/00011, A61B6/56, A61B8/56 take precedence)}
- A61B 5/0022: {Monitoring a patient using a global network, e.g. telephone networks, internet}
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 5/0088: {for oral or dental tissue}
- A61B 5/02055: {Simultaneously evaluating both cardiovascular condition and temperature}
- A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems}
- A61B 5/7267: {involving training the classification device}
- A61B 5/742: {using visual displays (displays for heart-related electrical signals, e.g. ECG, A61B5/339)}
- A61B 5/7435: {Displaying user selection data, e.g. icons in a graphical user interface}
- A61B 5/744: {Displaying an avatar, e.g. an animated cartoon character}
- A61B 5/7465: {Arrangements for interactive communication between patient and care services, e.g. by using a telephone network (telemetry of measured physiological signal A61B5/0002)}
- A61B 7/04: Electric stethoscopes
- G16H 10/20: for electronic clinical trials or questionnaires
- G16H 10/60: for patient-specific data, e.g. for electronic patient records
- G16H 15/00: ICT specially adapted for medical reports, e.g. generation or transmission thereof
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/20: for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
- G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems
- G16H 50/30: for calculating health indices; for individual health risk assessment
- G16H 80/00: ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
- H04N 7/185: {from a mobile camera, e.g. for remote control}
- A61B 5/01: Measuring temperature of body parts {; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue} (clinical contact thermometers G01K13/20)
- A61B 5/021: Measuring pressure in heart or blood vessels
- A61B 5/02438: {with portable devices, e.g. worn by the patient}
- A61B 5/0245: by using sensing means generating electric signals, {i.e. ECG signals}
- A61B 5/0816: {Measuring devices for examining respiratory frequency (measuring frequency of electric signals G01R23/00)}
- A61B 5/14551: {for measuring blood gases}
- A61B 5/14552: {Details of sensors specially adapted therefor}
- A61B 5/332: Portable devices specially adapted therefor
- A61B 2560/0425: Ergonomically shaped housings (A61B2560/0418 takes precedence)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of obtaining a clinical assessment of a user of a user device may include obtaining, by the user device and from a hand-held diagnostic device configured to communicate with the user device, first diagnostic information of the user obtained by one or more sensors of the hand-held diagnostic device; obtaining, by the user device, second diagnostic information based on a user input of the second diagnostic information via the user device; obtaining, by the user device and using an artificial intelligence (AI) model, the clinical assessment based on the first diagnostic information and the second diagnostic information; and displaying, by the user device, the clinical assessment to permit the user to visualize the clinical assessment.

## Claims

### Claim 1

A method of obtaining a clinical assessment of a user by a user device in communication with a hand-held diagnostic device comprising a wireless transceiver, a battery, and sensors including an endoscopic camera, a pulse oximeter, a temperature sensor, and a stethoscope, wherein the endoscopic camera comprises a lens, a photo tube configured to be inserted in the user's mouth, and an imaging sensor, the method comprising:
capturing, by the hand-held diagnostic device, imaging of a user's organs using at least one sensor in the hand-held diagnostic device, wherein the at least one sensor in the hand-held diagnostics device comprises the endoscopic camera and capturing the imaging of the user's organs is in real time;
streaming, by the hand-held diagnostic device, the imaging of the user's organs to the user device, wherein the streaming of the imaging of the user's organs is in real time;
visually displaying, by the user device, the imaging of the user's organs, wherein the visual displaying of the imaging of the user's organs is in real-time and enables remote viewing of the imaging of the user's organs that is captured by the hand-held diagnostic device in real-time;
receiving, by the user device, input from the user selecting a portion of the imaging of the user's organs as a first set of diagnostic information of the user, wherein the input is in response to the visual displaying and the remote viewing of the imaging of the user's organs in real-time;
measuring, by the hand-held diagnostic device, body signals using sensors in the hand-held diagnostics device, wherein the body signals of the user comprise at least one body sound;
obtaining, by the user device from the hand-held diagnostic device, the first set of diagnostic information of the user, wherein the first set of diagnostic information of the user comprises the portion of the imaging of the user's organs captured by the hand-held diagnostic device and the body signals measured by the hand-held diagnostic device;
obtaining, by the user device, a second set of diagnostic information comprising a set of clinical information comprising the user's (i) symptoms, (ii) medical history, and (iii) demographics;
obtaining, by the user device, input data indicating whether to provide the first set of diagnostic information and the second set of diagnostic information to generate the clinical assessment by a second user of a remote user device or to generate the clinical assessment by an artificial intelligence model;
in response to receiving the input data indicating to generate the clinical assessment by an artificial intelligence model, inputting, by the user device, the first set of diagnostic information and the second set of diagnostic information into the artificial intelligence model, the artificial intelligence model trained using the plurality of body signals and the set of clinical information obtained by the user device;
obtaining, using the trained artificial intelligence model, the clinical assessment of the user based on the plurality of body signals comprising at least one body sound; and
visually displaying, on the user device in communication with the hand-held diagnostic device, the clinical assessment.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
receiving, by the user device in communication with the hand-held diagnostic device, the imaging of the user's organs streamed from the hand-held diagnostic device, wherein the imaging of the user's organs comprises video captured by the endoscopic camera of the hand-held diagnostic device, based on the user manipulating the hand-held diagnostic device to obtain an image of a body part of the user; and
visually displaying, by the user device in communication with the hand-held diagnostic device, in real time, the video captured by the endoscopic camera of the hand-held diagnostic device, wherein the visual displaying enables remote viewing of the video to permit the user to place the hand-held diagnostic device in proximity to the body part of the user while remotely viewing the video via the user device.

### Claim 3 (depends on 1)

The method of claim 1, wherein the first set of diagnostic information further includes video information of the user.

### Claim 4 (depends on 1)

The method of claim 1, wherein measuring, by the hand-held diagnostic device, the body signals of the user further includes measuring additional body signals comprising one or more of: a temperature of the user using the temperature sensor, an oxygen saturation of the user using the pulse oximeter sensor, respiration rate of the user, an electrocardiogram (ECG) of the user, a blood pressure of the user, or a heart rate of the user.

### Claim 5 (depends on 1)

The method of claim 1, further comprising:
in response to receiving the input data indicating to generate the clinical assessment by the second user of a remote user device, providing, by the user device in communication with the hand-held diagnostic device and to a server, the first set of diagnostic information and the second set of diagnostic information to a remote user device, associated with the second user, to obtain the first set of diagnostic information and the second set of diagnostic information, wherein the second user is a physician and generates the clinical assessment; and
obtaining, from the remote user device in communication with the user device and the server, the clinical assessment by the second user of a remote user device.

### Claim 6

A system comprising:
a hand-held diagnostic device comprising a wireless transceiver, a battery, and sensors including an endoscopic camera, a pulse oximeter, a temperature sensor, and a stethoscope, the hand-held diagnostic device in communication with a user device and configured to:
capture, in real time, imaging of a user's organs using at least one sensor, wherein the at least one sensor comprises the endoscopic camera;
stream, in real-time, the imaging of the user's organs to the user device;
measure body signals using the sensors, wherein the body signals of the user comprise at least one body sound; and
the user device, wherein the user device is configured to obtain a clinical assessment of a user, the user device comprising:
a memory configured to store instructions; and
a processor configured to execute the instructions to:
control a display of the user device to visually display, in real-time, the imaging of the user's organs, wherein the visual displaying of the imaging of the user's organs enables remote viewing of the imaging of the user's organs that is captured by the hand-held diagnostic device in real-time;
receive input from the user selecting a portion of the imaging of the user's organs as a first set of diagnostic information of the user, wherein the input is in response to the visual displaying and the remote viewing of the imaging of the user's organs in real-time;
obtain, from the hand-held diagnostic device in communication with the user device, the first diagnostic information of the user, wherein the first set of diagnostic information of the user comprises the portion of the imaging of the user's organs captured by the hand-held diagnostic device and the body signals measured by the hand-held diagnostic device;
obtain, by the user device, second diagnostic information comprising clinical information comprising the user's: (i) symptoms, (ii) medial history, and (iii) demographics;
obtain, by the user device, input data indicating whether to provide the first diagnostic information and the second diagnostic information to generate the clinical assessment by a second user of a remote user device or to generate the clinical assessment by an artificial intelligence model;
in response to receiving the input data indicating to generate the clinical assessment by an artificial intelligence model, input the first diagnostic information and second diagnostic information obtained in the prior steps, into the artificial intelligence model trained using the plurality of body signals and the clinical information, wherein at least one body signal is a body sound;
obtain, on the user device in communication with the hand-held diagnostic device, the clinical assessment of the user from the trained artificial intelligence model, wherein the plurality of body signals obtained by the sensors of the hand-held diagnostic device and the clinical information of the user are obtained via the user device; and
control the display of the user device in communication with the hand-held diagnostic device to visually display the clinical assessment to the user.

### Claim 7 (depends on 6)

The system of claim 6, wherein the user device comprises the processor that is further configured to:
receive the imaging of the user's organs streamed from the hand-held diagnostic device, wherein the imaging of the user's organs comprises video captured by the endoscopic camera of the hand-held diagnostic device, based on the user manipulating the hand-held diagnostic device to obtain an image of a body part of the user; and
control the display to visually display, in real time, the video captured by the endoscopic camera of the hand-held diagnostic device, wherein the visual displaying enables remote viewing of the video to permit the user to place the hand-held diagnostic device in proximity to the body part of the user while remotely viewing the video via the user device in communication with the hand-held diagnostic device.

### Claim 8 (depends on 6)

The system of claim 6, wherein the first diagnostic information further includes video information of the user.

### Claim 9 (depends on 6)

The system of claim 6, wherein the hand-held diagnostic device further measures additional body signals of the user comprising one or more of: a temperature of the user using the temperature sensor, an oxygen saturation of the user using the pulse oximeter sensor, a respiration rate of the user, an electrocardiogram (ECG) of the user, a blood pressure of the user, or a heart rate of the user.

### Claim 10 (depends on 6)

The system of claim 6, wherein the user device comprises the processor that is further configured to: in response to receiving the input data indicating to generate the clinical assessment by the second user of a remote user device, provide, to a server, the first diagnostic information and the second diagnostic information to a remote user device in communication with the server, associated with the second user to obtain the first diagnostic information and the second diagnostic information, wherein the second user is a physician and generates the clinical assessment; and
obtain, from the remote user device in communication with the server, the clinical assessment by the second user of the remote user device.

### Claim 11

A non-transitory computer-readable medium storing instructions, the instructions comprising: instructions that, when executed by one or more processors of a system, causes the one or more processor to:
capture, by a hand-held diagnostic device in communication with a user device, imaging of a user's organs using sensors in the hand-held diagnostic device, wherein the hand-held diagnostic device comprises a wireless transceiver, a battery, and sensors including an endoscopic camera, a pulse oximeter, a temperature sensor, and a stethoscope, and is configured to obtain a clinical assessment of a user and capturing the imaging of the user's organs is in real time;
stream, by the hand-held diagnostic device, the imaging of the user's organs to the user device, wherein the streaming of the imaging of the user's organs is in real time;
visually display, by the user device, the imaging of the user's organs, wherein the visual displaying of the imaging of the user's organs is in real-time and enables remote viewing of the imaging of the user's organs that is captured by the hand-held diagnostic device in real-time;
receive, by the user device, input from the user selecting a portion of the imaging of the user's organs as a first set of diagnostic information of the user, wherein the input is in response to the visual displaying and the remote viewing of the imaging of the user's organs in real-time;
measure, by the hand-held diagnostic device, body signals using sensors in the hand-held diagnostics device, wherein the body signals of the user comprise at least one body sound;
obtain, from the hand-held diagnostic device in communication with the user device, the first diagnostic information of the user, wherein the first set of diagnostic information of the user comprises the portion of the imaging of the user's organs captured by the hand-held diagnostic device and the body signals measured by the hand-held diagnostic device;
obtain, from the hand-held diagnostic device, second diagnostic information comprising clinical information comprising one or more of the user's: (i) symptoms, (ii) medical history and (iii) demographics;
obtain, by the user device, input data indicating whether to provide the first diagnostic information and the second diagnostic information to generate the clinical assessment by a second user of a remote user device or to generate the clinical assessment by an artificial intelligence model;
in response to receiving the input data indicating to generate the clinical assessment by an artificial intelligence model, input the first diagnostic information and second diagnostic information into the artificial intelligence model, the artificial intelligence model trained using the plurality of body signals and the clinical information;
obtain the clinical assessment of the user from the trained artificial intelligence model, the plurality of body signals obtained by the sensors and the clinical information of the user obtained by the user device input into the artificial intelligence model; and
control a display of the user device to visually display the clinical assessment to the user.

### Claim 12 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the one or more instructions further cause the one or more processors to:
receive, from the hand-held diagnostic device, the imaging of the user's organs streamed from the hand-held diagnostic device, wherein the imaging of the user's organs comprises video captured by the endoscopic camera of the hand-held diagnostic device, based on the user manipulating the hand-held diagnostic device to obtain an image of a body part of the user; and
control the display to visually display, in real time, the video captured by the endoscopic camera of the hand-held diagnostic device, wherein the visual displaying enables remote viewing of the video to permit the user to place the hand-held diagnostic device in proximity to the body part of the user while remotely viewing the video via the user device.

### Claim 13 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the first diagnostic information further includes video information of the user.

### Claim 14 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the body signals of the user further include a temperature of the user, an oxygen saturation of the user, a respiration rate of the user, an electrocardiogram (ECG) of the user, a blood pressure of the user, or a heart rate of the user.

### Claim 15 (depends on 1)

The method of claim 1, wherein the hand-held diagnostic device further comprises at least one of a microphone, a digital stethoscope, a variable focus camera, an infrared temperature sensor, an EKG sensor, or a blood pressure sensor.

### Claim 16 (depends on 1)

The method of claim 1, wherein the hand-held diagnostic device includes at least one of a microphone, an EKG sensor, an infrared temperature sensor, or a blood pressure sensor.

### Claim 17 (depends on 15)

The method of claim 15, wherein the hand-held diagnostic device incorporates a detector that includes one or more photodetectors and offers colorimetric readouts.

### Claim 18 (depends on 17)

The method of claim 17, wherein the detector can detect light or colorimetric changes from an accompanying single-use chip or wafer pre-loaded with material-based nanoparticles that can bind to infectious agents, body fluids, or hormones.

### Claim 19 (depends on 17)

The method of claim 17, wherein the hand-held diagnostic device further comprises a stand-alone separate housing chamber in which a chip or wafer, a reagent, and test accessories are incorporated.

### Claim 20 (depends on 19)

The method of claim 19, wherein the chip or wafer provides at least one of a fluorescent or bioluminescent optical readout or a colorimetric readout.

### Claim 21 (depends on 20)

The method of claim 20, wherein the reagent is in a liquid format or in a dissolvable lyophilized dried powder format.

### Claim 22 (depends on 20)

The method of claim 20, wherein the stand-alone separate housing chamber is sealed to prevent contamination and tampering.

### Claim 23 (depends on 1)

The method of claim 1, wherein the first diagnostic information includes test measurements regarding a body fluid sample of the user.

### Claim 24 (depends on 1)

The method of claim 1, wherein the at least one body sound includes recorded sounds of user breathing, heartbeat, or stomach.

### Claim 25 (depends on 1)

The method of claim 1, wherein the endoscopic camera is configured to image at a focal distance in a range of 20 mm to 100 mm.

### Claim 26 (depends on 11)

The non-transitory computer-readable medium of claim 11, wherein the one or more instructions further cause the one or more processors to:
in response to receiving the input data indicating to generate the clinical assessment by the second user of the remote user device, provide, to a server, the first diagnostic information and the second diagnostic information to the remote user device in communication with the server, associated with the second user, to obtain the first diagnostic information and the second diagnostic information, wherein the second user is a physician and generates the clinical assessment; and
obtain, from the remote user device in communication with the server, the clinical assessment by the second user of the remote user device.