Diagnostic device for remote consultations and telemedicine

A system comprising:

• a hand-held diagnostic device comprising a wireless transceiver, a battery, and sensors including an endoscopic camera, a pulse oximeter, a temperature sensor, and a stethoscope, the hand-held diagnostic device in communication with a user device and configured to:
• capture, in real time, imaging of a user's organs using at least one sensor, wherein the at least one sensor comprises the endoscopic camera;
• stream, in real-time, the imaging of the user's organs to the user device;
• measure body signals using the sensors, wherein the body signals of the user comprise at least one body sound;
• and
• the user device, wherein the user device is configured to obtain a clinical assessment of a user, the user device comprising:
• a memory configured to store instructions;
• and
• a processor configured to execute the instructions to:
• control a display of the user device to visually display, in real-time, the imaging of the user's organs, wherein the visual displaying of the imaging of the user's organs enables remote viewing of the imaging of the user's organs that is captured by the hand-held diagnostic device in real-time;
• receive input from the user selecting a portion of the imaging of the user's organs as a first set of diagnostic information of the user, wherein the input is in response to the visual displaying and the remote viewing of the imaging of the user's organs in real-time;
• obtain, from the hand-held diagnostic device in communication with the user device, the first diagnostic information of the user, wherein the first set of diagnostic information of the user comprises the portion of the imaging of the user's organs captured by the hand-held diagnostic device and the body signals measured by the hand-held diagnostic device;
• obtain, by the user device, second diagnostic information comprising clinical information comprising the user's:
• (i) symptoms, (ii) medial history, and (iii) demographics;
• obtain, by the user device, input data indicating whether to provide the first diagnostic information and the second diagnostic information to generate the clinical assessment by a second user of a remote user device or to generate the clinical assessment by an artificial intelligence model;
• in response to receiving the input data indicating to generate the clinical assessment by an artificial intelligence model, input the first diagnostic information and second diagnostic information obtained in the prior steps, into the artificial intelligence model trained using the plurality of body signals and the clinical information, wherein at least one body signal is a body sound;
• obtain, on the user device in communication with the hand-held diagnostic device, the clinical assessment of the user from the trained artificial intelligence model, wherein the plurality of body signals obtained by the sensors of the hand-held diagnostic device and the clinical information of the user are obtained via the user device;
• and
• control the display of the user device in communication with the hand-held diagnostic device to visually display the clinical assessment to the user.

A non-transitory computer-readable medium storing instructions, the instructions comprising:

• instructions that, when executed by one or more processors of a system, causes the one or more processor to:
• capture, by a hand-held diagnostic device in communication with a user device, imaging of a user's organs using sensors in the hand-held diagnostic device, wherein the hand-held diagnostic device comprises a wireless transceiver, a battery, and sensors including an endoscopic camera, a pulse oximeter, a temperature sensor, and a stethoscope, and is configured to obtain a clinical assessment of a user and capturing the imaging of the user's organs is in real time;
• stream, by the hand-held diagnostic device, the imaging of the user's organs to the user device, wherein the streaming of the imaging of the user's organs is in real time;
• visually display, by the user device, the imaging of the user's organs, wherein the visual displaying of the imaging of the user's organs is in real-time and enables remote viewing of the imaging of the user's organs that is captured by the hand-held diagnostic device in real-time;
• receive, by the user device, input from the user selecting a portion of the imaging of the user's organs as a first set of diagnostic information of the user, wherein the input is in response to the visual displaying and the remote viewing of the imaging of the user's organs in real-time;
• measure, by the hand-held diagnostic device, body signals using sensors in the hand-held diagnostics device, wherein the body signals of the user comprise at least one body sound;
• obtain, from the hand-held diagnostic device in communication with the user device, the first diagnostic information of the user, wherein the first set of diagnostic information of the user comprises the portion of the imaging of the user's organs captured by the hand-held diagnostic device and the body signals measured by the hand-held diagnostic device;
• obtain, from the hand-held diagnostic device, second diagnostic information comprising clinical information comprising one or more of the user's:
• (i) symptoms, (ii) medical history and (iii) demographics;
• obtain, by the user device, input data indicating whether to provide the first diagnostic information and the second diagnostic information to generate the clinical assessment by a second user of a remote user device or to generate the clinical assessment by an artificial intelligence model;
• in response to receiving the input data indicating to generate the clinical assessment by an artificial intelligence model, input the first diagnostic information and second diagnostic information into the artificial intelligence model, the artificial intelligence model trained using the plurality of body signals and the clinical information;
• obtain the clinical assessment of the user from the trained artificial intelligence model, the plurality of body signals obtained by the sensors and the clinical information of the user obtained by the user device input into the artificial intelligence model;
• and
• control a display of the user device to visually display the clinical assessment to the user.