# US 10,945,637 B2 · Image based jaundice diagnosing method and apparatus and image based jaundice diagnosis assisting apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,945,637 B2 - Document ID: US10945637B2 - Status: Granted - Kind: B2 - Application number: 15/855,504 - Filed: 2017-12-27 - Published: 2018-06-28 - Granted: 2021-03-16 - Earliest claimed: 2016-12-28 - Assignees: Ajou University Industry-Academic Cooperation Foundation - Applicants: Ajou University Industry-Academic Cooperation Foundation - Inventors: Jin Hong Kim; Myung Hoon Sunwoo; Jung Won Lee - Web page: https://patentgrep.com/patent/US10945637B2 ## CPC - A61B 5/1034: {by means of colour cards} - A61B 5/14546: {for measuring analytes not otherwise provided for, e.g. ions, cytochromes} - A61B 5/1455: using optical sensors, e.g. spectral photometrical oximeters - A61B 5/6898: {Portable consumer electronic devices, e.g. music players, telephones, tablet computers} - G06T 7/0012: {Biomedical image inspection} - G06T 7/90: Determination of colour characteristics - A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens} - A61B 5/7264: {Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems} - A61B 2576/00: Medical imaging apparatus involving image processing or analysis (A61B1/00009, A61B6/52 and A61B8/52 take precedence) - G06T 2207/10024: Color image - G06T 2207/30041: Eye; Retina; Ophthalmic - G16H 30/40: for processing medical images, e.g. editing - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA ## Abstract Disclosed are image based jaundice analyzing method and apparatus. The image based jaundice analyzing method according to an exemplary embodiment of the present disclosure includes: receiving an image for jaundice diagnosis obtained by photographing a specific body part of a user and a reference object in a location where the user is currently located; generating color distortion information representing a degree of color distortion of the reference object included in the image for jaundice diagnosis; generating a correction image for jaundice diagnosis by correcting the color distortion of the image for jaundice diagnosis based on the color distortion information; and diagnosing a jaundice symptom of the user using the correction image for jaundice diagnosis. ## Claims ### Claim 1 A method for diagnosing jaundice based on an image by a jaundice diagnosing apparatus, the method comprising: receiving an image for jaundice diagnosis obtained by photographing a specific body part of a user and a reference object; generating color distortion information representing a degree of color distortion of the reference object included in the image for jaundice diagnosis; generating a correction image for jaundice diagnosis by correcting the color distortion of the image for jaundice diagnosis based on the color distortion information; and diagnosing a jaundice symptom of the user using the correction image for jaundice diagnosis, wherein the reference object is an eye patch and the eye patch is configured by a single area having a white color or a plurality of areas having different colors. ### Claim 2 (depends on 1) The method according to claim 1, wherein the diagnosing of a jaundice symptom of the user includes: transmitting a jaundice diagnosis request which includes the correction image for jaundice diagnosis and requests the jaundice diagnosis for the user to a diagnosis server; and receiving a jaundice diagnosis result which is a diagnosis result for the jaundice diagnosis request from the diagnosis server. ### Claim 3 (depends on 2) The method according to claim 2, wherein the jaundice diagnosis result is determined based on the image analysis result for the correction image for jaundice diagnosis and also determined further selectively based on at least one of medical history information of the user and medical treatment information of others with a jaundice symptom. ### Claim 4 (depends on 3) The method according to claim 3, wherein the jaundice diagnosis result further includes health risk information indicating whether the jaundice symptom of the user is risky for health, based on the correlation between the disease of the user predicted based on at least one of the medical history information of the user and the medical treatment information of others and the image analysis result. ### Claim 5 (depends on 1) The method according to claim 1, wherein when the reference object is a white object, in the generating of color distortion information, color temperature difference information which is a difference value between a first color temperature of the reference object in a reference image obtained by photographing the reference object under a previously stored reference light source and a second color temperature of the reference object included in the image for jaundice diagnosis is generated and in the generating of a correction image for jaundice diagnosis, the color temperature of the image for jaundice diagnosis is corrected such that the color temperature of the reference object of the image for jaundice diagnosis is equal to the first color temperature based on the color temperature difference information to generate a correction image for jaundice diagnosis. ### Claim 6 (depends on 1) The method according to claim 1, wherein the specific body part of the user include at least one of a face and an eyeball of the user. ### Claim 7 (depends on 1) The method according to claim 1, further comprising: outputting a user interface for photographing the image for jaundice diagnosis, wherein in the receiving of an image for jaundice diagnosis, the image photographed based on a photographing guideline provided on the user interface in real time is received. ### Claim 8 (depends on 1) The method according to claim 1, wherein the image for jaundice diagnosis is an image in which the reference object is worn or attached on the specific body part of the user. ### Claim 9 (depends on 1) The method according to claim 1, wherein the eye patch is configured by a plurality of areas having a white color and at least one different color. ### Claim 10 (depends on 9) The method according to claim 9, wherein in the eye patch, a pattern in which a first area and a second area having the same color are alternately disposed with a white area therebetween is formed. ### Claim 11 (depends on 9) The method according to claim 9, wherein the eye patch is attached on a face within a predetermined distance from the eye of the user or attached to a tool within a predetermined distance from the eye when a tool is used to widen a sclera of the eye. ### Claim 12 (depends on 1) The method according to claim 1, further comprising: before the receiving of an image for jaundice diagnosis, analyzing an image displayed through a camera equipped in the jaundice diagnosing apparatus in real time to automatically photograph an image at a time when the reference object is detected, wherein the photographed image is an image for jaundice diagnosis. ### Claim 13 (depends on 1) The method according to claim 1, wherein the color distortion information is generated based on at least one of illumination of environment in which the image for jaundice diagnosis is photographed, a photographic related setting value of a user device which photographs the image for jaundice diagnosis and a lens aberration of a lens mounted on the user device. ### Claim 14 (depends on 1) The method according to claim 1, wherein when a reference image obtained by photographing the reference object under a reference light source which is stored in advance has a YCbCr format and the image for jaundice diagnosis has an RGB format, the generating of color distortion information includes: generating a converted image for jaundice diagnosis by converting the image for jaundice diagnosis into the YCbCr format; and calculating a first luminance distribution function which is a cumulative probability density function for a luminance value Y of the entire pixels belonging to a converted image for jaundice diagnosis to generate the color distortion information, in the generating of a correction image for jaundice diagnosis, the correction image for jaundice diagnosis is generated by correcting the converted image for jaundice diagnosis corresponding to the first luminance distribution function to have a second luminance distribution function which is a cumulative probability density function for a luminance value Y of entire pixels belonging to the reference image. ### Claim 15 An image based jaundice diagnosing apparatus, comprising: a receiver configured to receive an image for jaundice diagnosis obtained by photographing a specific body part of a user and a reference object; and a processor configured to: generate color distortion information representing a degree of color distortion of the reference object included in the image for jaundice diagnosis; correct the color distortion of the image for jaundice diagnosis based on the color distortion information to generate a correction image for jaundice diagnosis; and diagnose a jaundice symptom of the user using the correction image for jaundice diagnosis, wherein the reference object is an eye patch and the eye patch is configured by a single area having a white color or a plurality of areas having different colors. ### Claim 16 (depends on 15) The image based jaundice diagnosing apparatus according to claim 15, wherein the eye patch is configured by a plurality of areas having a white color and at least one different color.