# US 12,191,036 B2 · Method for displaying ultrasonic image, ultrasonic diagnostic device, and computer program product > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,191,036 B2 - Document ID: US12191036B2 - Status: Granted - Kind: B2 - Application number: 17/435,581 - Filed: 2020-03-12 - Published: 2022-02-24 - Granted: 2025-01-07 - Earliest claimed: 2019-03-12 - Assignees: Samsung Medison Co., Ltd. - Applicants: Samsung Medison Co., Ltd. - Inventors: MoonHo Park; YeongKyeong Seong - Web page: https://patentgrep.com/patent/US12191036B2 ## CPC - A61B 8/4405: {Device being mounted on a trolley} - G16H 50/20: for computer-aided diagnosis, e.g. based on medical expert systems - A61B 8/085: {for locating body or organic structures, e.g. tumours, calculi, blood vessels, nodules} - A61B 8/461: {Displaying means of special interest} - A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display} - A61B 8/467: {characterised by special input means} - A61B 8/469: {for selection of a region of interest} - A61B 8/5207: {involving processing of raw data to produce diagnostic data, e.g. for generating an image} - A61B 8/5223: {for extracting a diagnostic or physiological parameter from medical diagnostic data (for algorithms to analyse biomedical images G06T7/0012)} - G06N 3/0464: Convolutional networks [CNN, ConvNet] - G06N 3/08: Learning methods - G06N 3/09: Supervised learning - G06T 7/0012: {Biomedical image inspection} - G06T 7/13: Edge detection - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS - G16H 30/40: for processing medical images, e.g. editing - A61B 8/0825: {for diagnosis of the breast, e.g. mammography} - A61B 8/4472: {Wireless probes} - G01S 7/52073: {Production of cursor lines, markers or indicia by electronic means} - G01S 7/52084: {related to particular user interfaces (special user input means for ultrasonic medical diagnostic devices A61B8/467)} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06T 2207/10132: Ultrasound image - G06T 2207/20081: Training; Learning - G06T 2207/20092: Interactive image processing based on input by user - G06T 2207/30096: Tumor; Lesion - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES ## Abstract Disclosed is a method for displaying an ultrasonic image, comprising the steps of: identifying a lesion area included in an ultrasonic image; diagnosing the lesion area to obtain a diagnostic result; generating a diagnostic image by displaying, in the lesion area of the ultrasonic image, a first area which is at least one area on which the lesion is diagnosed; and displaying a user interface screen including the diagnostic image and the diagnostic result. ## Claims ### Claim 1 A method of displaying an ultrasonic image, comprising: identifying a lesion area included in the ultrasonic image; diagnosing the lesion area to acquire a diagnostic result; generating a diagnostic image including a first area in the lesion area, which is at least one area that is the basis of diagnosing the lesion, in the ultrasonic image; displaying a user interface screen including the diagnostic image and the diagnostic result; and displaying the diagnostic image displaying a second area in the lesion area, which is at least one area indicating a feature of the lesion that changes the diagnostic result when the feature of the lesion is changed, wherein the displaying of the diagnostic image displaying the second area in the lesion area, includes displaying visual information indicating that the diagnostic result will be changed when the feature of the lesion in the second area is changed. ### Claim 2 (depends on 1) The method of claim 1, wherein the first area is an area indicating at least one feature among a plurality of features of the lesion in lesion area. ### Claim 3 (depends on 1) The method of claim 1, wherein the first area is an area that is the basis of determining at least one feature among a shape of the lesion, an orientation of the lesion, a margin of the lesion, an echo with respect to the lesion area, and a posterior of the lesion area. ### Claim 4 (depends on 1) The method of claim 1, wherein the diagnostic result includes information indicating whether the lesion is benign or malignant. ### Claim 5 (depends on 1) The method of claim 1, wherein the first area includes a plurality of areas indicating each of a plurality of features, wherein the generating of the diagnostic image includes: displaying the plurality of areas in the lesion area using at least one among different colors, marks, symbols, transparency, echoes, types of dotted line, and thicknesses of the dotted lines, thereby distinguishing different features from each other among the plurality of features; and the plurality of features include at least one among a shape of the lesion, an orientation of the lesion, a margin form of the lesion, an echo with respect to the lesion area, and a posterior feature of the lesion area that are the basis of diagnosing the lesion. ### Claim 6 (depends on 1) The method of claim 1, wherein the generating of the diagnostic image further includes displaying the first area to be distinguished from the second area in the diagnostic image. ### Claim 7 (depends on 1) The method of claim 1, wherein the displaying of the user interface screen includes displaying the user interface screen including a list including a plurality of items corresponding to a plurality of features indicating at least one of the diagnostic image, the diagnostic result, or the lesion. ### Claim 8 (depends on 7) The method of claim 7, further comprises: in response to a user input for selecting any one among the plurality of items, displaying at least one partial area indicating a feature corresponding to a selected item in the diagnostic image. ### Claim 9 (depends on 7) The method of claim 7, wherein the displaying of the user interface screen further includes, in accordance that when a first feature is changed and the diagnostic result is changed, displaying an item included in the list corresponding to the first feature to be distinguished from other items. ### Claim 10 (depends on 1) The method of claim 1, wherein the generating of the diagnostic image includes generating the diagnostic image including diagnostic information, which is information about a feature of the lesion area appearing in the first area. ### Claim 11 (depends on 10) The method of claim 10, wherein the generating of the diagnostic image including the diagnostic information includes analyzing the ultrasonic image using at least one of a computer aided detection & diagnosis (CAD) technology and an artificial intelligence (AI) technology and acquiring at least one among the lesion area, the diagnostic result, and diagnostic information corresponding to the diagnostic result. ### Claim 12 An ultrasound diagnosis device comprising: a display; a memory configured to store at least one instruction; and a processor configured to execute at least one of the at least one instruction to: identify a lesion area included in an ultrasonic image, diagnose the lesion area to acquire a diagnostic result, generate a diagnostic image including a first area, which is at least one area that is the basis of diagnosing a lesion in the lesion area, in the ultrasonic image, control the display to display a user interface screen including the diagnostic image and the diagnostic result, and control the display to display the diagnostic image displaying a second area in the lesion area, which is at least one area indicating a feature of the lesion that changes the diagnostic result when the feature of the lesion is changed, wherein the displaying of the diagnostic image displaying the second area in the lesion area, includes displaying visual information indicating that the diagnostic result will be changed when the feature of the lesion in the second area is changed. ### Claim 13 A non-transitory computer-readable recording medium, in which a computer program including commands executable by a computer is stored, when the computer program is executed by a computer, causing the computer to perform: identifying a lesion area included in an ultrasonic image; diagnosing the lesion area to acquire a diagnostic result; generating a diagnostic image including a first area in the lesion area, which is at least one area that is the basis of diagnosing the lesion, in the ultrasonic image; displaying a user interface screen including the diagnostic image and the diagnostic result; and displaying the diagnostic image displaying a second area in the lesion area, which is at least one area indicating a feature of the lesion that changes the diagnostic result when the feature of the lesion is changed, wherein the displaying of the diagnostic image displaying the second area in the lesion area, includes displaying visual information indicating that the diagnostic result will be changed when the feature of the lesion in the second area is changed.