# US 10,768,797 B2 · Method, apparatus, and system for generating body marker indicating object

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,768,797 B2
- Document ID: US10768797B2
- Status: Granted
- Kind: B2
- Application number: 14/714,735
- Filed: 2015-05-18
- Published: 2016-06-16
- Granted: 2020-09-08
- Earliest claimed: 2014-12-15
- Assignees: Samsung Medison Co., Ltd.
- Applicants: Samsung Medison Co., Ltd.
- Inventors: Min-Jung Song; Min-ju Lee; Seung-ju Lee; Jin-gyu Seo
- Web page: https://patentgrep.com/patent/US10768797B2

## CPC

- G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour
- A61B 8/14: Echotomography
- A61B 8/461: {Displaying means of special interest}
- A61B 8/463: {characterised by displaying multiple images or images and diagnostic data on one display}
- A61B 8/465: {adapted to display user selection data, e.g. icons or menus}
- A61B 8/467: {characterised by special input means}
- A61B 8/468: {allowing annotation or message recording}
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G06T 11/60: Creating or editing images; Combining images with text
- G16H 30/20: for handling medical images, e.g. DICOM, HL7 or PACS
- G16H 40/63: for local operation
- A61B 8/0866: {involving foetal diagnosis; pre-natal or peri-natal diagnosis of the baby}
- A61B 8/0891: {for diagnosis of blood vessels}
- A61B 8/4405: {Device being mounted on a trolley}
- A61B 8/4427: {Device being portable or laptop-like}
- A61B 8/4472: {Wireless probes}
- A61B 8/565: {involving data transmission via a network}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G06T 2210/41: Medical
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA

## Abstract

A method of generating a body marker includes selecting a first body marker from among a plurality of prestored body markers based on an object shown in a medical image; generating a second body marker by modifying a shape of the first body marker according to a user input; and displaying the second body marker.

## Claims

### Claim 1

A method of generating a body marker, the method comprising:
selecting a first body marker having a first shape of an object from among a plurality of prestored body markers based on information of a current shape of the object, which is an organ of a human, shown in a medical image, wherein the first body marker shows a picture that represents the object in the medical image;
displaying the first body marker and displaying guide images, that guide a change in the first shape, a position, or an orientation of the first body marker to modify the first body marker to be a second body marker, in the first body marker if the first body marker does not reflect the current shape or a location of the object shown in the medical image, wherein the guide images include a first guide image for rotating the first body marker along a predetermined central axis based on a first user input, a second guide image for rotating a portion of the first body marker toward the second guide image based on a second user input, and a third guide image for rotating the portion of the first body marker in clockwise or counterclockwise direction based on a third user input;
receiving at least one user input of selecting a predetermined point on the guide images, dragging from one point to another point on the guide images, and flipping the first body marker about a predetermined axis of the first body marker to generate an inverse image of the first body marker as the second body marker;
obtaining the second body marker that reflects the current shape or the location of the object by modifying the first body marker based on the at least one user input; and
displaying the second body marker in the medical image of the object.

### Claim 2 (depends on 1)

The method of claim 1, wherein the second body marker comprises a body marker generated by flipping the first body marker about a vertical axis.

### Claim 3 (depends on 1)

The method of claim 1, wherein the second body marker comprises a body marker generated by flipping the first body marker about a horizontal axis.

### Claim 4 (depends on 1)

The method of claim 1, wherein the second body marker comprises a body marker generated by rotating the first body marker about a central axis of the first body marker.

### Claim 5 (depends on 1)

The method of claim 1, wherein the second body marker comprises a body marker generated by rotating the first body marker in a clockwise direction.

### Claim 6 (depends on 1)

The method of claim 1, wherein the second body marker comprises a body marker generated by rotating the first body marker in a counterclockwise direction.

### Claim 7 (depends on 1)

The method of claim 1, wherein the selecting comprises receiving a fourth user input for selecting the first body marker that corresponds to the object from among a plurality of prestored body markers, and selecting the first body marker based on the fourth user input.

### Claim 8 (depends on 1)

The method of claim 1, wherein the selecting comprises selecting a portion of the object shown in the medical image, and selecting the first body marker based on the selected portion of the object.

### Claim 9 (depends on 1)

The method of claim 1, wherein the plurality of prestored body markers are sorted into application groups.

### Claim 10 (depends on 1)

The method of claim 1, wherein the first body marker and the second body marker are 2-dimensional or 3-dimensional.

### Claim 11 (depends on 1)

The method of claim 1, wherein the at least one user input comprises a user gesture input on a touch screen.

### Claim 12 (depends on 1)

The method of claim 1, wherein the at least one user input is input via a mouse or at least one key on a keyboard.

### Claim 13 (depends on 1)

The method of claim 1, wherein the displaying comprises displaying the first and second body markers on a single screen.

### Claim 14 (depends on 1)

A non-transitory computer-readable recording medium having recorded thereon a program, which, when executed by a computer, performs the method of claim 1.

### Claim 15

An apparatus for generating a body marker, the apparatus comprising:
a display configured to display a medical image showing an object, which is an organ of a human; and
a controller configured to select a first body marker having a first shape of the object from among a plurality of prestored body markers based on information of a current shape of the object, and generate a second body marker, wherein the first body marker shows a picture that represents the object in the medical image,
wherein the display is further configured to display the first body marker and display guide images, that guide a change in the first shape, a position, or an orientation of the first body marker to modify the first body marker to be a second body marker, in the first body marker if the first body marker does not reflect the current shape or a location of the object shown in the medical image, wherein the guide images include a first guide image for rotating the first body marker along a predetermined central axis based on a first user input, a second guide image for rotating a portion of the first body marker toward the second guide image based on a second user input, and a third guide image for rotating the portion of the first body marker in clockwise or counterclockwise direction based on a third user input,
wherein the apparatus further comprises an input device configured to receive at least one user input of selecting a predetermined point on the guide images, dragging from one point to another point on the guide images, and flipping the first body marker about a predetermined axis of the first body marker to generate an inverse image of the first body marker as the second body marker,
wherein the controller is further configured to generate the second body marker that reflects the current shape or the location of the object by modifying the first body marker based on the at least one user input,
wherein the display displays the second body marker in the medical image of the object.

### Claim 16 (depends on 15)

The apparatus of claim 15, wherein the second body marker comprises a body marker generated by flipping the first body marker about a vertical axis.

### Claim 17 (depends on 15)

The apparatus of claim 15, wherein the second body marker comprises a body marker generated by flipping the first body marker about a horizontal axis.

### Claim 18 (depends on 15)

The apparatus of claim 15, wherein the second body marker comprises a body marker generated by rotating the first body marker about a central axis of the first body marker.

### Claim 19 (depends on 15)

The apparatus of claim 15, wherein the second body marker comprises a body marker generated by rotating the first body marker in a clockwise direction.

### Claim 20 (depends on 15)

The apparatus of claim 15, wherein the second body marker comprises a body marker generated by rotating the first body marker in a counterclockwise direction.

### Claim 21 (depends on 15)

The apparatus of claim 15, wherein the input device is further configured to receive a fourth user input for selecting the first body marker that corresponds to the object from among a plurality of prestored body markers, and
wherein the controller selects the first body marker based on the fourth user input.

### Claim 22 (depends on 15)

The apparatus of claim 15, further comprising an image processor configured to select a portion of the object from the medical image, and
wherein the controller selects the first body marker based on the selected portion of the object.

### Claim 23 (depends on 15)

The apparatus of claim 15, wherein the plurality of prestored body markers are sorted into application groups.

### Claim 24 (depends on 15)

The apparatus of claim 15, wherein the first body marker and the second body marker are 2-dimensional or 3-dimensional.

### Claim 25 (depends on 15)

The apparatus of claim 15, wherein the at least one user input comprises a user gesture input on a touch screen.

### Claim 26 (depends on 15)

The apparatus of claim 15, wherein the at least one user input is input via a mouse or at least one key on a keyboard.

### Claim 27 (depends on 15)

The apparatus of claim 15, wherein the display displays the first and second body markers on a single screen.

### Claim 28

An ultrasound diagnosis system comprising:
a probe configured to transmit ultrasound signals to an object and receive echo signals that correspond to the ultrasound signals;
a display;
an ultrasound imaging device;
a memory storing instructions that, when executed by the ultrasound imaging device, perform operations comprising:
generating a medical image showing the object, which is an organ of a human, based on the echo signals;
displaying the medical image;
selecting a first body marker having a first shape of the object from among a plurality of prestored body markers based on information of a current shape of the object shown in the medical image, wherein the first body marker shows a picture that represents the object in the medical image;
displaying the first body marker and displaying guide images, that guide a change in the first shape, a position, or an orientation of the first body marker to modify the first body marker to be a second body marker, in the first body marker if the first body marker does not reflect a current shape or a location of the object shown in the medical image, wherein the guide images include a first guide image for rotating the first body marker along a predetermined central axis based on a first user input, a second guide image for rotating a portion of the first body marker toward the second guide image based on a second user input, and a third guide image for rotating the portion of the first body marker in clockwise or counterclockwise direction based on a third user input;
receiving at least one user input of selecting a predetermined point on the guide images, dragging from one point to another point on the guide images, and flipping the first body marker about a predetermined axis of the first body marker to generate an inverse image of the first body marker as the second body marker;
obtaining the second body marker that reflects the current shape or the location of the object by modifying a shape of the first body marker based on the at least one user input; and
displaying the second body marker in the medical image of the object.

### Claim 29 (depends on 1)

The method of claim 1, wherein the first body marker and the second body marker comprise an outline image of the organ of the human, and
wherein the second body marker comprising the outline image of the organ is displayed together with the medical image including a real image of the organ.

### Claim 30 (depends on 1)

The method of claim 1, wherein the guide images provide guidance on a three dimensional movement of the first body marker.
