# US 2022/0036071 A1 · Storage medium, control method of information processing apparatus, and information processing apparatus

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0036071 A1
- Document ID: US20220036071A1
- Status: Published application
- Kind: A1
- Application number: 17/373,991
- Filed: 2021-07-13
- Published: 2022-02-03
- Earliest claimed: 2020-07-31
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Natsumi Tokunaga
- Web page: https://patentgrep.com/patent/US20220036071A1

## CPC

- G09G 5/377: for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence)
- G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34)
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence)
- G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F 3/12: Digital output to print unit {, e.g. line printer, chain printer}
- G06F 3/1208: {resulting in improved quality of the output result, e.g. print layout, colours, workflows, print preview}
- G06F 3/1256: {User feedback, e.g. print preview, test print, proofing, pre-flight checks}
- G06F 3/1284: {Local printer device}
- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06T 11/60: Creating or editing images; Combining images with text
- G06V 20/10: Terrestrial scenes (scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59)
- A45D 2029/005: {Printing or stamping devices for applying images or ornaments to nails}
- G06T 2200/24: involving graphical user interfaces [GUIs]
- G09G 2354/00: Aspects of interface with display user
- G09G 2380/08: Biomedical applications
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- A45D: HAIRDRESSING OR SHAVING EQUIPMENT (wigs, toupees or the like A41G3/00, A41G5/00; hairdressers' chairs A47C1/04; hair cutting appliances, razors B26B); EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING

## Abstract

An object is to reduce the processing time. One embodiment is a non-transitory computer readable storage medium storing a program for causing an information processing apparatus to function as: a detection unit configured to detect an area of a first object for each second object from a captured image obtained by capturing the second object including the first object; a first display control unit configured to display a display item indicating a detected area at a position corresponding to the area detected by the detection unit in the captured image displayed on a screen; and a second display control unit configured to display a temporary area that is created based on the area of the first object detected in the second object in which area detection has succeeded in the captured image of the second object that is displayed on the screen and in which area detection has failed.

## Claims

### Claim 1

A non-transitory computer readable storage medium storing a program for causing an information processing apparatus to function as:
a detection unit configured to detect an area of a first object for each second object from a captured image obtained by capturing the second object including the first object;
a first display control unit configured to display a display item indicating a detected area at a position corresponding to the area detected by the detection unit in the captured image displayed on a screen; and
a second display control unit configured to, in a case where the second object in which area detection of the first object has succeeded and the second object in which area detection of the first object has failed are present, display a temporary area that is created based on the area of the first object detected in the second object in which area detection has succeeded in the captured image of the second object that is displayed on the screen and in which area detection has failed.

### Claim 2 (depends on 1)

The storage medium according to claim 1, wherein
the temporary area is created based on the area corresponding to the second object in which area detection of the first object has succeeded most recently and whose shape and size are the same as those of the area.

### Claim 3 (depends on 1)

The storage medium according to claim 1, wherein
the temporary area is created based on the area corresponding to the second object in which the area detection has been performed one before or one after the second object in which area detection has failed.

### Claim 4 (depends on 1)

The storage medium according to claim 1, wherein
the second display control unit displays the temporary area on an image of the second object in which area detection has failed in response to a user selecting the second object in which area detection has failed via the screen.

### Claim 5 (depends on 1)

The storage medium according to claim 1, wherein
the second display control unit displays the temporary area at a position selected by a user on the screen.

### Claim 6 (depends on 1)

The storage medium according to claim 1, storing a program for causing the information processing apparatus to further function as:
a determination unit configured to automatically determine whether the second object in which the area detection has failed is present, wherein
in a case where determination results by the determination unit are affirmative, the second display control unit displays the temporary area on an image of the second object in which the area detection has failed.

### Claim 7 (depends on 1)

The storage medium according to claim 1, wherein
the temporary area is not displayed on an image of the second object in which the area detection has succeeded.

### Claim 8 (depends on 1)

The storage medium according to claim 1, storing a program for causing a printer to print a printing-target image on the first object based on the detected area that is displayed by the second display control unit or the temporary area's position and size.

### Claim 9

A non-transitory computer readable storage medium storing a program for causing an information processing apparatus to function as:
a detection unit configured to detect an area of a first object that is a printing target from a captured image for each second object different from the first object;
a first display control unit configured to display a printable area that is set for the detected area of the first object on an image of the second object on a screen that displays the captured image; and
a second display control unit configured to, in a case where the second object in which area detection of the first object has failed is present, display a temporary printable area on an image of the second object in which area detection has failed on the screen, wherein
a user selects, as the temporary printable area, one from among a plurality of temporary printable area candidates prepared in advance.

### Claim 10 (depends on 1)

The storage medium according to claim 1, wherein
the first object is a fingernail of a user and
the second object is a finger of the user.

### Claim 11 (depends on 1)

The storage medium according to claim 1, wherein
a number of the second objects is one of arbitrary integers not less than two.

### Claim 12

A control method of an information processing apparatus, the control method comprising:
a step of detecting an area of a first object for each second object from a captured image obtained by capturing the second object including the first object;
a step of displaying a display item indicating a detected area at a position corresponding to the area detected at the detection step in the captured image displayed on a screen; and
a step of, in a case where the second object in which area detection of the first object has succeeded and the second object in which area detection of the first object has failed are present, displaying a temporary area that is created based on the area of the first object detected in the second object in which area detection has succeeded in the captured image of the second object that is displayed on the screen and in which area detection has failed.

### Claim 13

An information processing apparatus comprising:
a detection unit configured to detect an area of a first object for each second object from a captured image obtained by capturing the second object including the first object;
a first display control unit configured to display a display item indicating a detected area at a position corresponding to the area detected by the detection unit in the captured image displayed on a screen; and
a second display control unit configured to, in a case where the second object in which area detection of the first object has succeeded and the second object in which area detection of the first object has failed are present, display a temporary area that is created based on the area of the first object detected in the second object in which area detection has succeeded in the captured image of the second object that is displayed on the screen and in which area detection has failed.
