# US 2017/0289411 A1 · Image processing device, image processing method, and recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0289411 A1
- Document ID: US20170289411A1
- Status: Published application
- Kind: A1
- Application number: 15/512,340
- Filed: 2015-07-31
- Published: 2017-10-05
- Earliest claimed: 2014-09-19
- Assignees: NEC Corporation
- Applicants: NEC Corporation
- Inventors: Hiroo IKEDA
- Web page: https://patentgrep.com/patent/US20170289411A1

## CPC

- G06T 1/00: General purpose image data processing
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 19/00: Manipulating three-dimensional [3D] models or images for computer graphics
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G08B 13/19678: {User interface}
- G08B 25/08: using communication transmission lines {(G08B13/19658, G08B21/0286, G08B25/016 take precedence)}
- H04N 5/76: Television signal recording
- H04N 5/77: between a recording apparatus and a television camera
- H04N 9/8715: {involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal}
- H04N 17/002: {for television cameras}
- H04N 23/63: by using electronic viewfinders
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20096: Interactive definition of curve of interest
- G06T 2207/20101: Interactive definition of point of interest, landmark or seed
- G06T 2207/30196: Human being; Person
- G06T 2207/30232: Surveillance
- G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

An image processing device (3000) comprises an input unit (3020) and a presentation unit (3040). The input unit (3020) accepts an input of an operation for movement, on a captured image captured by a camera, of a first image which is superimposed on the captured image on the basis of a predetermined camera parameter indicating the position and attitude of the camera and which indicates a target object having a predetermined shape and a predetermined size set in a real space. The presentation unit (3040) presents the first image indicating the target object in a manner of view corresponding to a position on the captured image after the movement on the basis of the camera parameter.

## Claims

### Claim 1

An image processing device comprising:
one or more processors acting as an input unit configured to accept inputting of an operation for movement, on a captured image captured by a camera, to a first image that is superimposed on the captured image based on predetermined camera parameters indicating a position and attitude of the camera and indicates a target object having a predetermined shape and a predetermined size set on a real space; and
the one or more processors acting as a presentation unit configured to present the first image indicating the target object in a manner of view relating to a position on the captured image after the movement based on the camera parameters.

### Claim 2 (depends on 1)

The image processing device according to claim 1, wherein
the input unit accepts an operation for the movement by repeatedly accepting a designation of a first position on the captured image, and
the presentation unit generates, when a certain first position is designated, based on the camera parameters, a predetermined shape and a predetermined size on a real space of the target object, and a second position on the real space relating to the first position, a first image indicating the target object on the captured image appearing in a camera determined by the camera parameters when the target object is disposed in the second position and presents the generated first image in the first position on the captured image.

### Claim 3 (depends on 2)

The image processing device according to claim 2, wherein
the presentation unit
acquires height information of the second position and
calculates the second position based on the camera parameters, the first position, and the height information of the second position.

### Claim 4 (depends on 3)

The image processing device according to claim 3, wherein the presentation unit acquires information indicating a height of a ground surface in a real space as the height information of the second position.

### Claim 5 (depends on 3)

The image processing device according to claim 3, wherein the presentation unit acquires pieces of information of different heights for a plurality of areas on the captured image, respectively, as the height information of the second position.

### Claim 6 (depends on 1)

The image processing device according to claim 1, wherein the target object has a planar shape.

### Claim 7 (depends on 1)

The image processing device according to claim 1, comprising:
one or more processors acting as a second input unit configured to accept inputting of a point or line to the captured image; and
the one or more processors acting as a second display unit configured to display a second image indicating the point or line upon mapping on a plane parallel to a ground surface, based on the camera parameters, a position on the captured image of the point or line, and height information on a real space of the point or line.

### Claim 8

An image processing device comprising:
one or more processors acting as an input unit configured to accept a designation of a first position on a captured image; and
the one or more processors acting as a presentation unit configured to present, based on predetermined camera parameters indicating a position and attitude of a camera, a predetermined shape and a predetermined size on a real space of a target object, and a second position on the real space relating to the first position, a first image indicating the target object on the captured image appearing in a camera determined by the camera parameters when the target object is disposed in the second position in the first position on the captured image.

### Claim 9 (depends on 8)

The image processing device according to claim 8, wherein
the input unit accepts designations of a plurality of first positions, and
the presentation unit presents first images indicating a plurality of target objects relating to the plurality of first positions in respective corresponding first positions on the captured image.

### Claim 10 (depends on 8)

The image processing device according to claim 8, wherein
the input unit repeatedly accepts a designation of the first position, and
the presentation unit generates, when a certain first position is designated, a first image indicating the target object disposed in a second position on a real space relating to the first position and presents the generated first image in the first position on the captured image.

### Claim 11

An image processing device comprising:
one or more processors acting as an input unit configured to accept inputting of a point or line to a captured image captured by a camera; and
the one or more processors acting as a display unit configured to display a first image indicating the point or line upon mapping on a plane parallel to a ground surface, based on predetermined camera parameters indicating a position and attitude of the camera, a position on the captured image of the point or line, and height information on a real space of the point or line.

### Claim at position 12

-15. (canceled)
