# US 2012/0249831 A1 · Method, apparatus and handset

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0249831 A1
- Document ID: US20120249831A1
- Status: Published application
- Kind: A1
- Application number: 13/412,138
- Filed: 2012-03-05
- Published: 2012-10-04
- Earliest claimed: 2011-03-29
- Assignees: Sony Corporation
- Inventors: Robert Mark Stefan PORTER
- Web page: https://patentgrep.com/patent/US20120249831A1

## CPC

- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A method of annotating, on a display, a plurality of objects in an image of a scene captured by a camera, the method comprising: receiving i) metadata representing the different annotations to be applied to each of the objects, and ii) position information identifying the real-world position of each object in the scene to which the annotations in the image are to be applied; determining the focal length of the camera and the tilt applied to the camera; determining the position of the camera with respect to the scene being captured; and applying the annotation to the image captured by the camera in accordance with the position information.

## Claims

### Claim 1

A method of annotating, on a display, a plurality of objects in an image of a scene captured by a camera, the method comprising: receiving i) metadata representing the different annotations to be applied to each of the objects, and ii) position information identifying the real-world position of each object in the scene to which the annotations in the image are to be applied; determining the focal length of the camera and the tilt applied to the camera; determining the position of the camera with respect to the scene being captured; applying the annotation to the image captured by the camera in accordance with the position information; and obtaining the position information from an image capture device having a field of view of the scene that is different to the camera, and wherein the position information is determined from an image of the scene captured by the image capture device.

### Claim 2 (depends on 1)

A method according to claim 1, further comprising identifying at least one of the objects in the image captured by the camera in accordance with the received real-world position information of the object, the position information of the camera, the local length of the camera and the tilt applied to the camera; and applying the annotation to the image in accordance with the identified object.

### Claim 3 (depends on 2)

A method according to claim 2, wherein the step of identifying the object comprises detecting the object in the image.

### Claim 4 (depends on 2, 3)

A method according to claim 2 or 3, further comprising identifying the object in accordance with a stored lens distortion characteristic of the camera.

### Claim 5 (depends on 1)

A method according to claim 1, wherein the position information is global positioning system location information.

### Claim 6 (depends on 1)

A method according to claim 1 wherein the one object is either a static object located in the scene or is a unique object in the scene.

### Claim 7 (depends on 1)

A method according to claim 1, further comprising storing the metadata and displaying the annotation from the stored metadata.

### Claim 8

An apparatus comprising a display and a camera, the display operative in use to display an image of a scene having a plurality of objects, the image being captured by the camera, the apparatus further comprising:
a receiving device operable to receive i) metadata representing the different annotations to be applied to each of the objects, and ii) position information identifying the real-world position of each object in the scene to which the annotations in the image are to be applied; a determining device configured to:
determine the focal length of the camera and the tilt applied to the camera; and
determine the position of the camera with respect to the scene being captured; and the apparatus comprising a controller operable to apply the annotation to the image captured by the camera in accordance with the position information; and the apparatus further comprising an obtaining device operable to obtain the position information from an image capture device having a field of view of the scene that is different to the camera, and wherein the position information is determined from an image of the scene captured by the image capture device.

### Claim 9 (depends on 8)

An apparatus according to claim 8, wherein the controller is further operable to identify at least one of the objects in the image captured by the camera in accordance with the received real-world position information of the object, the position information of the camera, the focal length of the camera and the tilt applied to the camera; and applying the annotation to the image in accordance with the identified object.

### Claim 10 (depends on 9)

An apparatus according to claim 9, wherein the controller is operable to detect the object in the image.

### Claim 11 (depends on 9, 10)

An apparatus according to claim 9 or 10, wherein the controller is further operable to identify the object in accordance with a stored lens distortion characteristic of the camera.

### Claim 12 (depends on 8)

An apparatus according to claim 8, wherein the position information is global positioning system location information

### Claim 13 (depends on 8)

An apparatus according to claim 8 wherein the one object is either a static object located in the scene or is a unique object in the scene.

### Claim 14 (depends on 8)

An apparatus according to claim 8, further comprising a storage device operable to store the metadata and the controller is operable to display the annotation from the stored metadata.

### Claim 15 (depends on 8)

A mobile handset comprising a transceiver for connection to a network and an apparatus according to claim 8.

### Claim 16 (depends on 1)

A computer program comprising computer readable instructions which when loaded onto a computer configure the computer to perform a method according to claim 1.

### Claim 17 (depends on 16)

A storage medium configured to store the computer program of claim 16 therein or thereon.
