# US 2010/0141772 A1 · Image processing device and method, image processing system, and image processing program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2010/0141772 A1
- Document ID: US20100141772A1
- Status: Published application
- Kind: A1
- Application number: 12/629,139
- Filed: 2009-12-02
- Published: 2010-06-10
- Earliest claimed: 2008-12-04
- Assignees: Sony Corporation
- Inventors: Ritsuo INAGUMA; Takanobu UJISATO
- Web page: https://patentgrep.com/patent/US20100141772A1

## CPC

- G01S 3/7864: {T.V. type tracking systems}
- G01S 11/12: using electromagnetic waves other than radio waves
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G08B 13/1961: {Movement detection not involving frame subtraction, e.g. motion detection on the basis of luminance changes in the image}
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/61: based on recognised objects
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/63: by using electronic viewfinders
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06T 2207/10004: Still image; Photographic image
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An image processing device includes: an entire image display control portion that performs control to display an entire image of a predetermined region in an entire image display window; and a cutout image display control portion that performs control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window. The cutout image display control portion performs the control in such a manner that one cutout image including the tracking subjects is displayed in the cutout image display window in a case where relative distances among the tracking subjects are equal to or smaller than a predetermined value, and that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the tracking subjects are larger than the predetermined value.

## Claims

### Claim 1

An image processing device comprising:
an entire image display control portion that performs control to display an entire image of a predetermined region in an entire image display window; and
a cutout image display control portion that performs control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window,
wherein the cutout image display control portion performs the control in such a manner that one cutout image including the plurality of tracking subjects is displayed in the cutout image display window in a case where relative distances among the plurality of tracking subjects are equal to or smaller than a predetermined value and performs the control in such a manner that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the plurality of tracking subjects are larger than the predetermined value.

### Claim 2 (depends on 1)

The image processing device according to claim 1 further comprising:
an operation portion that specifies the plurality of tracking subjects from the entire image being displayed in the entire image display window in response to an operation by a user.

### Claim 3 (depends on 1)

The image processing device according to claim 1,
wherein the relative distances are calculated on the basis of one or both of sizes of the tracking subjects within the entire image and distances among the tracking subjects within the entire image.

### Claim 4 (depends on 2)

The image processing device according to claim 2,
wherein the cutout image display control portion changes an enlargement ratio of the cutout image in response to an operation from the operation portion.

### Claim 5

An image processing system comprising:
an image transmission device having a camera portion that generates image data, an image data processing portion that generates compressed image data by encoding the image data generated by the camera portion, and a data transmission portion that transmits the compressed image data generated by the image data processing portion; and
an image processing device having a data reception portion that receives the compressed image data, an entire image display control portion that performs control to display an entire image of a predetermined range generated from image data obtained by decoding the compressed image data received at the data reception portion in an entire image display window, and a cutout image display control portion that performs control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window,
wherein the cutout image display control portion performs the control in such a manner that one cutout image including the plurality of tracking subjects is displayed in the cutout image display window in a case where relative distances among the plurality of tracking subjects are equal to or smaller than a predetermined value and performs the control in such a manner that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the plurality of tracking subjects are larger than the predetermined value.

### Claim 6 (depends on 5)

The image processing system according to claim 5,
wherein the image transmission device further includes a swivel base on which the camera portion is mounted and which performs a swivel operation;
the camera portion generates a plurality of items of image data of continuous regions according to the swivel operation of the swivel base; and
the entire image display control portion performs the control in such a manner that a panoramic entire image generated from the plurality of items of image data of the continuous regions is displayed in the entire image display window.

### Claim 7 (depends on 5)

The image processing system according to claim 5,
wherein the image transmission device is provided in a plural form;
the camera portion in each of a plurality of the image transmission devices generates a plurality of items of image data of continuous regions; and
the entire image display control portion performs the control in such a manner that a panoramic entire image generated from the plurality of items of image data of continuous regions is displayed in the entire image display window.

### Claim 8

An image processing method comprising the steps of:
performing control to display an entire image of a predetermined region in an entire image display window; and
performing control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window,
wherein, in the step of displaying the tracking subjects, the control is performed in such a manner that one cutout image including the plurality of tracking subjects is displayed in the cutout image display window in a case where relative distances among the plurality of tracking subjects are equal to or smaller than a predetermined value and the control is performed in such a manner that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the plurality of tracking subjects are larger than the predetermined value.

### Claim 9

An image processing program causing a computer to perform the steps of:
performing control to display an entire image of a predetermined region in an entire image display window; and
performing control to enlarge a plurality of tracking subjects included in the entire image and display the tracking subjects in a cutout image display window,
wherein, in the step of displaying the tracking subjects, the control is performed in such a manner that one cutout image including the plurality of tracking subjects is displayed in the cutout image display window in a case where relative distances among the plurality of tracking subjects are equal to or smaller than a predetermined value and the control is performed in such a manner that two cutout images including the respective tracking subjects are displayed in the cutout image display window in a case where the relative distances among the plurality of tracking subjects are larger than the predetermined value.
