# US 9,438,842 B2 · Reproduction control apparatus, reproduction control method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,842 B2
- Document ID: US9438842B2
- Status: Granted
- Kind: B2
- Application number: 14/097,473
- Filed: 2013-12-05
- Published: 2014-06-05
- Granted: 2016-09-06
- Earliest claimed: 2012-12-05
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Naoyuki Murakami
- Web page: https://patentgrep.com/patent/US9438842B2

## CPC

- H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/04883: for inputting data by handwriting, e.g. gesture or text
- G11B 27/002: {Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; (transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22)}
- G11B 27/28: by using information signals recorded by the same method as the main recording {(G11B27/22 takes precedence)}
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 5/783: Adaptations for reproducing at a rate different from the recording rate
- H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)}
- H04N 21/44012: {involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs}
- H04N 21/47205: {for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04N 5/907: using static stores, e.g. storage tubes or semiconductor memories (H04N5/91 takes precedence)
- H04N 9/8042: {involving data reduction}
- H04N 9/8211: {the additional signal being a sound signal (H04N9/835 takes precedence)}
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

A reproduction control apparatus that enables a user to perform fast forward and fast rewind of a moving image by an intuitive operation, and provides good operability. The reproduction apparatus controls reproduction of a moving image including a plurality of frames. A controller detects selection of an area including an object by a user's touch operation during reproduction of the moving image. The size of an object is detected for each of the plurality of frames. The controller searches for a frame including the object, which corresponds in size to the size of the selected area, and the frame found by the search is reproduced and displayed.

## Claims

### Claim 1

A reproduction control apparatus that controls reproduction of a moving image including a plurality of frames, comprising:
a storage device; and
a processor configured to execute computer executable instructions recorded on the storage device, the computer executable instructions including instructions, that when executed by the processor, cause the reproduction control apparatus to:
reproduce a first frame among the plurality of frames of the moving image;
render an object frame which identifies an object according to both a position and a size of the object which is included in the first frame of the moving image, during the reproduction of the first frame of the moving image;
detect selection of the object frame, of the first frame of the moving image, including the object during reproduction of the first frame of the moving image;
detect a change in size of the selected object frame, in response to a user's operation;
search for a second frame among the plurality of frames of the moving image, including the object corresponding in size to the changed size of the selected object frame; and
reproduce the second frame including the object corresponding in size to the changed size of the selected object frame in response to the detection of the change in size of the selected object frame, the first frame having a first reproduction time and the second frame having a second reproduction time different from the first reproduction time.

### Claim 2 (depends on 1)

The reproduction control apparatus according to claim 1, wherein the user's operation is an operation for designating two points on a reproduced moving image at the same time, the object frame having the designated two points as diagonal points, and changing a distance between the two points.

### Claim 3 (depends on 2)

The reproduction control apparatus according to claim 2, wherein the computer executable instructions further include instructions, that when executed by the processor, cause the reproduction control apparatus to search, according to a change in distance between the two points, for the second frame.

### Claim 4 (depends on 2)

The reproduction control apparatus according to claim 2, wherein the computer executable instructions further include instructions, that when executed by the processor, cause the reproduction control apparatus to, when two points on the reproduced moving image are designated at the same time, display a frame of a size corresponding to at least one of the maximum size and the minimum size of the object included in the object frame having the designated two points as diagonal points in a manner superimposed on the reproduced moving image.

### Claim 5 (depends on 1)

The reproduction control apparatus according to claim 1,
wherein the computer executable instructions further include instructions, that when executed by the processor, cause the reproduction control apparatus to selectively display a movement track of the object or an object frame which defines a location of the object according to at least one of an amount of change in the detected size and an amount of change in the detected position, in a manner superimposed on the reproduced moving image.

### Claim 6 (depends on 5)

The reproduction control apparatus according to claim 5, wherein the user's operation is an operation for designating two points on a reproduced moving image at the same time, the two points being diagonal points of the object frame which defines the location of the object,
and even if reproducing the second frame according to the change in distance between the two points separates the diagonal points of the object frame from the two points after the change of the distance, the reproduction control apparatus is caused to search again, according to a further change in distance between the two points in response to a continuous user's operation, for a frame including the object corresponding in size to a further changed size of the selected object frame.

### Claim 7 (depends on 6)

The reproduction control apparatus according to claim 6, further comprising a touch panel,
wherein the user's operation is an operation for touching the touch panel with user's two fingers to designate the two points and then moving, without cancelling the touching operation, the user's two fingers so as to change the distance therebetween to change the distance between the two points, and
the continuous user's operation is an operation for moving, while continuing to touch the touch panel with the user's two fingers, the user's two fingers so as to further change the distance therebetween to further change the distance between the two points.

### Claim 8 (depends on 1)

The reproduction control apparatus according to claim 1, wherein said reproduction control unit causes the moving image to be reproduced from the second frame which is used as a cue.

### Claim 9

A method of controlling reproduction of a moving image including a plurality of frames, comprising:
reproducing a first frame among the plurality of frames of the moving image;
rendering an object frame which identifies an object according to both a position and a size of the object which is included in the first frame of the moving image, during the reproduction of the first frame of the moving image;
detecting selection of the object frame, of the first frame of the moving image, including the object during reproduction of the first frame of the moving image;
detecting a change in size of the selected object frame, in response to a user's operation;
searching for a second frame among the plurality of frames of the moving image, including the object corresponding in size to the changed size of the selected object frame; and
reproducing the second frame including the object corresponding in size to the changed size of the selected object frame in response to the detection of the change in size of the selected object frame, the first frame having a first reproduction time and the second frame having a second reproduction time different from the first reproduction time.

### Claim 10

A non-transitory computer-readable storage medium storing a computer-executable control program for causing a computer to execute a method of controlling reproduction of a moving image including a plurality of frames,
wherein the method comprises:
reproducing a first frame among the plurality of frames of the moving image;
rendering an object frame which identifies an object according to both a position and a size of the object which is included in the first frame of the moving image, during the reproduction of the first frame of the moving image;
detecting selection of the object frame, of the first frame of the moving image, including the object during reproduction of the first frame of the moving image;
detecting a change in size of the selected object frame, in response to a user's operation;
searching for a second frame among the plurality of frames of the moving image, including the object corresponding in size to the changed size of the selected object frame; and
reproducing the second frame including the object corresponding in size to the changed size of the selected object frame in response to the detection of the change in size of the selected object frame, the first frame having a first reproduction time and the second frame having a second reproduction time different from the first reproduction time.