# US 11,445,102 B2 · Information processing device and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,445,102 B2
- Document ID: US11445102B2
- Status: Granted
- Kind: B2
- Application number: 17/250,681
- Filed: 2019-07-31
- Published: 2021-06-24
- Granted: 2022-09-13
- Earliest claimed: 2018-08-31
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Shigeo Nakatsuka
- Web page: https://patentgrep.com/patent/US11445102B2

## CPC

- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/62: Control of parameters via user interfaces
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/632: {for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/61: based on recognised objects
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing device is connected to an image-capturing device via a network, in which a mark indicating image-capturing timing in an image-capturing scene is set on the basis of: a captured image of a scene similar to the image-capturing scene, the captured image being transmitted via the network; and a live view image corresponding to the captured image.

## Claims

### Claim 1

An information processing device, comprising:
circuitry configured to:
receive, from an image-capturing device via a network, a captured image of a scene similar to an image-capturing scene, wherein the captured image includes an image-capturing object in a first state;
determine a live view image corresponding to the captured image, wherein the live view image includes the image-capturing object in a second state delayed from the first state; and
set a mark indicating an image-capturing timing in the image-capturing scene based on the live view image corresponding to the captured image.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein the image-capturing device captures the captured image of the scene prior to capture of an image of the image-capturing scene.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein the circuitry is further configured to:
control a display unit to display a frame of the live view image; and
set the mark based on a first user input to the frame of the live view image.

### Claim 4 (depends on 3)

The information processing device according to claim 3, wherein the circuitry is further configured to:
receive a plurality of captured images of the scene;
control the display unit to display the plurality of captured images that includes the captured image; and
set, based on a second user input, an image-capturing timing image that indicates the image-capturing timing in the image-capturing scene from among the plurality of captured images.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein the frame of the live view image is a frame corresponding to the image-capturing timing image.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein the circuitry is further configured to determine the frame corresponding to the image-capturing timing image based a frame rate of the live view image and a frame rate of continuous image-capturing of the plurality of captured images.

### Claim 7 (depends on 4)

The information processing device according to claim 4, wherein the image-capturing timing is a timing to start continuous shooting image-capturing in the image-capturing scene.

### Claim 8 (depends on 4)

The information processing device according claim 4, wherein the image-capturing timing is a timing to end continuous shooting image-capturing in the image-capturing scene.

### Claim 9 (depends on 4)

The information processing device according to claim 4, wherein the image-capturing timing is a timing for execution of single image-capturing in the image-capturing scene.

### Claim 10 (depends on 3)

The information processing device according claim 3, wherein the circuitry is further configured to control the display unit to display the set mark is in a manner superimposed on the live view image.

### Claim 11 (depends on 3)

The information processing device according to claim 3, wherein the circuitry is further configured to:
seta subject in the frame of the live view image as a following target subject; and
move the mark based on the following target subject.

### Claim 12 (depends on 11)

The information processing device according to claim 11, wherein
the image-capturing device captures an image in the image-capturing scene subsequent to capture of the captured image of the scene, and
the circuitry is further configured to:
control the display unit to display the mark in a manner superimposed on the image of the image-capturing scene; and
move the mark based on a movement of the following target subject.

### Claim 13 (depends on 1)

The information processing device according to claim 1, wherein the mark indicating the image-capturing timing includes:
a timing to start continuous shooting image-capturing in the image-capturing scene, and
a timing to end the continuous shooting image-capturing in the image-capturing scene.

### Claim 14 (depends on 1)

The information processing device according to claim 1, wherein the delay is based on at least one of an encoding time in the image-capturing device, a transmission time in the network, or a decoding time in a device that displays the live view image.

### Claim 15 (depends on 1)

The information processing device according to claim 1, wherein
the image-capturing device captures an image of the image-capturing scene subsequent to capture of the captured image of the scene, and
the circuitry is further configured to control a display unit to display the mark in a manner superimposed on the image of the image-capturing scene.

### Claim 16 (depends on 1)

The information processing device according to claim 1, wherein the circuitry is further configured to set the mark based a subject detection result in a frame of constituting the live view image.

### Claim 17

An information processing method, comprising:
receiving, from an image-capturing device via a network, a captured image of a scene similar to an image-capturing scene, wherein the captured image includes an image-capturing object in a first state;
determining a live view image corresponding to the captured image, wherein the live view image includes the image-capturing object in a second state delayed from the first state; and
setting a mark indicating an image-capturing timing in the image-capturing scene based on the live view image corresponding to the captured image.

### Claim 18

A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:
receiving, from an image-capturing device via a network, a captured image of a scene similar to an image-capturing scene, wherein the captured image includes an image-capturing object in a first state;
determining a live view image corresponding to the captured image, wherein the live view image includes the image-capturing object in a second state delayed from the first state; and
setting a mark indicating an image-capturing timing in the image-capturing scene based on the live view image corresponding to the captured image.

### Claim 19

An information processing device, comprising:
circuitry configured to:
receive, from an image-capturing device via a network, a plurality of captured images of a scene similar to an image-capturing scene;
control a display unit to display the plurality of captured images;
set, based on a first user input, an image-capturing timing image that indicates an image-capturing timing in the image-capturing scene from among the plurality of captured images;
determine a frame corresponding to the image-capturing timing image based on a frame rate of a live view image and a frame rate of continuous image-capturing of the plurality of captured images, wherein the frame corresponding to the image-capturing timing image is a frame of the live view image;
control the display unit to display the frame of the live view image; and
set a mark indicating the image-capturing timing in the image-capturing scene based on a second user input to the frame of the live view image.
