# US 2017/0256283 A1 · Information processing device and information processing method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256283 A1
- Document ID: US20170256283A1
- Status: Published application
- Kind: A1
- Application number: 15/507,512
- Filed: 2015-06-16
- Published: 2017-09-07
- Earliest claimed: 2014-09-08
- Assignees: Sony Corporation
- Applicants: Sony Corporation
- Inventors: Masakazu YAJIMA; Yoichiro SAKO; Takayuki HIRABAYASHI; Masashi TAKEDA; Hiromitsu KOMATSU; Kouichirou ONO
- Web page: https://patentgrep.com/patent/US20170256283A1

## CPC

- G11B 20/10527: {Audio or video recording; Data buffering arrangements (G11B20/12 - G11B20/18 take precedence)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G11B 20/10: Digital recording or reproducing
- G11B 27/031: Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B 27/102: {Programmed access in sequence to addressed parts of tracks of operating record carriers (access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816)}
- G11B 27/19: by using information detectable on the record carrier
- H04N 5/765: Interface circuits between an apparatus for recording and another apparatus
- H04N 5/77: between a recording apparatus and a television camera
- H04N 5/91: Television signal processing therefor
- H04N 5/93: Regeneration of the television signal or of selected parts thereof
- H04N 9/8715: {involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal}
- H04N 21/2665: Gathering content from different sources, e.g. Internet and satellite
- G11B 2020/10537: {Audio or video recording}
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Excellent information processing device, information processing method, and information processing system capable of viewing a content without temporal and spatial limitation are provided. When an arithmetic device 120 receives position/attitude information and time information from an information device 141 on a reproduction side, this loads information of an image and audio around the position information of the device and around the time from a database 111 and reconfigures an image and audio to be reproduced from wanted viewing time from a viewpoint viewing from which is wanted. The reconfigured image and audio are reproduced while being loaded into a main storage unit 202 in the information devices 141 on the reproduction side through a network 150.

## Claims

### Claim 1

An information processing device comprising:
an information obtaining unit which obtains information of an image or audio;
a sensor information obtaining unit which obtains position/attitude information or other sensor information when the information of the image or audio is obtained; and
a storage unit which stores the obtained information of the image or audio in a database together with the sensor information.

### Claim 2 (depends on 1)

The information processing device according to claim 1, wherein
the storage unit stores the information of the image or audio in a dedicated database on a network or a database of a moving image sharing site.

### Claim 3 (depends on 1)

The information processing device according to claim 1, wherein
the storage unit corrects blurring when recording the image and audio.

### Claim 4

An information processing device comprising:
an information obtaining unit which obtains information of an image or audio stored in a database; and
an arithmetic processing unit which reproduces information at an arbitrary time point or in an arbitrary place from information which is image recorded or audio recorded at different time or in a different place.

### Claim 5 (depends on 4)

The information processing device according to claim 4, wherein
the database stores the information of the image or audio together with position/attitude information or other sensor information, and
the arithmetic processing unit reproduces the information of the image or audio with the position/attitude information of a viewpoint viewing from which is wanted and time.

### Claim 6 (depends on 5)

The information processing device according to claim 5, wherein
the arithmetic processing unit performs a reproduction process of the image or audio according to temporal difference between wanted viewing time and present time.

### Claim 7 (depends on 6)

The information processing device according to claim 6, wherein
the arithmetic processing unit generates a real-time image when the temporal difference between the wanted viewing time and the present time is smaller than a predetermined threshold.

### Claim 8 (depends on 7)

The information processing device according to claim 7, wherein
the arithmetic processing unit generates the real-time image in arbitrary place/viewpoint when spatial difference between a generated image and a real image is not smaller than a predetermined threshold.

### Claim 9 (depends on 6)

The information processing device according to claim 6, wherein
the arithmetic processing unit generates a future image when the wanted viewing time is in the future with the temporal difference from the present time not smaller than a predetermined threshold.

### Claim 10 (depends on 9)

The information processing device according to claim 9, wherein
the arithmetic processing unit generates the future image in arbitrary place/viewpoint and at arbitrary time when a spatial difference between a generated image and a real image is not smaller than a predetermined threshold and generates the future image in a fixed place, an arbitrary viewpoint, and at arbitrary time when the spatial difference is smaller than the predetermined threshold.

### Claim 11 (depends on 6)

The information processing device according to claim 6, wherein
the arithmetic processing unit generates a playback image when the wanted viewing time is in the past with the temporal difference from the present time not smaller than a predetermined threshold.

### Claim 12 (depends on 11)

The information processing device according to claim 11, wherein
the arithmetic processing unit generates the playback image in arbitrary place/viewpoint and at arbitrary time when spatial difference between a generated image and a real image is not smaller than a predetermined threshold and generates the playback image in a fixed place, an arbitrary viewpoint, and at arbitrary time when the spatial difference is smaller than the predetermined threshold.

### Claim 13

An information processing method comprising:
an information obtaining step of obtaining information of an image or audio;
a sensor information obtaining step of obtaining position/attitude information or other sensor information when the information of the image or audio is obtained; and
a storing step of storing the obtained information of the image or audio in a database together with the sensor information.

### Claim 14

An information processing method comprising:
an information obtaining step of obtaining information of an image or audio stored in a database; and
an arithmetic processing step of reproducing information at an arbitrary time point or in an arbitrary place from information which is image recorded or audio recorded at different time or in a different place.
