# US 2017/0287522 A1 · Information processing apparatus, information processing method, and storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0287522 A1
- Document ID: US20170287522A1
- Status: Published application
- Kind: A1
- Application number: 15/459,733
- Filed: 2017-03-15
- Published: 2017-10-05
- Earliest claimed: 2016-03-31
- Assignees: Canon Kabushiki Kaisha
- Applicants: Canon Kabushiki Kaisha
- Inventors: Eiji Imao
- Web page: https://patentgrep.com/patent/US20170287522A1

## CPC

- G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G06F 16/5854: {using shape and object relationship}
- G06F 16/5866: {using information manually generated, e.g. tags, keywords, comments, manually generated location and time information}
- H04L 65/65: Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
- H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04N 1/00244: {with a server, e.g. an internet server (fax-servers or the like for store and forward H04N1/324)}
- H04N 1/32128: {attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image (for information embedded in the image H04N1/32144)}
- H04N 5/77: between a recording apparatus and a television camera
- H04N 21/6437: Real-time Transport Protocol [RTP]
- H04N 21/8547: involving timestamps for synchronizing content
- H04N 2201/0084: Digital still camera
- H04N 2201/3215: of a time or duration
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing apparatus includes an acquisition unit configured to acquire a first type of data, a generation unit configured to generate a type of time information according to time information of a second type of data among a plurality of types of time information as time information of the first type of data, and a transmission unit configured to transmit the first type of data and the time information of the first type of data that is generated by the generation unit to an external apparatus, which is configured to receive the first type of data and the second type of data from plurality of apparatuses and then perform processing while associating the first type of data and second type of data with each other.

## Claims

### Claim 1

An information processing apparatus comprising:
an acquisition unit configured to acquire a first type of data;
a generation unit configured to generate a type of time information according to time information of a second type of data among a plurality of types of time information as time information of the first type of data; and
a transmission unit configured to transmit the first type of data and the time information of the first type of data to an external apparatus, the external apparatus being configured to receive the first type of data and the second type of data from plurality of apparatuses and then perform processing while associating the first type of data and second type of data with each other.

### Claim 2 (depends on 1)

The information processing apparatus according to claim 1, further comprising:
a second acquisition unit configured to acquire the second type of data; and
a second transmission unit configured to transmit the second type of data and the time information of the second type of data to the external apparatus,
wherein the generation unit generates the type of time information according to the time information of the second type of data among the plurality of types of time information as the time information of the first type of data.

### Claim 3 (depends on 2)

The information processing apparatus according to claim 2, wherein the generation unit selects any time information from pieces of time information of a plurality of pieces of the second type of data, and generates the selected time information as the time information of the first type of data.

### Claim 4 (depends on 3)

The information processing apparatus according to claim 3,
wherein the acquisition unit acquires the first type of data having the time information, and
wherein the generation unit selects any time information from the pieces of time information of the plurality of pieces of the second data, based on the time information contained in the first type of data, and generates the selected time information as the time information of the first type of data.

### Claim 5 (depends on 3)

The information processing apparatus according to claim 3, wherein the generation unit selects any time information from the pieces of time information of the plurality of pieces of the second type of data, based on a timing at which the acquisition unit acquires the first type of data, and generates the selected time information as the time information of the first type of data.

### Claim 6 (depends on 2)

The information processing apparatus according to claim 2,
wherein the acquisition unit acquires a detection result detected by an external sensor as the first type of data, and
wherein the second acquisition unit acquires a captured image as the second type of data by carrying out imaging.

### Claim 7 (depends on 1)

The information processing apparatus according to claim 1,
wherein the acquisition unit acquires the first type of data having the time information, and
wherein the generation unit generates the time information of the first type of data by converting the time information contained in the first type of data into a type of the time information according to the time information of the second type of data.

### Claim 8 (depends on 1)

The information processing apparatus according to claim 1, wherein the generation unit generates the time information of the first type of data by converting the time information contained in the first type of data from a type of time information expressing a time point into a type of time information expressing a time period elapsed from a predetermined moment.

### Claim 9 (depends on 1)

The information processing apparatus according to claim 1, wherein the generation unit generates the type of time information according to the time information of the second type of data based on a timing at which the acquisition unit acquires the first type of data as the time information of the first type of data.

### Claim 10 (depends on 1)

The information processing apparatus according to claim 1, further comprising a determination unit configured to determine whether the first type of data is data to be associated with the second type of data that is received by the external apparatus,
wherein the generation unit generates the type of time information according to the time information of the second type of data as time information of data that is the first type of data and is determined to be the data to be associated.

### Claim 11 (depends on 1)

The information processing apparatus according to claim 1, wherein the generation unit generates a same type of time information as the time information of the second type of data among the plurality of types of time information as the time information of the first type of data.

### Claim 12 (depends on 1)

The information processing apparatus according to claim 1,
wherein the first type of data is a detection result detected by a sensor;
wherein the second type of data is a captured image, and
wherein the processing that the external apparatus performs while associating the first type of data and the second type of data with each other includes processing for performing control so as to display the second type of data having time information matching or close to the time information of the first type of data received by the external apparatus.

### Claim 13 (depends on 1)

The information processing apparatus according to claim 1, wherein the first type of data includes at least any one of information indicating that a predetermined event is detected by a sensor and information of a numerical value acquired from measurement carried out by a sensor.

### Claim 14 (depends on 2)

The information processing apparatus according to claim 2, wherein the second transmission unit transmits the second type of data and the time information of the acquired second type of data to the external apparatus by streaming based on Real-time Transport Protocol (RTP).

### Claim 15

An information processing method comprising:
acquiring a first type of data, as acquisition;
generating a type of time information according to time information of a second type of data among a plurality of types of time information as time information of the first type of data, as generation; and
transmitting the first type of data and the time information of the first type of data that is generated in the generation to an external apparatus, the external apparatus being configured to receive the first type of data and the second type of data from plurality of apparatuses and then perform processing while associating the first type of data and second type of data with each other, as transmission.

### Claim 16 (depends on 15)

The information processing method according to claim 15, further comprising:
acquiring the second type of data, as second acquisition; and
transmitting the second type of data and the time information of second type of data to the external apparatus, as second transmission,
wherein, in the generation, the type of time information according to the time information of the second type of data that is transmitted in the second transmission, among the plurality of types of time information, is generated as the time information of the first type of data.

### Claim 17 (depends on 15)

The information processing method according to claim 15,
wherein, in the acquisition, the first type of data having the time information is acquired, and
wherein, in the generation, the time information of the first type of data is generated by converting the time information contained in the first type of data into the type of the time information according to the time information of the second type of data.

### Claim 18

A storage medium storing a computer executable program for performing an information processing method, the method comprising:
acquiring a first type of data, as acquisition;
generating a type of time information according to time information of a second type of data among a plurality of types of time information as time information of the first type of data, as generation; and
transmitting the first type of data and the time information of the first type of data that is generated in the generation to an external apparatus, the external apparatus being configured to receive the first type of data and the second type of data from plurality of apparatuses and then perform processing while associating the first type of data and second type of data with each other, as transmission.

### Claim 19 (depends on 18)

The storage medium according to claim 18, further comprising:
acquiring the second type of data, as second acquisition; and
transmitting the second type of data and the time information of second type of data to the external apparatus, as second transmission,
wherein, in the generation, the type of time information according to the time information of the second type of data that is transmitted in the second transmission, among the plurality of types of time information, is generated as the time information of the first type of data.

### Claim 20 (depends on 18)

The storage medium according to claim 18,
wherein, in the acquisition, the first type of data having the time information is acquired, and
wherein, in the generation, the time information of the first type of data is generated by converting the time information contained in the first type of data into the type of the time information according to the time information of the second type of data.
