# US 9,438,796 B2 · Apparatus and method for capturing panoramic images and motion

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 9,438,796 B2
- Document ID: US9438796B2
- Status: Granted
- Kind: B2
- Application number: 14/927,984
- Filed: 2015-10-30
- Published: 2016-02-18
- Granted: 2016-09-06
- Earliest claimed: 2004-07-30
- Assignees: EyeSee360, Inc.
- Applicants: EyeSee360, Inc.
- Inventors: Michael Rondinelli; Anthony Stentz; Sanjiv Singh; Herman Herman
- Web page: https://patentgrep.com/patent/US9438796B2

## CPC

- H04N 21/43074: {of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV programme}
- H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56)
- H04N 5/144: {Movement detection (for video coding H04N19/503; analysis of motion in general G06T7/20)}
- H04N 5/76: Television signal recording
- H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure}
- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 9/89: Time-base error compensation
- H04N 21/41415: {involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk}
- H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)}
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An imaging system comprising a panoramic visual image display, an associated directional sound playback device, and an associated motion reproduction device is disclosed. The imaging system conveys visual, sound and motion information related to a particular viewing direction to provide a realistic experience for the viewer. The imaging system can also comprise a panoramic visual image recording device capable of recording panoramic images, an associated directional sound capturing device capable of recording sound, and an associated directional motion capturing device capable of recording motion. Recorded panoramic images, sound and motion can be synchronously recorded to a common time code for simultaneous playback.

## Claims

### Claim 1

An apparatus comprising:
a panoramic image capturing device capable of recording panoramic visual images comprising a plurality of cameras; and
a motion capturing device capable of recording motion of the panoramic visual image capturing device to produce captured motion data that can be synchronized with the panoramic visual images captured by the panoramic visual image capturing device, and can be associated with a particular image view corresponding to only a portion of the panoramic visual images.

### Claim 2 (depends on 1)

The apparatus of claim 1, further comprising a sound capturing device capable of recording sound associated with viewing directions for the panoramic visual images.

### Claim 3 (depends on 2)

The apparatus of claim 2, comprising a plurality of the sound capturing devices.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the sound capturing devices are located on the panoramic image capturing device.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the motion capturing device comprises a gyroscopic motion sensor.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the motion capturing device captures linear velocity.

### Claim 7 (depends on 1)

The apparatus of claim 1, wherein the motion capturing device captures rotational velocity.

### Claim 8 (depends on 1)

The apparatus of claim 1, wherein the motion capturing device captures acceleration.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the motion capturing device captures pitch and/or yaw.

### Claim 10 (depends on 1)

The apparatus of claim 1, further comprising at least one additional motion capturing device positioned remotely from the panoramic visual image capturing device.

### Claim 11

A method comprising the steps of:
recording panoramic visual images with a panoramic image capturing device comprising a plurality of cameras;
recording motion of the panoramic visual image capturing device to produce captured motion data; and
synchronizing the captured motion data with the panoramic visual images captured by the panoramic visual image capturing device, wherein the captured motion data can be associated with a particular image view corresponding to only a portion of the panoramic visual images.

### Claim 12 (depends on 11)

The method of claim 11, further comprising recording sound associated with viewing directions for the panoramic visual images.

### Claim 13 (depends on 12)

The method of claim 12, comprising a plurality of the sound capturing devices.

### Claim 14 (depends on 13)

The method of claim 13, wherein the sound capturing devices are located on the panoramic image capturing device.

### Claim 15 (depends on 11)

The method of claim 11, wherein the motion of the panoramic visual image capturing device is captured with a gyroscopic motion sensor.

### Claim 16 (depends on 11)

The method of claim 11, wherein the recorded motion comprises linear velocity of the panoramic image capturing device.

### Claim 17 (depends on 11)

The method of claim 11, wherein the recorded motion comprises rotational velocity of the panoramic image capturing device.

### Claim 18 (depends on 11)

The method of claim 11, wherein the recorded motion comprises acceleration of the panoramic image capturing device.

### Claim 19 (depends on 11)

The method of claim 11, wherein the recorded motion comprises pitch and/or yaw of the panoramic image capturing device.
