# US 2018/0027181 A1 · Method to capture, store, distribute, share, stream and display panoramic image or video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0027181 A1
- Document ID: US20180027181A1
- Status: Published application
- Kind: A1
- Application number: 15/656,647
- Filed: 2017-07-21
- Published: 2018-01-25
- Earliest claimed: 2016-07-22
- Assignees: 6115187 Canada, D/B/A Immervision
- Applicants: 6115187 Canada, d/b/a ImmerVision, Inc.
- Inventors: Patrice ROULET; Xiaojun DU; Pierre KONEN; Simon THIBAULT; Jocelyn PARENT; Pascale NINI; Alessandro GASPARINI; Valentin BATAILLE; Jhinseok LEE
- Web page: https://patentgrep.com/patent/US20180027181A1

## CPC

- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G03B 37/00: Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B 37/04: with cameras or projectors providing touching or overlapping fields of view
- G06T 5/70: Denoising; Smoothing
- H04N 5/2628: {Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/57: Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The present invention is a system for capturing and assembling panoramic image data having a panoramic image capture device with image assembly parameters and configured to capture image content data, an encoding device coupled to the panoramic image capture device and configured to combine the image content data and the image assembly parameters into a panoramic image file, and a decoding device configured to receive the panoramic image file and assemble, based on the image assembly parameters, at least a portion of the image content data into an output image.

## Claims

### Claim 1

A system for capturing and assembling panoramic image data, the system comprising:
(a) a panoramic image capture device having image assembly parameters, the panoramic image capture device configured to capture image content data;
(b) an encoding device coupled to the panoramic image capture device, the encoding device configured to combine the image content data and the image assembly parameters into a panoramic image file; and
(c) a decoding device configured to receive the panoramic image file and assemble, based on the image assembly parameters, at least a portion of the image content data into an output image.

### Claim 2 (depends on 1)

The system of claim 1, wherein the panoramic capture device comprises a plurality of camera modules configured to capture the image content data from multiple perspectives.

### Claim 3 (depends on 2)

The system of claim 2, wherein at least two of the plurality of camera modules are in a generally back-to-back configuration.

### Claim 4 (depends on 2)

The system of claim 2, wherein at least two of the plurality of camera modules are in a generally side-by-side configuration.

### Claim 5 (depends on 2)

The system of claim 2, wherein the panoramic image capture device further comprises an image processing unit configured to synchronize data from the plurality of camera modules.

### Claim 6 (depends on 1)

The system of claim 1, wherein the image assembly parameters comprise at least the relative position and orientation of the capture device.

### Claim 7 (depends on 1)

The system of claim 1, wherein the panoramic image capture device comprises an image processing unit configured to reduce differences between different images captured in multiple directions.

### Claim 8 (depends on 7)

The system of claim 7, wherein the image processing unit in the panoramic capture device uses at least one of the image assembly parameters to evaluate differences between the different images.

### Claim 9 (depends on 1)

The system of claim 1, wherein the panoramic capture device comprises a camera module configured to capture the image content data from multiple perspectives.

### Claim 10 (depends on 1)

The system of claim 1, wherein the decoding device selectively assembles multiple portions of the image content data into the output image using the image assembly parameters.

### Claim 11 (depends on 1)

The system of claim 1, wherein the panoramic image capture device captures multiple original images and combines the multiple original images in the image content data.

### Claim 12 (depends on 1)

The system of claim 1, wherein the image content data comprises an image pixel density ratio of the image capture device.

### Claim 13 (depends on 1)

The system of claim 1, wherein the image assembly parameters are encoded with at least one marker to create at least one marked image.

### Claim 14 (depends on 1)

The system of claim 1, wherein the image content data and at least some image assembly parameters are captured in real time.

### Claim 15 (depends on 1)

The system of claim 1, wherein the image assembly parameters comprise at least one of an orientation of the capture device, a scene image content position, an orientation of the image content data, a size of an image, a speed of the panoramic image capture device, an acceleration of the panoramic image capture device, a distance of an object from the panoramic image capture device, and information of the mechanical parts of the image capture device visible inside the image field of view.

### Claim 16 (depends on 1)

The system of claim 1, wherein the panoramic image capture device comprises a wide-angle camera module.

### Claim 17

A method for capturing and assembling panoramic image data, the method comprising:
(a) capturing, using a panoramic image capture device having image assembly parameters, image content data;
(b) encoding the image content data and the image assembly parameters into a panoramic image file; and
(c) assembling, based on the image assembly parameters, at least a portion of the image content data into an output image.

### Claim 18

A method for receiving and assembling panoramic image data, the method comprising:
(a) receiving a panoramic image file, the panoramic image file including image assembly parameters and image content data; and
(b) assembling, based on the image assembly parameters, at least a portion of the image content data into an output image.

### Claim 19

A panoramic imager comprising:
(a) a panoramic image capture device having image assembly parameters, the panoramic image capture device configured to capture image content data;
(b) an encoding device electrically coupled to the panoramic image capture device, the encoding device configured to encode the image content data and the image assembly parameters into a panoramic image file; and
(c) a decoding device configured to receive the panoramic image file and assemble, based on the image assembly parameters, at least a portion of the image content data into an output image.

### Claim 20 (depends on 19)

The panoramic imager of claim 19, wherein the decoding device is further configured to communicate to the panoramic image capture device which part of the native panoramic images are displayed.

### Claim 21 (depends on 1)

The panoramic imager of claim 1, further comprising:
(d) a decoding device configured to communicate to the panoramic image capture device information computed during the image assembly.
