# US 2020/0007743 A1 · Camera Array Including Camera Modules

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0007743 A1
- Document ID: US20200007743A1
- Status: Published application
- Kind: A1
- Application number: 16/569,067
- Filed: 2019-09-12
- Published: 2020-01-02
- Earliest claimed: 2014-07-28
- Assignees: Jaunt Inc.
- Applicants: Jaunt Inc.
- Inventors: Arthur van Hoff; Thomas M. Annau; Jens Christensen; Koji Gardiner
- Web page: https://patentgrep.com/patent/US20200007743A1

## CPC

- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)}
- G06F 3/04815: Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0241: Advertisements
- G06Q 30/0246: {Traffic}
- G06Q 30/0251: Targeted advertisements
- G06Q 30/0263: {based upon Internet or website rating}
- G06Q 30/0269: {based on user profile or attribute}
- G06Q 30/0277: {Online advertisement}
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G11B 27/11: by using information not detectable on the record carrier
- G11B 27/34: Indicating arrangements {(indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D)}
- G11B 31/006: {with video camera or receiver}
- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- H04N 13/111: Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation
- H04N 13/189: Recording image signals; Reproducing recorded image signals
- H04N 13/243: using three or more two-dimensional [2D] image sensors
- H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps
- H04N 13/282: for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
- H04N 23/661: Transmitting camera control signals through networks, e.g. control via the Internet
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06Q 30/0273: Determination of fees for advertising
- G06Q 30/0284: {Time or distance, e.g. usage of parking meters or taximeters}
- G06T 2207/10012: Stereo images
- G06T 2207/20228: Disparity calculation for image-based rendering
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 13/204: using stereoscopic image cameras (stereoscopic photography G03B35/00)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R)

## Abstract

The disclosure includes a camera array comprising camera modules, the camera modules comprising a master camera that includes a processor, a memory, a sensor, a lens, a status indicator, and a switch, the switch configured to instruct each of the camera modules to initiate a start operation to start recording video data using the lens and the sensor in the other camera modules and the switch configured to instruct each of the camera modules to initiate a stop operation to stop recording, the status indicator configured to indicate a status of at least one of the camera modules.

## Claims

### Claim 1

A system comprising:
a camera array comprising a set of camera modules that are each substantially identical relative to one another and communicatively coupled to one another via a daisy chain; and
an aggregation system stored on a memory and executed by one or more processors, the aggregation system operable to:
receive video data describing image frames from the camera array captured by the set of camera modules;
stitch the image frames together based on a frame sync signal and a relative position of each camera module of the set of camera modules to generate three-dimensional video data;
determine that color deficiencies occurred in stitched image frames;
determine corrected pixel values to replace original pixel values in stitched image frames that include the color deficiencies in the three-dimensional video data; and
generate three-dimensional content that includes the corrected pixel values in a set of pixel values.

### Claim 2 (depends on 1)

The system of claim 1, wherein determining the corrected pixel values is based on a robust affine model that transforms one set of color values into another.

### Claim 3 (depends on 2)

The system of claim 2, wherein determining the corrected pixel values based on the robust affine model includes applying a downweight to outlier pixel pairs that do not correspond to a same special location.

### Claim 4 (depends on 1)

The system of claim 1, wherein the aggregation system is further operable to increase saturation of the set of pixel values.

### Claim 5 (depends on 1)

The system of claim 1, wherein each of the set of camera modules is positioned to have at least one overlapping field of view with another camera module of the set of camera modules.

### Claim 6 (depends on 5)

The system of claim 5, wherein determining the corrected pixel values includes identifying that the corrected pixel values are for corresponding pixels in the at least one overlapping field of view that do not include the color deficiencies.

### Claim 7 (depends on 5)

The system of claim 5, wherein the camera array generates a stereoscopic image based at least in part on the at least one overlapping field of view.

### Claim 8

A method comprising:
identifying, at a runtime, a camera array comprising a set of camera modules that are each substantially identical relative to one another and communicatively coupled to one another via a daisy chain;
receiving video data describing image frames from the camera array captured by the set of camera modules;
stitching the image frames together based on a frame sync signal and a relative position of each camera module of the set of camera modules to generate three-dimensional video data;
determining that color deficiencies occurred in stitched image frames;
determining corrected pixel values to replace original pixel values in stitched image frames that include the color deficiencies in the three-dimensional video data; and
generating three-dimensional content that includes the corrected pixel values in a set of pixel values.

### Claim 9 (depends on 8)

The method of claim 8, wherein determining the corrected pixel values is based on a robust affine model that transforms one set of color values into another.

### Claim 10 (depends on 9)

The method of claim 9, wherein determining the corrected pixel values based on the robust affine model includes applying a downweight to outlier pixel pairs that do not correspond to a same special location.

### Claim 11 (depends on 8)

The method of claim 8, further comprising increasing saturation of the set of pixel values.

### Claim 12 (depends on 8)

The method of claim 8, wherein each of the set of camera modules is positioned to have at least one overlapping field of view with another camera module of the set of camera modules.

### Claim 13 (depends on 12)

The method of claim 12, wherein determining the corrected pixel values includes identifying that the corrected pixel values are for corresponding pixels in the at least one overlapping field of view that do not include the color deficiencies.

### Claim 14 (depends on 12)

The method of claim 12, wherein the camera array generates a stereoscopic image based at least in part on the at least one overlapping field of view.

### Claim 15

A computer program product comprising a non-transitory computer-usable medium including a computer-readable program, wherein the computer-readable program when executed on a computer causes the computer to:
identify, at a runtime, a camera array comprising a set of camera modules that are each substantially identical relative to one another and communicatively coupled to one another via a daisy chain;
receive video data describing image frames from the camera array captured by the set of camera modules;
stitch the image frames together based on a frame sync signal and a relative position of each camera module of the set of camera modules to generate three-dimensional video data;
determine that color deficiencies occurred in stitched image frames;
determine corrected pixel values to replace original pixel values in stitched image frames that include the color deficiencies in the three-dimensional video data; and
generate three-dimensional content that includes the corrected pixel values in a set of pixel values.

### Claim 16 (depends on 15)

The computer program product of claim 15, wherein determining the corrected pixel values is based on a robust affine model that transforms one set of color values into another.

### Claim 17 (depends on 16)

The computer program product of claim 16, wherein determining the corrected pixel values based on the robust affine model includes applying a downweight to outlier pixel pairs that do not correspond to a same special location.

### Claim 18 (depends on 15)

The computer program product of claim 15, wherein the computer-readable program when executed on the computer further causes the computer to increasing saturation of the set of pixel values.

### Claim 19 (depends on 15)

The computer program product of claim 15, wherein each of the set of camera modules is positioned to have at least one overlapping field of view with another camera module of the set of camera modules.

### Claim 20 (depends on 19)

The computer program product of claim 19, wherein determining the corrected pixel values includes identifying that the corrected pixel values are for corresponding pixels in the at least one overlapping field of view that do not include the color deficiencies.
