# US 2020/0402318 A1 · 360 Degree Camera Apparatus with Augmented Reality

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0402318 A1
- Document ID: US20200402318A1
- Status: Published application
- Kind: A1
- Application number: 17/008,904
- Filed: 2020-09-01
- Published: 2020-12-24
- Earliest claimed: 2015-04-14
- Assignees: ETAK Systems, LLC
- Applicants: ETAK Systems, LLC
- Inventors: Charlie Terry; James Perry; Lee Priest
- Web page: https://patentgrep.com/patent/US20200402318A1

## CPC

- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- G06T 17/05: Geographic models
- H04N 7/181: {for receiving images from a plurality of remote sources}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/50: Constructional details
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- H04N 23/631: {Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters}
- H04N 23/662: {by using camera arrangements where one camera controls another camera to affect the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image}
- H04N 23/695: Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Systems and methods include a monitoring system. The monitoring system includes a camera apparatus and a server. The camera apparatus includes a mounting base adapted to mount to a structure and a plurality of sensors including an array of image sensors arranged to simultaneously capture a combined 360 degree view around the camera apparatus. The server includes a network interface and a processor communicatively coupled to one another. The server also includes memory storing instructions that, when executed, cause the processor to obtain a data from the camera apparatus including a plurality of images from the combined 360 degree view around the camera apparatus, generate a model of the commercial location using the data, and display information from the model within images from the combined 360 degree view to a user while a user is viewing the images in real time.

## Claims

### Claim 1

A monitoring system for monitoring a commercial location, comprising:
a camera apparatus including
a mounting base adapted to mount to a structure, and
a plurality of sensors including an array of image sensors arranged to simultaneously capture a combined 360 degree view around the camera apparatus; and
a server including
a network interface and a processor communicatively coupled to one another; and
memory storing instructions that, when executed, cause the processor to
obtain a data from the camera apparatus including a plurality of images from the combined 360 degree view around the camera apparatus,
generate a model of the commercial location using the data, and
display information from the model within images from the combined 360 degree view to a user while a user is viewing the images in real time.

### Claim 2 (depends on 1)

The monitoring system of claim 1, wherein the information displayed within the images includes measurements of at least one of dimensions of equipment and dimensions of available space within the commercial location.

### Claim 3 (depends on 1)

The monitoring system of claim 1, wherein the memory storing the instructions that, when executed, cause the processor to insert a virtual object representing equipment for the commercial space into the images and displaying the virtual object with the images to the user in real time.

### Claim 4 (depends on 1)

The monitoring system of claim 1, wherein the array of image sensors is arranged in a circular pattern.

### Claim 5 (depends on 1)

The monitoring system of claim 1, wherein the memory storing the instructions that, when executed, cause the processor to, upon receipt of an instruction from a user, obtain updated data from the camera apparatus including an updated plurality of images and update the model of the commercial location.

### Claim 6 (depends on 1)

The monitoring system of claim 1, wherein the camera apparatus is configured to provide a plurality of images that form the combined 360 degree view around the camera apparatus in real time by one of streaming images taken on a regular interval and streaming video from the array of image sensors.

### Claim 7 (depends on 1)

The monitoring system of claim 1, wherein the memory storing the instructions that, when executed, cause the processor to provide multiple images from the camera apparatus simultaneously and to stitch multiple views from the camera apparatus together.

### Claim 8

A non-transitory computer-readable medium comprising instructions that, when executed, cause a processor to perform the steps of:
obtain a data from a camera apparatus including a plurality of images captured using an array of image sensors arranged to simultaneously capture a combined 360 degree view around the camera apparatus;
generate a model of the commercial location using the data; and
display information from the model within images from the combined 360 degree view to a user while a user is viewing the images in real time.

### Claim 9 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the information displayed within the images includes measurements of at least one of dimensions of equipment and dimensions of available space within the commercial location.

### Claim 10 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions that, when executed, cause the processor to insert a virtual object representing equipment for the commercial space into the images and displaying the virtual object with the images to the user in real time.

### Claim 11 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the array of image sensors is arranged in a circular pattern.

### Claim 12 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions that, when executed, cause the processor to, upon receipt of an instruction from a user, obtain updated data from the camera apparatus including an updated plurality of images and update the model of the commercial location.

### Claim 13 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the plurality of images obtained are obtained in real time and are one of streaming images taken on a regular interval and streaming video from the array of image sensors.

### Claim 14 (depends on 8)

The non-transitory computer-readable medium of claim 8, wherein the instructions that, when executed, cause the processor to provide multiple images from the camera apparatus simultaneously and to stitch multiple views from the camera apparatus together.

### Claim 15

A method for monitoring a commercial location, comprising:
obtaining a data from a camera apparatus including a plurality of images captured using an array of image sensors arranged to simultaneously capture a combined 360 degree view around the camera apparatus;
generating a model of the commercial location using the data; and
displaying information from the model within images from the combined 360 degree view to a user while a user is viewing the images in real time.

### Claim 16 (depends on 15)

The method of claim 15, wherein the information displayed within the images includes measurements of at least one of dimensions of equipment and dimensions of available space within the commercial location.

### Claim 17 (depends on 15)

The method of claim 15, further comprising insert a virtual object representing equipment for the commercial space into the images and displaying the virtual object with the images to the user in real time.

### Claim 18 (depends on 15)

The method of claim 15, wherein further comprising insert a virtual object representing equipment for the commercial space into the images and displaying the virtual object with the images to the user in real time.

### Claim 19 (depends on 15)

The method of claim 15, wherein the plurality of images obtained are obtained in real time and are one of streaming images taken on a regular interval and streaming video from the array of image sensors.

### Claim 20 (depends on 15)

The method of claim 15, further comprising providing multiple images from the camera apparatus simultaneously and to stitch multiple views from the camera apparatus together.
