# US 2018/0324361 A1 · Video display system, video display device, and video display method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0324361 A1
- Document ID: US20180324361A1
- Status: Published application
- Kind: A1
- Application number: 16/033,668
- Filed: 2018-07-12
- Published: 2018-11-08
- Earliest claimed: 2015-07-14
- Assignees: Panasonic Intellectual Property Management Co., Ltd.
- Applicants: Panasonic Intellectual Property Management Co., Ltd.
- Inventors: Ryoji OGINO; Junya KUWADA; Hiroyasu MAKINO
- Web page: https://patentgrep.com/patent/US20180324361A1

## CPC

- H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 3/147: using display panels
- G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A video image processing device uses a plurality of video data captured by a plurality of cameras to generate a wide range video data of the entire celestial sphere having a 360-degree range around an area where the plurality of cameras is installed and to transmit the generated wide range video data of the entire celestial sphere to a video display device. The video display device detects a direction of the video display device as a direction of a sight line of the user, receives the transmitted wide range video data of the entire celestial sphere, segments a predetermined area of video data including a detection result of a sensor from the wide range video data of the entire celestial sphere, adjusts a luminosity of the extracted predetermined area of video data to fall in a certain range of luminosity, and displays the adjusted predetermined area of video data.

## Claims

### Claim 1

A video display system comprising:
a video image processing device that retains a plurality of video data captured by a plurality of cameras and is connected to the video display system; and
a video display device that is wearable by a user and is connected to the video display system,
wherein the video image processing device includes
a video generator that uses the plurality of video data to generate a wide range video data of the entire celestial sphere having a 360-degree range around an area where the plurality of cameras is installed, and
a video transmitter that transmits the wide range video data of the entire celestial sphere generated by the video generator to the video display device, and
the video display device includes
a sensor that detects a direction of a sight line of the user,
a video receiver that receives the wide range video data of the entire celestial sphere transmitted from the video transmitter,
a video extractor that segments a predetermined area of video data including a detection result of the sensor from the wide range video data of the entire celestial sphere,
a luminosity adjuster that adjusts a luminosity of the predetermined area of video data extracted by the video extractor to fall in a certain range of luminosity corresponding to a luminosity of the wide range video data of the entire celestial sphere, and
a video display that displays the predetermined area of video data adjusted by the luminosity adjuster.

### Claim 2 (depends on 1)

The video display system of claim 1,
wherein the luminosity adjuster adjusts the luminosity of the predetermined area of video data to fall in the certain range when the luminosity of the predetermined area of video data is higher or lower than the certain range of luminosity corresponding to the luminosity of the wide range video data of the entire celestial sphere.

### Claim 3 (depends on 1)

The video display system of claim 1,
wherein the luminosity adjuster calculates an average value of the luminosity of the predetermined area of video data extracted by the video extractor and adjusts the calculated average value of the luminosity to fall in the certain range of luminosity.

### Claim 4 (depends on 1)

The video display system of claim 1,
wherein the video display device, each time the direction of the sight line of the user is switched, adjusts the luminosity of the predetermined area of video data segmented in accordance with the detection result of the sensor to fall in the certain range of luminosity and displays the adjusted predetermined area of video data.

### Claim 5

A video display device wearable by a user and connected with a video image processing device that retains a plurality of video data captured by a plurality of cameras, the video display device comprising:
a sensor that detects a direction of a sight line of the user;
a video receiver that receives a wide range video data of the entire celestial sphere generated by the video image processing device and having a 360-degree range around an area where the plurality of cameras is installed;
a video extractor that segments a predetermined area of video data including a detection result of the sensor from the wide range video data of the entire celestial sphere;
a luminosity adjuster that adjusts a luminosity of the predetermined area of video data extracted by the video extractor to fall in a certain range of luminosity corresponding to a luminosity of the wide range video data of the entire celestial sphere, and
a video display that displays the predetermined area of video data adjusted by the luminosity adjuster.

### Claim 6 (depends on 5)

The video display device of claim 5,
wherein the luminosity adjuster adjusts the luminosity of the predetermined area of video data to fall in the certain range when the luminosity of the predetermined area of video data is higher or lower than the certain range of luminosity corresponding to the luminosity of the wide range video data of the entire celestial sphere.

### Claim 7

A video display method for a video display device wearable by a user and connected with a video image processing device that retains a plurality of video data captured by a plurality of cameras, the method comprising:
detecting a direction of a sight line of the user;
receiving a wide range video data of the entire celestial sphere generated by the video image processing device and having a 360-degree range around an area where the plurality of cameras is installed;
segmenting a predetermined area of video data including the detected direction of the sight line of the user from the wide range video data of the entire celestial sphere;
adjusting a luminosity of the extracted predetermined area of video data to fall in a certain range of luminosity corresponding to a luminosity of the wide range video data of the entire celestial sphere; and
displaying the adjusted predetermined area of video data.

### Claim 8 (depends on 7)

The video display method of claim 7,
wherein the luminosity of the predetermined area of video data is adjusted to fall in the certain range when the luminosity of the predetermined area of video data is higher or lower than the certain range of luminosity corresponding to the luminosity of the wide range video data of the entire celestial sphere.

### Claim 9 (depends on 7)

The video display method of claim 7,
wherein an average value of the luminosity of the predetermined area of video data is calculated, and the calculated average value of the luminosity is adjusted to fall in the certain range of luminosity.

### Claim 10 (depends on 7)

The video display method of claim 7,
wherein each time the direction of the sight line of the user is switched, the luminosity of the predetermined area of video data, segmented in accordance with the detection result of the sensor, is adjusted to fall in the certain range of luminosity, and the adjusted predetermined area of video data is displayed.
