# US 10,620,435 B2 · Utilizing vehicle window shading to improve quality of augmented reality video

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,620,435 B2
- Document ID: US10620435B2
- Status: Granted
- Kind: B2
- Application number: 15/871,058
- Filed: 2018-01-14
- Published: 2018-06-07
- Granted: 2020-04-14
- Earliest claimed: 2015-10-26
- Assignees: Active Knowledge Ltd.
- Applicants: Active Knowledge Ltd.
- Inventors: Gil Thieberger; Ari M Frank
- Web page: https://patentgrep.com/patent/US10620435B2

## CPC

- B60R 21/04: Padded linings for the vehicle interior {; Energy absorbing structures associated with padded or non-padded linings}
- B60R 21/06: Safety nets, transparent sheets, curtains, or the like, e.g. between occupants and glass ({B60R21/026} , B60R21/11, B60R21/12, B60R21/16 take precedence)
- G02B 27/017: {Head mounted}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)}
- B60J 3/04: adjustable in transparency
- B60R 21/0134: responsive to imminent contact with an obstacle {, e.g. using radar systems}
- B60R 21/017: including arrangements for providing electric power to safety arrangements {or their actuating means, e.g. to pyrotechnic fuses or electro-mechanic valves}
- B60R 21/02: Occupant safety arrangements or fittings {, e.g. crash pads (seat belts with crash pads B60R22/14; removable children's seats having a front guard or barrier B60N2/2839)}
- B60R 21/055: Padded {or energy-absorbing} fittings {, e.g. seat belt anchors (sun visors B60J3/00; head rests B60N2/80)}
- B60R 21/36: using airbags
- B60R 2021/0004: {Frontal collision}
- B60R 2021/0006: {Lateral collision}
- B60R 2021/0034: {lying down}
- B60R 2021/0048: {Head}
- B60R 2021/01013: {Means for detecting collision, impending collision or roll-over}
- B60R 2021/01034: {Controlling a plurality of restraint devices}
- B60R 2021/01252: {Devices other than bags}
- B60R 2021/0273: {automatically movable to an operative position, e.g. in case of collision or impending collision}
- B60R 2021/343: {using deformable body panel, bodywork or components}
- B60R 2021/346: {means outside vehicle body}
- B60R 2300/105: using multiple cameras
- B62D 21/06: of X-shaped or fork-shaped construction, i.e. having members which form an X or fork as the frame is seen in plan view
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60J: WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES; REMOVABLE EXTERNAL PROTECTIVE COVERINGS SPECIALLY ADAPTED FOR VEHICLES (fastening, suspending, closing, or opening of such devices E05)
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)

## Abstract

A light shading module is integrated with a vehicle window and is configured to be in different states that involve different values of Visible Light Transmittance (VLT) of the vehicle window. A camera fixed to the vehicle takes video of the outside environment. A computer generates a video see-through (VST) of the outside environment, which is presented to the vehicle's occupant on an augmented reality device (ARD). In order to improve the image quality, the ARD operates according to different modes involving varying intensities, depending on the VLT of the window.

## Claims

### Claim 1

A system comprising:
a light shading module integrated with a vehicle window; the light shading module is configured to be in at least first and second states, wherein the Visible Light Transmittance (VLT) of the vehicle window in the first state is higher than the VLT in the second state;
a camera, fixed to the vehicle, configured to take video of the outside environment;
a computer configured to generate a video see-through (VST) based on the video; and
a head-mounted display (HMD) configured to operate according to a first mode of operation when an occupant inside the vehicle looks at the direction of the vehicle window and the light shading module is in the first state, and to operate according to a second mode of operation when the occupant looks at the direction of the vehicle window and the light shading module is in the second state;
wherein the total intensity of the VST light, emitted by the HMD and reaching the occupant's eyes, is higher in the second mode than in the first mode.

### Claim 2 (depends on 1)

The system of claim 1, wherein the vehicle is an autonomous vehicle, and the light shading module covers more than half of the front windshield in the second state.

### Claim 3 (depends on 1)

The system of claim 1, wherein in the first state the VLT is above 10% of ambient light entering through the window, in the second state the VLT is below 50% of ambient light entering through the window, and the VLT in the first state is higher than the VLT in the second state.

### Claim 4 (depends on 1)

The system of claim 1, wherein in the first state the VLT is above 70% of ambient light entering through the window, in the second state the VLT is below 30% of ambient light entering through the window, and the VLT in the first state is higher than the VLT in the second state.

### Claim 5 (depends on 1)

The system of claim 1, wherein the HMD comprises an optical see-through component and a display component; in the first mode the intensity of light that reaches the occupant's eyes via the optical see-through component is higher than the intensity of light from the VST that is emitted by the display component and reaches the occupant's eyes; and in the second mode, the intensity of light from the environment that reaches the occupant's eyes via the optical see-through component is lower than the intensity of light from the VST that is emitted by the display component and reaches the occupant's eyes.

### Claim 6 (depends on 5)

The system of claim 5, wherein the perceived contrast of the optical see-through component is better when the light shading module is in the second state compared to when the light shading module is in the first state.

### Claim 7 (depends on 1)

The system of claim 1, wherein the computer is further configured not to generate the VST when the HMD operates in the first mode.

### Claim 8 (depends on 1)

The system of claim 1, wherein the light shading module is a movable physical element configured to reduce the intensity of the ambient light entering into the vehicle compartment through the vehicle window.

### Claim 9 (depends on 8)

The system of claim 8, wherein the light shading module is unfurled from the inside of the compartment in order to block at least 50% of the ambient light intensity.

### Claim 10 (depends on 8)

The system of claim 8, wherein the light shading module is unfurled from the outside of the compartment in order to block at least 50% of the ambient light intensity.

### Claim 11 (depends on 1)

The system of claim 1, wherein the light shading module is a curtain.

### Claim 12 (depends on 1)

The system of claim 1, wherein the vehicle window is made of a material able to change its transparency properties.

### Claim 13 (depends on 1)

The system of claim 1, wherein the VST represents the outside environment from a point of view of the occupant while looking at the outside environment through at least a portion of the vehicle window.

### Claim 14 (depends on 1)

The system of claim 1, further comprising an occupant tracking module configured to calculate the point of view of the occupant based on measurements of a sensor.

### Claim 15 (depends on 14)

The system of claim 14, wherein the computer is further configured to render the VST based on data received from the occupant tracking module.

### Claim 16 (depends on 15)

The system of claim 15, wherein the HMD comprises an optical see-through component and a display component, and the display component is a three dimensional (3D) display configured to show the occupant the VST, such that point of gaze of the occupant, while looking via the 3D display, is most of the time beyond the location of the light shading module.

### Claim 17 (depends on 15)

The system of claim 15, wherein the HMD is an augmented reality device.