US 11,082,635 B2 · Systems and methods for video display

Abstract

Implementations provide an aircraft synthetic vision system (“SVS”) giving passengers an exterior view. Omitting windows reduces costs, lowers weight, and simplifies hypersonic aircraft design and construction. Unlike contemporary SVSs, no lag exists between the exterior view and actual aircraft motion. Passengers experience no airsickness associated with a visual and vestibular system feedback mismatch. Lag is eliminated by predicting aircraft interior motion based on sensor feedback, and (b) displaying video camera images transformed to match the predicted aircraft orientation when the images get through the display system latency. Implementations predict aircraft orientation and pre-transform—through the use of dead reckoning to adjust a video signal based on sensed aircraft dynamics and an aircraft electronic model—an image captured from a video camera to match that orientation at the image display time. This approach is robust, cheaper, and more effective than conventional SVS at providing an airsickness-free view of the aircraft exterior.

Claims31

Dependent claims

A display system comprising:

an inertial measuring system (IMS) configured to sense dynamics of an aircraft;
a video camera configured to image an external scene;
a video display system inside the aircraft;
and
an image processing sub-system comprising a video processor, the image processing sub-system configured to:
access an electronic model of the aircraft and compare the dynamics sensed by the IMS to the electronic model to compute a response to the sensed dynamics as a function of time,
predict a movement of the aircraft using the computed response, the predicted movement of the aircraft comprising a prediction of a change in an orientation of an aircraft interior between a first time, when the video camera acquires an image frame imaged by the video camera, and a second time, when the image frame appears on the video display system,
estimate a lag between a scene and the external scene imaged by the video camera based on the predicted movement, and
generate video signals comprising the image frame that are pre-compensated for the lag to drive the video processor to display on the video display system a lag compensated video image of the external scene, the lag compensated video image of the external scene being:
transformed by the video processor to match the predicted movement of the aircraft from the first time to the second time, and
displayed on the video display system at the second time.

8 more elements

A method for video display comprising:

sensing dynamics of an aircraft using an inertial measuring system (IMS);
imaging an external scene using a video camera;
displaying the external scene imaged by the video camera using a video display
system inside the aircraft;
configuring an image processing sub-system comprising a video processor to processor to access an electronic model of the aircraft;
comparing the dynamics sensed by the IMS to the electronic model to compute a response to the sensed dynamics as a function of time;
predicting a movement of the aircraft using the computed response, the predicted movement of the aircraft comprising a prediction of a change in an orientation of an aircraft interior between a first time, when the video camera acquires an image frame imaged by the video camera, and a second time, when the image frame appears on the video display system;
estimating a lag between a scene and the external scene imaged by the video camera based on the predicted movement;
and
generating video signals comprising the image frame that are pre-compensated for the lag to drive the video processor to display on the video display system a lag compensated video image of the external scene, the lag compensated video image of the external scene being:
transformed by the video processor to match the predicted movement of the aircraft from the first time to the second time, and
displayed on the video display system at the second time.

9 more elements

One or more non-transitory computer readable media having computer-executable instructions stored thereon for video display, which, on execution by a computer, cause the computer to perform operations comprising:

sensing dynamics of an aircraft using an inertial measuring system (IMS);
imaging an external scene using a video camera;
displaying the external scene imaged by the video camera using a video display system inside the aircraft;
configuring an image processing sub-system comprising a video processor to processor to access an electronic model of the aircraft and:
compare the dynamics sensed by the IMS to the electronic model to compute a response to the sensed dynamics as a function of time;
predict a movement of the aircraft using the computed response, the predicted movement of the aircraft comprising a prediction of a change in an orientation of an aircraft interior between a first time, when the video camera acquires an image frame imaged by the video camera, and a second time, when the image frame appears on the video display system;
estimate a lag between a scene and the external scene imaged by the video camera based on the predicted movement;
and
generate video signals comprising the image frame that are pre-compensated for the lag to drive the video processor to display on the video display system a lag compensated video image of the external scene, the lag compensated video image of the external scene being:
transformed by the video processor to match the predicted movement of the aircraft from the first time to the second time, and
displayed on the video display system at the second time.

8 more elements

A display system comprising:

an inertial measuring system (IMS) configured to sense dynamics of an aircraft;
a video camera configured to image an external scene;
a video display system inside the aircraft;
and
an image processing sub-system comprising a video processor, the image processing sub-system configured to:
access an electronic model of the aircraft and compare the dynamics sensed by the IMS to the electronic model,
predict a movement of the aircraft to estimate a lag between a scene and the external scene imaged by the video camera based on the predicted movement, and
generate video signals comprising the image frame that are pre-compensated for the lag to drive the video processor to display on the video display system a lag compensated video image of the external scene, the lag compensated video image of the external scene being:
transformed by the video processor to match the predicted movement of the aircraft from the first time to the second time, and
displayed on the video display system at the second time.

7 more elements

Dependencies are inferred from the claim text.

Systems and methods for video display

Life of this patent

Systems and methods for video display

Life of this patent

Abstract

Claims31