System for georeferenced, geo-oriented realtime video streams
AssigneeADCOR MAGnet Systems, LLC
InventorsEvangelos Foutzitzis, Javier Santoro
Life of this patent
Estimating the term…
Abstract
A system for creating a composite georeferenced, geo-oriented geospatial/realtime image by combining prestored geographic data with realtime video streams and state data characterizing the source of the realtime video stream and visually displaying the composite image under a user's realtime control.
Claims20
A process for generating a 3-Dimensional, georeferenced, geo-oriented realtime hybrid video comprising,
- providing a platform coupled to a video camera controlled by a remote control device, a GPS device coupled to said video camera so as to determine the location of the video camera, a clock colocated with said video camera so as to enable determination of the time at which an image captured by said video camera was captured, a 3-Axis compass mounted to said platform in such a manner as to enable determination of the attitude of said video camera at any given time and a processor electronically connected to each of said video camera, said clock and said 3-axis compass in such a manner as to allow it to receive data from said video camera, said clock and said 3-axis compass and transmit said data to a computer via a communications network;
- activating said video camera by said remote control device when said video camera is able to capture a realtime image of interest, simultaneously activating capture of location information by said GPS device, capture of the time by said clock and capture of attitude information by said 3-axis computer;
- collecting the information so captured by the processor and conversion of said data to a form compatible with transmission via the network;
- transmitting the information so captured to the computer via a network;
- receiving the information so captured by said computer;
- providing said computer with access to a database of topographical information and database management software;
- instructing said computer to access the topographical information associated with the location from which the realtime image was captured;
- instructing said computer to fuse said topographical information with said realtime information so as to generate a 3-Dimensional, georeferenced, geo-oriented realtime hybrid image comprising the fused topographical image and realtime image;
- displaying said fused topographical image and realtime image on a monitor.
A process for creating an embodiment of video information and associated environmental information comprising:
- simultaneously acquiring a stream of video information and an associated stream of environmental information;
- multiplexing said stream of video information with said stream of environmental information so as to create a multiplexed stream of information;
- transmitting said multiplexed stream of information to a remote location;
- receiving said multiplexed stream as an input to a computer having a receiver capable of receiving said multiplexed stream, a processor capable of demultiplexing said multiplexed stream into a stream of video information and a stream of environmental information and converting them into a visually display;
- demuliplexing said multiplexed stream into a stream of video information and a stream of environmental information;
- providing said computer with access to a database of topographical information and database management software;
- instructing said computer to access the topographical information associated with the location from which the stream of video information was captured;
- instructing said computer to fuse said topographical information with said stream of video information so that the stream of video information is displayed on a virtual map at a location corresponding on said map with the physical location from which the stream of video information was captured;
- and displaying said stream of video information so located on said map on a monitor.
A computer system for displaying geo-referenced, geo-orientated video images on a map image, comprising:
- a user computing device including a display device and a processor coupled to the display device, the processor programmed to:
- receive a data feed from a mobile computing device, the mobile computing device including a location sensor, an orientation sensor and a camera including an imaging sensor, the data feed including video image data acquired by the imaging sensor, location data acquired by the location sensor, and orientation data acquired by the orientation sensor;
- determine a location of the mobile computing device based on the received location data;
- generate and display a 3-dimensional (3D) map image on the display device including the determined location of the mobile computing device;
- generate and display a camera location icon on the 3D map image at the determined location of the mobile computing device;
- determine an orientation of the mobile computing device based on the orientation data and generate and display a video frame object overlaying a portion of the 3D map image, the video frame object being displayed having an orientation matching the determined orientation of the camera of the mobile computing device;
- and
- display the video images acquired by the imaging sensor onto the video frame object.
A method of operating a user computing device for generating a geo-referenced, geo-orientated video images on a map image, the user computing device including a display device and a processor coupled to the display device, the method comprising the processor performing the steps of:
- receiving a data feed from a mobile computing device, the mobile computing device including a location sensor, an orientation sensor and a camera including an imaging sensor, the data feed including video image data acquired by the imaging sensor, location data acquired by the location sensor, and orientation data acquired by the orientation sensor;
- determining a location of the mobile computing device based on the received location data;
- generating and displaying a 3-dimensional (3D) map image on the display device including the determined location of the mobile computing device;
- generating and displaying a camera location icon on the 3D map image at the determined location of the mobile computing device;
- determining an orientation of the mobile computing device based on the orientation data and generate and display a video frame object overlaying a portion of the 3D map image, the video frame object being displayed having an orientation matching the determined orientation of the camera of the mobile computing device;
- and
- displaying the video images acquired by the imaging sensor onto the video frame object.
Dependencies are inferred from the claim text.