Dynamic multi-dimensional media content projection
AssigneeFujitsu Limited
InventorYusuke Hida
Life of this patent
Estimating the term…
Abstract
In an embodiment, dynamic multi-dimensional media content is projected. Image data including 2D images depicting view of real-world is acquired. 3D polygons are detected corresponding to objects on a ground of the 2D images. 3D surface model is segmented into 3D segments including ground segments and non-ground segments. The ground segment of the 3D surface model is extracted by removing the one or more non-ground segments from the plurality of 3D segments. Corresponding information between 2D pixel coordinates in the 2D images and 3D surface coordinates of the ground segments is determined by applying a ray casting operation on the 2D images and the ground segment of the 3D surface model. The 3D polygons are projected onto the 3D surface model based on the correspondence information.
Claims18
A method, executed by a processor in an electronic device, comprising:
- acquiring image data that includes two-dimensional (2D) images depicting a view of a real-world location;
- detecting one or more 3D polygons corresponding to one or more objects on a ground region of the 2D images;
- acquiring a three-dimensional (3D) surface model of the real-world location;
- segmenting the 3D surface model into a plurality of 3D segments comprising a ground segment and one or more non-ground segments;
- and
- extracting the ground segment of the 3D surface model by removing the one or more non-ground segments from the plurality of 3D segments;
- determining, by applying a ray casting operation on the 2D images and the ground segment of the 3D surface model, correspondence information between 2D pixel coordinates in the 2D images and 3D surface coordinates of the ground segment;
- and
- projecting, based on the correspondence information, the one or more 3D polygons corresponding to the one or more objects onto the 3D surface model;
- wherein the correspondence information includes a table that includes the 2D pixel coordinates and the 3D surface coordinates corresponding to the 2D pixel coordinates.
One or more non-transitory computer-readable storage media configured to store instructions that, in response to being executed, cause an electronic device to perform operations, the operations comprising:
- acquiring image data that includes two-dimensional (2D) images depicting a view of a real-world location;
- detecting one or more 3D polygons corresponding to one or more objects on a ground region of the 2D images;
- acquiring a three-dimensional (3D) surface model of the real-world location;
- segmenting the 3D surface model into a plurality of 3D segments comprising a ground segment and one or more non-ground segments;
- and
- extracting the ground segment of the 3D surface model by removing the one or more non-ground segments from the plurality of 3D segments;
- determining, by applying a ray casting operation on the 2D images and the ground segment of the 3D surface model, correspondence information between 2D pixel coordinates in the 2D images and 3D surface coordinates of the ground segment;
- and
- projecting, based on the correspondence information, the one or more 3D polygons corresponding to the one or more objects onto the 3D surface model;
- wherein the correspondence information includes a table that includes the 2D pixel coordinates and the 3D surface coordinates corresponding to the 2D pixel coordinates.
An electronic device, comprising:
- a memory configured to store instructions;
- and
- a processor, coupled to the memory, configured to execute the instructions to perform a process comprising:
- acquiring image data that includes two-dimensional (2D) images depicting a view of a real-world location;
- detecting one or more 3D polygons corresponding to one or more objects on a ground region of the 2D images;
- acquiring a three-dimensional (3D) surface model of the real-world location;
- segmenting the 3D surface model into a plurality of 3D segments comprising a ground segment and one or more non-ground segments;
- extracting the ground segment of the 3D surface model by removing the one or more non-ground segments from the plurality of 3D segments;
- determining, by applying a ray casting operation on the 2D images and the ground segment of the 3D surface model, correspondence information between 2D pixel coordinates in the 2D images and 3D surface coordinates of the ground segment;
- and
- projecting, based on the correspondence information, the one or more 3D polygons corresponding to the one or more objects onto the 3D surface model;
- wherein the correspondence information includes a table that includes the 2D pixel coordinates and the 3D surface coordinates corresponding to the 2D pixel coordinates.
Dependencies are inferred from the claim text.