Method for reproducing object in 3D scene and virtual reality head-mounted device

A virtual reality head-mounted device, wherein the virtual reality head-mounted device comprises at least two image gatherers, a memory storing an instruction and at least one processor, wherein the at least one processor executes the following operations according to the instruction stored on the memory:

• acquiring at least two channels of video stream data that are simultaneously gathered in real time at different angles for an object to be displayed from an output of the at least two image gatherers, wherein first field angles of the image gatherers at least partially overlap in space, and the first field angles are a horizontal field angle, a vertical field angle or a diagonal field angle;
• identifying out a shape of the object varying in real time from the at least two channels of video stream data;
• according to the shape of the object varying in real time, obtaining a corresponding object motion trajectory;
• and
• processing the shape of the object varying in real time and the corresponding object motion trajectory into a 3D image and in real time superposition-displaying the 3D image into the 3D scene;
• wherein the identifying out a shape of the object varying in real time from the at least two channels of video stream data comprises:
• performing sampling processing of each of the at least two channels of video stream data, to obtain video image data that are sampled each time;
• judging whether the video image data contain the object, and if so, performing binarization processing to the video image data, to extract contour information of the object;
• identifying out a shape of the object that is corresponding to the contour information of the object from a preset object model database;
• and
• combining shapes of the object that are identified out in each sampling of respective channels of video stream data, to obtain the shape of the object varying in real time;
• wherein the according to the shape of the object varying in real time, obtaining a corresponding object motion trajectory comprises:
• obtaining relative spatial position information of the shape of the object varying in real time;
• according to contacts that are determined on the shape of the object varying in real time, obtaining variation information of the contacts on the shape of the object varying in real time, wherein the contacts are characteristic key points for identifying the object;
• and
• according to the relative spatial position information and the variation information of the contacts, obtaining a corresponding object motion trajectory from a preset motion trajectory database;
• and
• wherein the obtaining relative spatial position information of the shape of the object varying in real time comprises:
• obtaining angle information with the shape of the object varied, from video image information of the at least two channels of video stream data;
• obtaining distance information of the object according to the angle information with the shape of the object varied;
• or sensing distance information of the object in real time by a distance sensor;
• and
• according to the angle information with the shape of the object varied and the distance information of the object, obtaining the relative spatial position information of the object.

The device according to 7, wherein the device further comprises a nine-axis sensor;

• and
• the obtaining relative spatial position information of the shape of the object varying in real time comprises:
• gathering video raw data of the object, and acquiring nine-axis sensor data;
• and
• processing the video raw data and the nine-axis sensor data, to obtain relative spatial position information of the shape of the object varying in real time.

A non-transitory computer readable storage medium, having a program instruction stored thereon, wherein the program instruction when executed by a controlling unit implements the following steps:

• simultaneously gathering at least two channels of video stream data in real time at different angles for an object to be displayed by using at least two image gatherers, wherein first field angles of the image gatherers at least partially overlap in space, and the first field angles are a horizontal field angle, a vertical field angle or a diagonal field angle;
• identifying out a shape of the object varying in real time from the at least two channels of video stream data;
• according to the shape of the object varying in real time, obtaining a corresponding object motion trajectory;
• and
• processing the shape of the object varying in real time and the corresponding object motion trajectory into a 3D image and in real time superposition-displaying the 3D image into the 3D scene;
• wherein the identifying out a shape of the object varying in real time from the at least two channels of video stream data comprises:
• performing sampling processing of each of the at least two channels of video stream data, to obtain video image data that are sampled each time;
• judging whether the video image data contain an object, and if so, performing binarization processing to the video image data, to extract contour information of the object;
• identifying out a shape of the object that is corresponding to the contour information of the object from a preset object model database;
• and
• combining shapes of the object that are identified out in each sampling of respective channels of video stream data, to obtain the shape of the object varying in real time;
• wherein the according to the shape of the object varying in real time, obtaining a corresponding object motion trajectory comprises:
• obtaining relative spatial position information of the shape of the object varying in real time;
• according to contacts that are determined on the shape of the object varying in real time, obtaining variation information of the contacts on the shape of the object varying in real time, wherein the contacts are characteristic key points for identifying the object;
• and
• according to the relative spatial position information and the variation information of the contacts, obtaining a corresponding object motion trajectory from a preset motion trajectory database;
• and
• wherein the obtaining relative spatial position information of the shape of the object varying in real time comprises:
• obtaining angle information with the shape of the object varied, from video image information of the at least two channels of video stream data;
• obtaining distance information of the object according to the angle information with the shape of the object varied;
• or sensing distance information of the object in real time by a distance sensor;
• and
• according to the angle information with the shape of the object varied and the distance information of the object, obtaining the relative spatial position information of the object.