Virtual reality control using image, model and control data to manipulate interactions

A virtual reality data presentation system, comprising:

• model data memory means for storing 3D (three dimensional) model data representing a 3D model with object models in a 3D virtual space;
• data presentation means for presenting the 3D model to a user according to the 3D model data stored in the data memory means in a manner allowing a user's virtual manipulation of the object models in the 3D model within the 3D virtual space;
• real data acquisition means for obtaining dynamically changing real physical object appearance data in real time from physical objects in a real space which are represented by the object models in the 3D model;
• and
• control means for controlling the data presentation means to selectively present selected ones of the object models in the 3D model in terms of the real physical object appearance data obtained by the real data acquisition means such that appearances of the object models in the 3D virtual spaces presented by the data presentation means resemble appearances of the physical object in the real space.

A method of virtual reality data presentation, comprising the steps of:

• presenting a 3D (three dimensional) model to a user according to 3D model data representing a 3D model with object models in a 3D virtual space;
• entering input data indicating a user's physical action in a real space for virtually manipulating physical objects represented by the object models in the 3D model;
• and
• controlling the presenting step according to the 3D model data, the input data entered at the entering step, and control data specifying reactions of the object models in the 3D virtual space presented at the presenting step in response to the user's physical action indicated by the input data entered at the entering step, the control data specifying the reactions of the object models by applying a non-linear function defining a desired natural relationship between the reactions of the object models and the user's physical action onto the input data entered at the entering step, such that reactions of the object models in the 3D virtual space in response to the user's physical action resemble reactions of the physical objects in the real space in response to the user's physical action.

A method of virtual reality data presentation, comprising the steps of:

• presenting a 3D (three dimensional) model to a user according to 3D model data representing a 3D model with object models in a 3D virtual space, in a manner allowing a user's virtual manipulation of the object models in the 3D model within the 3D virtual space;
• obtaining dynamically changing real physical object appearance data in real time from physical objects in a real space which are represented by the object models in the 3D model;
• and
• controlling the presenting step to selectively present selected ones of the object models in the 3D model in terms of the real physical object appearance data obtained at the obtaining step, such that appearances of the object models in the 3D virtual space presented by the presenting step resemble appearance of the physical objects in the real space.

A virtual reality data presentation system, comprising:

• model data memory means for storing 3D (three dimensional) model data representing a 3D model with object models in a 3D virtual space;
• data presentation means for presenting the 3D model according to the 3D model data stored in the data memory means;
• input means operated by a user to which the 3D model is presented by the data presentation means, for entering input data indicating a user's physical action in a real space for virtually manipulating physical objects represented by the object models in the 3D model;
• control data memory means for storing control data specifying reactions of the object model in the 3D virtual space presented by the data presentation means in response to the user's physical action indicated by the input data entered from the input means, the control data specifying the reactions of the object models in terms of natural movements of the object models which are different from manipulating movements set by the user's physical action indicated by the input data entered from the input means;
• and
• control means for controlling the data presentation means according to the 3D model data stored in the model data memory means, the input data entered from the input means, and the control data stored in the control data memory means, such that reactions of the object models in the 3D virtual space in response to the user's physical action resemble reactions of the physical objects in the real space in response to the user's physical action.

A method of virtual reality data presentation, comprising the steps of:

• presenting a 3D (three dimensional) model to a user according to 3D model data representing a 3D model with object models in a 3D virtual space;
• entering input data indicating a user's physical action in a real space for virtually manipulating physical objects represented by the object models in the 3D model;
• and
• controlling the presenting step according to the 3D model data, the input data entered at the entering step, and control data specifying reactions of the object models in the 3D virtual space presented at the presenting step in response to the user's physical action indicated by the input data entered at the entering step, the control data specifying the reactions of the object models in terms of natural movements of the object models which are different from manipulating movements set by the user's physical action indicated by the input data entered at the entering step, such that reactions of the object models in the 3D virtual space in response to the user's physical action resemble reactions of the physical objects in the real space in response to the user's physical action.