Semantically tagged virtual and physical objects

A method comprising:

• at a processor:
• storing a database of physical objects in a physical environment and virtual objects that have been associated with one or more semantic tags;
• receiving a natural language input from a user via an input device;
• performing semantic processing on the natural language input to determine a user specified operation and identify one or more semantic tags indicated by the natural language input;
• selecting a target virtual object and a target physical object from the physical objects and virtual objects in the database based on the identified one or more semantic tags;
• performing the determined user specified operation on the target virtual object based on the target physical object;
• and
• displaying the target virtual object at a physical location associated with the target physical object.

A computer device comprising:

• a display device configured to display virtual objects at locations in a physical environment;
• a camera device configured to capture images of the physical environment;
• an input device configured to receive a user input;
• and
• a processor configured to:
• receive a natural language input from a user via the input device;
• perform semantic processing on the natural language input to determine a user specified operation and identify one or more semantic tags indicated by the natural language input;
• select a target virtual object and a target physical object based on the identified one or more semantic tags;
• perform the determined user specified operation on the target virtual object based on the target physical object;
• and
• display the target virtual object via the display device.