Method and device for utilizing physical objects and physical usage patterns for presenting virtual content

A device comprising:

• one or more displays;
• one or more processors;
• a non-transitory memory;
• and
• one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:
• determine a first set of usage patterns associated with a first physical object that is identified within a physical environment;
• obtain a first objective for an objective-effectuator (OE) instantiated in a computer-generated reality (CGR) environment, wherein the first objective is associated with a first representation of the first physical object within the physical environment;
• obtain a first directive for the OE that limits actions for performance by the OE to achieve the first objective to the first set of usage patterns associated with the first physical object;
• generate a first set of actions, for performance by the OE, in order to achieve the first objective as limited by the first directive, wherein the first set of actions corresponds to a first subset of usage patterns from the first set of usage patterns associated with the first physical object;
• and
• present, via the one or more displays, the CGR environment including the OE performing the first set of actions on the first representation of the first physical object overlaid on the physical environment.

A non-transitory memory storing one or more programs, which, when executed by one or more processors of a device with one or more displays, cause the device to:

• determine a first set of usage patterns associated with a first physical object that is identified within a physical environment;
• obtain a first objective for an objective-effectuator (OE) instantiated in a computer-generated reality (CGR) environment, wherein the first objective is associated with a first representation of the first physical object within the physical environment;
• obtain a first directive for the OE that limits actions for performance by the OE to achieve the first objective to the first set of usage patterns associated with the first physical object;
• generate a first set of actions, for performance by the OE, in order to achieve the first objective as limited by the first directive, wherein the first set of actions corresponds to a first subset of usage patterns from the first set of usage patterns associated with the first physical object;
• and
• present, via the one or more displays, the CGR environment including the OE performing the first set of actions on the first representation of the first physical object overlaid on the physical environment.