Model and detachable controller for augmented reality / virtual reality experience

A system comprising:

• a model comprising circuitry and one or more external visual indicators, wherein the model has a physical appearance according to a model type of the model, wherein the model type is included in a set of predefined virtual elements of an augmented reality environment;
• a controller device comprising:
• a handle configured to be gripped by a user's hand;
• an interface dimensioned to removably attach to the model;
• a power supply configured to provide power to the circuitry when the controller device is removably attached to the model;
• and
• one or more sensors;
• a body-wearable device comprising:
• a forward-sensing visual sensor;
• and
• a display;
• and
• one or more computer processors configured to:
• identify, using the visual sensor, at least a first external visual indicator of the one or more external visual indicators that is visible at an external surface of the model when the handle is gripped;
• maintain, within the augmented reality environment, a virtual model corresponding to the model type indicated by identification information received from the circuitry, wherein a structural configuration of the virtual model corresponds to the physical appearance of the model, wherein an orientation of the virtual model is based on orientation information received from the one or more sensors and referenced to the one or more external visual indicators;
• display, using the display, the virtual model at a location referenced to a location of the model within a field of view of the user, wherein displaying the virtual model comprises selecting a magnification to cause the virtual model to appear larger than the model within the field of view;
• and
• responsive to receiving an input, displaying one or more visual effects using the display, wherein the one or more visual effects are referenced to the virtual model.

A controller device comprising:

• a body contoured as a handle to be gripped by a user's hand;
• an attachment interface dimensioned to removably attach the body to a selected model of a plurality of models, each model of the plurality of models having a physical appearance according to a respective model type of a plurality of model types, wherein the plurality of model types are included in a set of predefined virtual elements of an augmented reality environment, each model comprising circuitry and at least a first external visual indicator that is visible at an external surface of the model when the model is attached to the attachment interface and the handle is gripped;
• a power supply configured to provide power to the circuitry of a first model of the plurality of models when the first model is removably attached to the attachment interface;
• one or more sensors;
• a communication interface configured to:
• transmit identification information identifying the model type of the first model to an external computing device;
• transmit sensor information from the one or more sensors to the external computing device, wherein the sensor information configures an application executing on the external computing device to display a virtual model within the augmented reality environment with a selected magnification to cause the virtual model to appear larger than the model within a field of view of the user, wherein a structural configuration of the virtual model corresponds to the physical appearance of the first model as indicated by the identification information, and wherein a location of displaying the model is referenced to a location of the first model within the field of view;
• and
• receive information from the application that corresponds to one or more actions of the virtual model within the augmented reality environment;
• and
• a sensory feedback device configured to provide sensory feedback with timing based on the one or more actions of the virtual model.