Context aware augmentation interactions
AssigneeQUALCOMM Incorporated
InventorRoy Lawrence Ashok Inigo
Life of this patent
Estimating the term…
Abstract
A mobile platform renders different augmented reality objects based on the spatial relationship, such as the proximity and/or relative positions between real-world objects. The mobile platform detects and tracks a first object and a second object in one or more captured images. The mobile platform determines the spatial relationship of the objects, e.g., the proximity or distance between objects and/or the relative positions between objects. The proximity may be based on whether the objects appear in the same image or the distance between the objects. Based on the spatial relationship of the objects, the augmentation object to be rendered is determined, e.g., by searching a database. The selected augmentation object is rendered and displayed.
Claims38
A method comprising:
- capturing and displaying an image of a first object and a second object;
- detecting and tracking the first object;
- detecting and tracking the second object;
- identifying the first object and the second object;
- accessing a database based on the identification of the first object and the second object to determine that the first object and the second object have associated contextually dependent augmented reality objects;
- determining a spatial relationship between the first object and the second object in response to a determination that the first object and the second object have associated contextually dependent augmented reality objects;
- determining an augmentation object to render based on the spatial relationship between the first object and the second object;
- and
- displaying the augmentation object.
A mobile platform comprising:
- a camera;
- a processor connected to the camera;
- memory connected to the processor;
- a display connected to the memory;
- and
- software held in the memory and run in the processor to cause the processor to display on the display an image captured by the camera of a first object and a second object, detect and track the first object, detect and track the second object, identify the first object and the second object, access a database based on the identification of the first object and the second object to determine that the first object and the second object have associated contextually dependent augmented reality objects, determine a spatial relationship between the first object and the second object in response to a determination that the first object and the second object have associated contextually dependent augmented reality objects, determine an augmentation object to render based on the spatial relationship between the first object and the second object, and display on the display the augmentation object.
A device comprising:
- means for capturing an image of a first object and a second object;
- means for detecting and tracking the first object and the second object;
- means for identifying the first object and the second object;
- means for accessing a database based on the identification of the first object and the second object to determine that the first object and the second object have associated contextually dependent augmented reality objects;
- means for determining a spatial relationship between the first object and the second object in response to a determination that the first object and the second object have associated contextually dependent augmented reality objects;
- means for determining an augmentation object to render based on the spatial relationship between the first object and the second object;
- and
- means for displaying the augmentation object and the image of the first object and the second object.
A non-transitory computer-readable medium including program code stored thereon, comprising:
- program code to display on the display an image of a first object and a second object;
- program code to detect and track the first object and to detect and track the second object;
- program code to identify the first object and the second object;
- program code to access a database based on the identification of the first object and the second object to determine that the first object and the second object have associated contextually dependent augmented reality objects;
- program code to determine a spatial relationship between the first object and the second object in response to a determination that the first object and the second object have associated contextually dependent augmented reality objects;
- program code to determine an augmentation object to render based on the spatial relationship between the first object and the second object;
- and
- program code to display on the display the augmentation object.
Dependencies are inferred from the claim text.