Back to results
US 2019/0196609 A1Published application
Detection of pointing object and activity object
AssigneeTangible Play, Inc.
InventorsTony Aube, Jon Dukerschein, Jerome Scholler, Mark Solomon, Vivardhan Kanoria
Life of this patent
Estimating the term…
Abstract
Various implementations for object detection include a method includes capturing a video stream that includes an activity object and a pointing object, identifying the activity object, displaying a graphical user interface embodying a virtual scene based on the identified activity object, determining a location of the pointing object relative to the activity object, determining a routine based on the location of the pointing object relative to the activity object, and executing the routine within the virtual scene.
Claims23
A method comprising:
- capturing, using a video capture device coupled to a computing device, a video stream of a physical activity scene proximate to the computing device, the video stream including an activity object and a pointing object, the activity object including a visualization marker on the activity object;
- identifying, using a processor of the computing device, the activity object based on the visualization marker on the activity object;
- displaying, on a display of a computing device, a graphical user interface embodying a virtual scene based on the identified activity object;
- determining, using the processor of the computing device, a location of the pointing object relative to the activity object in the physical activity scene;
- determining, using the processor of the computing device, a routine based on the location of the pointing object relative to the activity object;
- and
- executing, on the display of the computing device, the routine within the virtual scene on the graphical user interface.
4 more elements
A physical activity scene visualization system comprising:
- a video capture device coupled for communication with a computing device, the video capture device being adapted to capture a video stream that includes an activity object and a pointing object;
- a detector coupled to the computing device, the detector being adapted to identify within the video stream the activity object and a location of the pointing object relative to the activity object;
- a processor of the computing device, the processor being adapted to determine a routine based on the location of the pointing object relative to the activity object;
- and
- a display coupled to the computing device, the display being adapted to display a graphical user interface that includes a virtual scene and the routine.
2 more elements
A method comprising:
- capturing, using a video capture device coupled to a computing device, a video stream of a physical activity scene proximate to the computing device, the video stream including an activity object and a pointing object, the activity object including a visualization marker on the activity object and the pointing object including a pointing marker;
- identifying, using a processor of the computing device, a type of the activity object based on the visualization marker on the activity object;
- displaying, on a display of a computing device, a graphical user interface embodying a virtual scene based on the identified type of the activity object;
- determining, using the processor of the computing device, a position and an orientation of the activity object based on the visualization marker on the activity object;
- determining, using the processor of the computing device, a location of the pointing object relative to the position and the orientation of the activity object in the physical activity scene;
- determining, using the processor of the computing device, a routine based on the location of the pointing object relative to the position and the orientation of the activity object;
- and
- executing, on the display of the computing device, the routine within the virtual scene on the graphical user interface.
5 more elements
Dependencies are inferred from the claim text.