US 2015/0310280 A1Published application

Motion event recognition and video synchronization system and method

AssigneeBlast Motion Inc.

InventorsMichael Bentley, Ryan Kaps, Bhaskar Bose, Sheehan Alam, Michael Gillen, Mazen Abdel-Rahman

Life of this patent

Estimating the term…

Loading patent…

Abstract

Enables recognition of events within motion data obtained from portable wireless motion capture elements and video synchronization of the events with video as the events occur or at a later time, based on location and/or time of the event or both. May use integrated camera or external cameras with respect to mobile device to automatically generate generally smaller event videos of the event on the mobile device or server. Also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users. Provides low memory and power utilization and greatly reduces storage for video data that corresponds to events such as a shot, move or swing of a player, a concussion of a player, or other medical related events or events, such as the first steps of a child, or falling events.

Claims30

Dependent claims

A motion event recognition and video synchronization system comprising:

at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor configured to capture one or more values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;
a first communication interface;
a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to
collect data that comprises sensor values from said sensor;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;
a computer comprising
a memory;
a second communication interface configured to
communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;
wherein said computer is coupled with said memory and said second communication interface, wherein said computer is configured to
receive
said data from said second communication interface and
analyze said data and recognize an event within said data to determine event data
or
said event data from said second communication interface
or
both said data and said event data from said second communication interface;
analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data in said memory;
obtain an event start time and an event stop time from said event data;
request image data captured with a camera comprising a video captured at least during a timespan from said event start time to said event stop time;
display an event video on a display comprising both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time,
and
said video captured during said timespan from said event start time to said event stop time;
and,
wherein said computer is further configured to discard at least a portion of said video outside of said event start time to said event stop time and store said event video without said portion of said video outside of said event start time to said event stop time.

26 more elements

A motion event recognition and video synchronization system comprising:

at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor configured to capture one or more values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;
a first communication interface;
a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to
collect data that comprises sensor values from said sensor;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;
a computer comprising
a memory;
a second communication interface configured to
communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;
wherein said computer is coupled with said memory and said second communication interface, wherein said computer is configured to
receive
said data from said second communication interface and
analyze said data and recognize an event within said data to determine event data
or
said event data from said second communication interface
or
both said data and said event data from said second communication interface;
analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data;
obtain an event start time and an event stop time from said event data;
request image data captured with a camera comprising a video captured at least during a timespan from said event start time to said event stop time;
display an event video on a display comprising both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time,
and
said video captured during said timespan from said event start time to said event stop time;
and,
a server computer remote to said computer, wherein said server computer is configured to obtain said event video without said portion of said video outside of said event start time to said event stop time without at least a portion of said video outside of said event start time to said event stop, and
return said video captured during said timespan from said event start time to said event stop time to another computer.

27 more elements

A motion event recognition and video synchronization system comprising:

at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor configured to capture one or more values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;
a first communication interface;
a microcontroller coupled with said memory, said sensor and said first communication interface, wherein said microcontroller is configured to
collect data that comprises sensor values from said sensor;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;
a computer comprising
a second communication interface configured to
communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;
wherein said computer is coupled with said second communication interface, wherein said computer is configured to
receive
said data from said second communication interface and
analyze said data and recognize an event within said data to determine event data
or
said event data from said second communication interface
or
both said data and said event data from said second communication interface;
analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data;
obtain an event start time and an event stop time from said event data;
request image data captured with a camera comprising a video captured at least during a timespan from said event start time to said event stop time;
display an event video on a display comprising both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time,
and
said video captured during said timespan from said event start time to said event stop time;
and
while a communication link is open between said at least one motion capture element and said computer, to discard at least a portion of said video outside of said event start time to said event stop, and to save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time
or
while a communication link is not open between said at least one motion capture element and said computer, to save said video, and after said event is received after said communication link is open, to then discard at least a portion of said video outside of said event start time to said event stop time and to save said video from said event start time to said event stop time with said motion analysis data that occurs from said event start time to said event stop time.

27 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/792,543Filed 6 Jul 2015
Priority: 26 Aug 2010
Published: 29 Oct 2015
Term ends: Not estimatedThe source records don’t support an estimate.

Classification23 codes

G06V 20/46
In video content: extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
A63F 13/00
Video games, i.e. games using an electronically generated display having two or
G06F 16/7837
Using metadata automatically derived from the content: using objects detected or recognised in the video content
G06T 7/20
Image analysis: analysis of motion

Family

Application12/868,882Continuation in part · filed 26 Aug 2010
Application12/901,806Continuation in part · filed 11 Oct 2010
Application13/048,850Continuation in part · filed 15 Mar 2011
Application13/191,309Continuation in part · filed 26 Jul 2011
Application13/219,525Continuation in part · filed 26 Aug 2011
Application13/267,784Continuation in part · filed 6 Oct 2011
Application13/298,158Continuation in part · filed 16 Nov 2011
Application13/679,879Continuation in part · filed 16 Nov 2012
Application13/914,525Continuation in part · filed 10 Jun 2013
Application14/257,959Continuation · filed 21 Apr 2014
Application14/792,543Continuation
Application14/257,959Continuation in part
US 2011/0305369 A1Published application
US 2012/0050529 A1Published application
US 2012/0052971 A1Published application
US 2012/0052972 A1Published application
US 2012/0052973 A1Published application
US 2012/0088544 A1Published application
US 2012/0122574 A1Published application
US 2013/0063432 A1Published application
US 2013/0271602 A1Published application
US 2014/0376876 A1Published application
US 8,465,376 B2Related patent
US 8,702,516 B2Related patent
US 8,905,855 B2Related patent
US 8,941,723 B2Related patent
US 8,944,928 B2Related patent
US 8,994,826 B2Related patent
US 9,033,810 B2Related patent
US 9,076,041 B2Related patent
US 9,320,957 B2Related patent
US 9,361,522 B2Related patent
US 9,604,142 B2Related patent
US 2015/0310280 A1This patent

From the US filing history. Foreign family members aren’t listed.