# US 2016/0256740 A1 · Method for interactive training and analysis

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2016/0256740 A1
- Document ID: US20160256740A1
- Status: Published application
- Kind: A1
- Application number: 15/159,254
- Filed: 2016-05-19
- Published: 2016-09-08
- Earliest claimed: 2011-11-22
- Inventors: SCOTT DALLAS ROWE
- Web page: https://patentgrep.com/patent/US20160256740A1

## CPC

- A63B 24/0003: {Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis}
- G06T 7/32: using correlation-based methods
- G06T 7/66: of image moments or centre of gravity
- G06V 40/23: {Recognition of whole body movements, e.g. for sport training}
- G09B 19/0038: {Sports}
- H04N 5/2621: {Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability}
- H04N 5/272: Means for inserting a foreground image in a background image, i.e. inlay, outlay
- G06T 2207/10016: Video; Image sequence
- G06T 2207/30196: Human being; Person
- G06T 2207/30221: Sports video; Sports image
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

Apparatus and methods are provided that can display selected predetermined postures or predetermined motions on a frame by frame basis or as a continuous motion for imitation or emulation by a system user or subject to, for example, learn the motion or posture, or to be guided in rehabilitation from a trauma, surgery or other injury, or to permit comparison of the users posture or motion to a baseline posture or motion for purposes of analysis or diagnosis.

## Claims

### Claim 1

A method comprising:
displaying one at a time to a subject a sequence of object frame representations, each said object frame representation comprising an object in one stationary position of a plurality of predetermined sequential stationary positions;
having said subject imitate said object representation in each said object frame representation;
capturing images and data of said subject in real time while said subject is imitating said object in each said object frame representation;
utilizing said captured images and data of said subject to generate, in real time, representations of said subject;
displaying a composite overlay of one upon the other of each of said real time representations of said subject and said object frame representation in said stationary position until said subject approximates positional alignment with said object in said one stationary position; and
displaying a next said object frame representation in said sequence of object frame representations when said subject approximates positional alignment with said object in said stationary position

### Claim 2 (depends on 1)

A method in accordance with claim 1, comprising:
generating comparison data in real time for differences between positions of said subject and a position of said object in said stationary position.

### Claim 3 (depends on 2)

A method in accordance with claim 2, comprising:
utilizing said comparison data to determine deviation and coincidence between said positions of said subject and said position of said object in said stationary position; and
displaying said deviation and coincidence in said composite overlay.

### Claim 4 (depends on 3)

A method in accordance with claim 3, comprising:
selecting one or more of said sequence of object frame representations for display to said subject; and
displaying sequentially said selected one or more object frame representations for said subject to imitate.

### Claim 5 (depends on 1)

A method in accordance with claim 1, comprising:
determining at least one of posture or postural stability of said subject.

### Claim 6 (depends on 5)

A method in accordance with claim 5, comprising:
capturing a plurality of frames of said subject in a sequence of a plurality of corresponding predetermined positions;
utilizing said plurality of captured frames of said subject as said sequence of object frame representations.

### Claim 7 (depends on 5)

A method in accordance with claim 5, comprising:
utilizing said captured frames of said subject to compute centers of gravity for said subject on a frame-by-frame basis.

### Claim 8 (depends on 7)

A method in accordance with claim 7, comprising:
utilizing said centers of gravity for said subject to compute postural stability of said subject.

### Claim 9 (depends on 5)

A method in accordance with claim 5, comprising:
calculating sway index angles and sway index positions for said subject.

### Claim 10 (depends on 1)

A method in accordance with claim 1, comprising:
providing scaling of one or both of said real time representation of said subject and said object.

### Claim 11 (depends on 1)

A method in accordance with claim 1, comprising:
sequentially displaying said sequence of frames of object representations such that said object appears in motion;
capturing real time frame-by-frame representations of said subject in motion imitating said object; and
displaying in real time a composite overlay comprising said frame-by-frame representations of said subject in motion and said sequence of frames of object representations.

### Claim 12 (depends on 11)

A method in accordance with claim 11, comprising:
utilizing said real time composite overlay to highlight coincidences and deviations between said subject in motion and said sequence of frames of object representations.

### Claim 13

A method comprising:
displaying to a subject an object representation in a stationary position such that said subject may imitate said stationary position of said object representation;
capturing frames of said subject in real time while said subject assumes positions to imitate said object representation in said stationary position;
utilizing said captured frames of said subject to generate and display, in real time on a frame-by-frame basis, composite overlays each comprising one of said captured frames of said subject and said object representation in said stationary position until a predetermined event occurs; and
automatically displaying a next object representation in a stationary position after said predetermined event occurs.

### Claim 14 (depends on 13)

A method in accordance with claim 13, comprising:
selecting said predetermined event as said subject approximating positional alignment with said object.

### Claim 15 (depends on 13)

A method in accordance with claim 13, comprising:
generating frame-by-frame comparison data for differences between said positions of said subject and said object in a stationary position.

### Claim 16 (depends on 15)

A method in accordance with claim 15, comprising:
utilizing said frame-by-frame comparison data to determine deviations and coincidences between said positions of said subject and said object in a stationary position;
generating a composite overlay of said deviations and coincidences between said positions of said subject and said object in a stationary position; and
displaying said composite overlay to show said deviations and coincidences.

### Claim 17 (depends on 13)

A method in accordance with claim 13, comprising:
determining at least one of posture or postural stability of said subject.
