# US 12,109,478 B2 · Electronic tracking system with heads up display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,109,478 B2
- Document ID: US12109478B2
- Status: Granted
- Kind: B2
- Application number: 17/553,706
- Filed: 2021-12-16
- Published: 2022-04-07
- Granted: 2024-10-08
- Earliest claimed: 2011-12-30
- Assignees: NIKE, Inc.
- Applicants: NIKE, Inc.
- Inventors: Nicholas A. Leech
- Web page: https://patentgrep.com/patent/US12109478B2

## CPC

- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A63B 24/0021: {Tracking a path or terminating locations}
- A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance}
- A63B 37/0072: {with a specified number of layers}
- A63B 43/008: {with means for improving visibility, e.g. special markings or colours (illuminating or reflecting means A63B43/06)}
- A63B 43/06: with illuminating devices {; with reflective surfaces}
- A63B 69/36: for golf
- A63B 69/3605: {Golf club selection aids informing player of his average or expected shot distance for each club}
- A63B 69/3608: {Attachments on the body, e.g. for measuring, aligning, restraining (A63B69/0059, A63B69/3673 take precedence)}
- A63B 69/3676: {for putting (A63B69/3608, A63B69/3661, A63B69/3667 and A63B69/3697 take precedence)}
- A63B 71/0619: {Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills}
- G01C 3/02: Details
- G01S 13/66: Radar-tracking systems; Analogous systems
- G01S 13/867: {Combination of radar systems with cameras}
- G01S 15/66: Sonar tracking systems
- G01S 17/66: Tracking systems using electromagnetic waves other than radio waves
- G01S 19/19: Sporting applications
- G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking}
- G02B 27/017: {Head mounted}
- G02B 27/0172: {characterised by optical features}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- A63B 2024/0025: {Tracking the path or location of one or more users, e.g. players of a game}
- A63B 2024/0028: {Tracking the path of an object, e.g. a ball inside a soccer pitch}
- A63B 2024/0034: {during flight}
- A63B 2024/0053: {for locating an object, e.g. a lost ball}
- A63B 2024/0056: {for statistical or strategic analysis}
- A63B 2071/0666: {worn on the head or face, e.g. combined with goggles or glasses}
- A63B 2071/0691: {Maps, e.g. yardage maps or electronic maps}
- A63B 2220/12: Absolute positions, e.g. by using GPS
- A63B 2220/13: Relative positions
- A63B 2220/14: Geo-tagging, e.g. for correlating route or track location data with specific information related to that specific location
- A63B 2220/20: Distances or displacements
- A63B 2220/30: Speed
- A63B 2220/802: Ultra-sound sensors
- A63B 2220/805: Optical or opto-electronic sensors
- A63B 2220/806: Video cameras
- A63B 2220/833: Sensors arranged on the exercise apparatus or sports implement
- A63B 2220/836: Sensors arranged on the body of the user
- A63B 2225/20: with means for remote communication, e.g. internet or the like
- A63B 2225/50: Wireless data transmission, e.g. by radio transmitters or telemetry
- A63B 2225/54: Transponders, e.g. RFID
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G02B 2027/014: {comprising information/image processing systems}
- G02B 2027/0141: {characterised by the informative content of the display}
- G02B 2027/0178: {Eyeglass type (eyeglass details G02C)}
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An electronic tracking system for assisting a user in determining distances to landmarks and objects in a sporting environment includes a user tracking system for determining the location of a user, a heads up display for displaying information to the user, and a processor operable to communicate with the user tracking system and the heads up display. The heads up display is designed to be worn on the user's head, and to display an image within the user's field of view. The processor is programmed to determine a distance between the user's determined location and an object or a landmark on. This information is displayed via the heads up display as a numeric representation of the determined distance.

## Claims

### Claim 1

A head-worn mobile device for assisting a user with determining distances in a sporting environment, the head-worn mobile device comprising:
a headgear component configured to be worn on the head of the user;
a GPS transceiver and/or an RF triangulation module mounted to the headgear component and configured to determine user geolocation data for the user;
a digital camera mounted to the headgear component and configured to capture image data indicative of a field of view of the user and a landmark or object in the field of view within the sporting environment;
a heads-up display (HUD) device mounted to the headgear component, the HUD device having a display screen with a transparent display area configured to be worn in front of one or both eyes of the user and to display images; and
a processor mounted to the headgear component and programmed to:
receive the user geolocation data;
receive, from the digital camera, the image data indicative of the field of view of the user;
identify, from the image data, the object or landmark within the field of view in the sporting environment;
determine a distance between the user and the object or landmark; and
direct the HUD device to display the determined distance coincident with or adjacent to the object or landmark as the object or landmark is visible through the transparent display area of the HUD device.

### Claim 2 (depends on 1)

The head-worn mobile device of claim 1, wherein the processor is further programmed to determine, from the image data captured by the digital camera, a real-time location of the object or landmark within the field of view of the user in the sporting environment.

### Claim 3 (depends on 1)

The head-worn mobile device of claim 1, wherein the processor is further programmed to determine, from the image data captured by the digital camera, an object or landmark type for the object or landmark within the field of view of the user.

### Claim 4 (depends on 1)

The head-worn mobile device of claim 1, further comprising a sensor mounted to the headgear component and operable to track movement of the object within the sporting environment.

### Claim 5 (depends on 4)

The head-worn mobile device of claim 4, wherein the object includes a ball, and wherein the processor is further programmed to determine, from sensor data output via the sensor, a real-time location and/or trajectory of the ball.

### Claim 6 (depends on 5)

The head-worn mobile device of claim 5, wherein the landmark includes a tree, a natural hazard, a body of water, a sand trap on a golf course, a dogleg on the golf course, or a portion of a green on the golf course, or any combination thereof.

### Claim 7 (depends on 4)

The head-worn mobile device of claim 4, wherein tracking movement of the object within the sporting environment includes the sensor detecting a special coating on the object.

### Claim 8 (depends on 1)

The head-worn mobile device of claim 1, further comprising a wireless communications device mounted to the headgear component and operable to receive from an external database landmark geolocation data for the landmark.

### Claim 9 (depends on 1)

The head-worn mobile device of claim 1, further comprising a user interface attached to the headgear component and having one or more input devices configured to receive a user input from the user.

### Claim 10 (depends on 9)

The head-worn mobile device of claim 9, wherein the user interface includes an interface display operable to display control settings and command options to the user.

### Claim 11 (depends on 1)

The head-worn mobile device of claim 1, wherein the processor is further programmed to direct the HUD device to display an enhanced image of the object or landmark superimposed over the object or landmark within the transparent display area of the display screen as the object or landmark is visible through the transparent display area.

### Claim 12 (depends on 11)

The head-worn mobile device of claim 11, wherein the enhanced image of the object or landmark includes a stereoscopic, enlarged, brightened, and/or transparent image of the object or landmark.

### Claim 13 (depends on 1)

The head-worn mobile device of claim 1, wherein the headgear component includes a visor, a helmet, eyeglasses, or goggles.

### Claim 14

A method of operating a head-worn mobile device for assisting a user with determining distances in a sporting environment, the method comprising:
receiving, via a processor from a GPS transceiver and/or an RF triangulation module each mounted to a headgear component of the head-worn mobile device, user geolocation data for the user, the headgear component configured to be worn on the head of the user, a heads-up display (HUD) device being mounted to the headgear component, the HUD device having a display screen with a transparent display area configured to be worn in front of one or both eyes of the user and to display images;
receiving, via the processor from a digital camera mounted to the headgear component, image data indicative of a field of view of the user and a landmark or object in the field of view within the sporting environment;
identifying, via the processor from the image data, the object or landmark within the field of view in the sporting environment;
determining a distance between the user and the object or landmark; and
displaying, via the HUD device, the determined distance coincident with or adjacent to the object or landmark as the object or landmark is visible through the transparent display area of the HUD device.

### Claim 15 (depends on 14)

The method of claim 14, further comprising determining, via the processor from the image data captured by the digital camera, a real-time location of the object or landmark within the field of view of the user.

### Claim 16 (depends on 14)

The method of claim 14, further comprising determining, via the processor from the image data captured by the digital camera, an object or landmark type for the object or landmark within the field of view of the user.

### Claim 17 (depends on 14)

The method of claim 14, further comprising tracking, via a sensor mounted to the headgear component, movement of the object within the sporting environment.

### Claim 18 (depends on 14)

The method of claim 14, further comprising receiving, via a wireless communications device mounted to the headgear component from an external database, landmark geolocation data for the landmark.

### Claim 19 (depends on 14)

The method of claim 14, further comprising receiving one or more control signals indicative of inputs from the user via one or more input devices of a user interface.

### Claim 20 (depends on 14)

The method of claim 14, further comprising displaying, via the HUD device, an enhanced image of the object or landmark superimposed over the object or landmark within the transparent display area of the display screen as the object or landmark is visible through the transparent display area.