# US 2019/0378303 A1 · Systems and methods for measurement of 3d attributes using computer vision

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0378303 A1
- Document ID: US20190378303A1
- Status: Published application
- Kind: A1
- Application number: 16/439,550
- Filed: 2019-06-12
- Published: 2019-12-12
- Earliest claimed: 2018-06-12
- Assignees: Karsten Manufacturing Corporation
- Applicants: Karsten Manufacturing Corporation
- Inventors: Tyler A. Shaw; Clayson C. Spackman
- Web page: https://patentgrep.com/patent/US20190378303A1

## CPC

- A63B 60/42: Devices for measuring, verifying, correcting or customising the inherent characteristics of golf clubs, bats, rackets or the like, e.g. measuring the maximum torque a batting shaft can withstand
- G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)}
- A63B 24/0003: {Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis}
- A63B 24/0006: {Computerised comparison for qualitative assessment of motion sequences or the course of a movement}
- A63B 53/047: {iron-type}
- A63B 60/46: Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
- A63B 69/36: for golf
- A63B 69/3605: {Golf club selection aids informing player of his average or expected shot distance for each club}
- A63B 69/3608: {Attachments on the body, e.g. for measuring, aligning, restraining (A63B69/0059, A63B69/3673 take precedence)}
- G01B 5/0023: {Measuring of sport goods, e.g. bowling accessories, golfclubs, game balls}
- G01B 11/002: {for measuring two or more coordinates}
- G01B 11/26: for measuring angles or tapers; for testing the alignment of axes
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/292: Multi-camera tracking
- G06T 7/50: Depth or shape recovery
- G06T 7/55: from multiple images
- G06T 7/593: from stereo images
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/74: {involving reference images or patches}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 7/85: {Stereo camera calibration}
- A63B 53/0408: {characterised by specific dimensions, e.g. thickness}
- A63B 53/0441: {with visual indicators for aligning the golf club}
- A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user}
- A63B 2024/0028: {Tracking the path of an object, e.g. a ball inside a soccer pitch}
- A63B 2220/807: Photo cameras
- A63B 2225/02: Testing, calibrating or measuring of equipment
- A63B 2225/50: Wireless data transmission, e.g. by radio transmitters or telemetry
- G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence
- G06T 2207/30204: Marker
- G06T 2207/30221: Sports video; Sports image
- G06T 2207/30244: Camera pose
- G06V 2201/12: Acquisition of 3D measurements of objects
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A system including a computing device and camera is disclosed; the system configured for measuring three-dimensional attributes and associated performance measurements of a mechanical device. Some embodiments comprise a camera configured to capture images of the mechanical device and a computing device in communication with the camera. In some embodiments, the computing device is configured to access a first set of pixels associated with a first plurality of fiducials to calibrate a spatial resolution of the camera. A second image from the camera can be converted into a second set of pixels associated with each of the plurality of fiducials, which are attached to the mechanical device. The computing device can be further configured to compare the first and second set of pixels to determine the location of the plurality of fiducials on the mechanical device.

## Claims

### Claim 1

A system for measuring attributes of a golf club, comprising:
a camera configured to capture images of the golf club and a plurality of fiducials; and
a computing device in operable communication with the camera, the computing device configured to:
access a first set of pixels associated with each of the plurality of fiducials of a first image to calibrate a spatial resolution of the camera,
access a second image from the camera, the second image including a golf club with the plurality of fiducials positioned along predetermined locations of the golf club,
convert the second image to a second set of pixels associated with each of the plurality of fiducials,
generate a set of points corresponding to the plurality of fiducials, the set of points defining estimated three-dimensional features of the plurality of fiducials in the second image based on comparisons between the first set of pixels and the second set of pixels,
apply the set of points to a series of predetermined functions to generate club characteristics data defining a center axis of a shaft of the golf club, a plane parallel to a face of the golf club, and a normal vector to the plane, and
output measurements including a loft angle and a lie angle associated with the golf club based upon the club characteristics data.

### Claim 2 (depends on 1)

The system of claim 1, wherein the plurality of fiducials comprise discrete fiducials removable from the golf club.

### Claim 3 (depends on 2)

The system of claim 2, wherein the discrete fiducials comprise a set of 2D quick response (QR) codes.

### Claim 4 (depends on 1)

The system of claim 1, wherein the plurality or fiducials comprise natural preselected features of the golf club.

### Claim 5 (depends on 1)

The system of claim 1, wherein calibration of the spatial resolution of the camera comprises:
providing a sheet, the plurality of fiducials defined as an array along a side of the sheet,
positioning the sheet in front of the camera such that the side of the sheet is oriented towards a lens of the camera, and
changing a position and orientation of the sheet relative to the camera while capturing one or more images to generate calibration data,
wherein the calibration data is utilized by the computing device to determine the set of points corresponding to the plurality of fiducials.

### Claim 6 (depends on 5)

The system of claim 5, wherein the sheet is used as a reference to compute an initial pose of the camera.

### Claim 7 (depends on 1)

The system of claim 1, wherein the second set of pixels are a portion of a pixel array defining an entirety of the second image, wherein the second set of pixels define positions and dimensions specific to the plurality of fiducials in the second image, and further define an array of integers.

### Claim 8 (depends on 1)

The system of claim 1, wherein the computing device utilizes a recursive filter to generate the set of points based on a pose of the camera and the second set of pixels.

### Claim 9 (depends on 1)

The system of claim 1, wherein a portion of the plurality of fiducials are assigned to the face of the golf club, and a second portion of the plurality of fiducials are assigned to the shaft of the golf club.

### Claim 10 (depends on 1)

The system of claim 1, wherein the set of predetermined functions comprises:
a series of one or predetermined linear algebraic operations comprising:
a three dimensional (3D)I function, the 3D function including an input comprising a set of coordinates representing an origin of a local coordinate system and a second of coordinates representing a predetermined location along the golf club, the 3D function configured to generate an output comprising a third set of coordinates representing a vector of a shaft axis of the golf club;
a first function which performs a cross product operation on a first function input, the first function input comprising a set of points defining a plane on a face of the golf club, the first function configured to generate a first function output defining a normal vector to the plane;
a second function including a second function input that comprises a ratio of vectors, the second function configured to generate a second function output defining an angle representing a lie of the golf club; and
a third function including a third function input that comprises a ratio of vectors, the third function configured to generate a third function output defining an angle representing a loft of the golf club.

### Claim 11

A method, comprising:
providing a processor in operable communication with a camera component, the processor configured for:
accessing a first image from the camera component, the first image including a plurality of fiducials;
converting the first image to a first plurality of picture elements associated with each of the plurality of fiducials;
accessing a second image from the camera component, the second image including the plurality of fiducials positioned along predetermined locations of a golf club;
converting the second image to a second plurality of picture elements associated with each of the plurality of fiducials;
generating a set of points defining virtual three-dimensional aspects of the plurality of fiducials based on differences between the first and the second plurality of picture elements;
applying the set of points as inputs to a series of predefined linear algebraic operations to generate golf club characteristics data; and
generating output measurements defining a loft angle and a lie angle associated with the golf club based on the golf club characteristics data.

### Claim 12 (depends on 11)

The method of claim 11, wherein the camera component comprises one or more cameras.

### Claim 13 (depends on 11)

The method of claim 11, wherein the first plurality of picture elements and the second plurality of picture elements comprise pixels represented as a two-dimensional array of integers.

### Claim 14 (depends on 11)

The method of claim 11, further comprising utilizing the camera component to continuously track the plurality of fiducials while the golf club is positioned within an image frame associated with the camera component.

### Claim 15 (depends on 11)

The method of claim 11, further comprising:
engaging the golf club to a pneumatic vice of an adjustment fixture to position the golf club within a clear line of sight of the camera component.

### Claim 16 (depends on 11)

The method of claim 11, further comprising positioning the camera component in a predetermined location relative to the plurality of fiducials prior to a calibration step.

### Claim 17 (depends on 11)

The method of claim 11, wherein the plurality of fiducials comprises features of the golf club including grooves, a logo, and a face of the golf club.

### Claim 18 (depends on 11)

The method of claim 11, wherein a first fiducial and a second fiducial of the plurality of fiducials are defined along a bottom groove of the golf club and a third fiducial of the plurality of fiducials is defined along a face of the golf club.

### Claim 19

An apparatus, comprising:
a camera; and
a computing device, the computing device configured to access a plurality of picture elements associated with a plurality of fiducials from a first image generated by the camera, identify a series of changes to the plurality of picture elements from a second image depicting the plurality of fiducials positioned along a golf club, generate a set of 3D points based on the series of changes to the plurality of picture elements associated with the plurality of fiducials, apply the 3D set of points as inputs to one or more predefined linear algebra operations to generate golf club characteristics data, and output measurements defining a loft angle and a lie angle associated with the golf club based on the golf club characteristics data.

### Claim 20 (depends on 19)

The apparatus of claim 19, wherein the golf club characteristics data a center axis of a shaft of the golf club, a plane parallel to a face of the golf club, and a normal vector to the plane, and wherein the output measurements are checked against predetermined target specifications associated with the golf club.
