# US 2022/0273998 A1 · Detecting method of golf club and sensing device using the same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0273998 A1
- Document ID: US20220273998A1
- Status: Published application
- Kind: A1
- Application number: 17/630,941
- Filed: 2020-07-24
- Published: 2022-09-01
- Earliest claimed: 2019-07-30
- Assignees: Golfzon Co., Ltd.
- Applicants: Golfzon Co., Ltd.
- Inventors: Hyun Jin PARK
- Web page: https://patentgrep.com/patent/US20220273998A1

## CPC

- A63B 60/46: Measurement devices associated with golf clubs, bats, rackets or the like for measuring physical parameters relating to sporting activity, e.g. baseball bats with impact indicators or bracelets for measuring the golf swing
- G06T 7/73: using feature-based methods
- G06T 3/00: Geometric image transformations in the plane of the image
- G06T 7/11: Region-based segmentation
- G06T 7/13: Edge detection
- G06T 7/66: of image moments or centre of gravity
- G06T 15/60: Shadow generation
- G06V 10/26: Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
- G06V 10/46: Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features (colour feature extraction G06V10/56)
- G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model
- G06V 20/647: {by matching two-dimensional images to three-dimensional objects}
- A63B 2102/32: Golf
- A63B 2220/807: Photo cameras
- G06T 2207/30172: Centreline of tubular or elongated structure
- G06T 2207/30221: Sports video; Sports image
- A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

The present invention is to provide a method for detecting a golf club and a sensing device using the same, and provides a new method for detecting the golf club from an image captured by the sensing device. The present invention provides a method for accurately analyzing movement characteristics such as bending of a golf club by accurately detecting the shape of the golf club during golf swing by analyzing the shadow of the golf club formed on the floor in the captured image rather than directly detecting the golf club from the captured image.

## Claims

### Claim 1

A method for detecting a golf club using a sensing device including a camera, the method comprising:
acquiring an image at an angle of view including a golf club held by a golf swing user;
calculating information on the shadow area of the golf club formed on the bottom from the image; and
detecting the golf club through analysis of the information on the shadow area of the golf club.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the calculating information on the shadow area of the golf club includes:
checking pixels on the image to detect effective pixels corresponding to the shadow area, and calculating information on the shadow area of the golf club using the effective pixels.

### Claim 3 (depends on 1)

The method according to claim 1, wherein the calculating information on the shadow area of the golf club includes:
calculating a lighting vector from the structural relationship of the camera, a light source and a bottom surface;
calculating a model for a contour of the shadow of the golf club using the calculated lighting vector; and
calculating information on the shadow area of the golf club by checking pixels on the image based on the model for the contour of the shadow.

### Claim 4 (depends on 1)

The method according to claim 1, wherein the calculating information on the shadow area of the golf club includes:
detecting a club-fitted line fitted to the club shaft of the golf club by analyzing the image;
calculating a model for a shadow contour of the golf club based on a straight line component projected onto the floor of the detected club-fitted line; and
calculating Information on the shadow area of the golf club by checking pixels of the difference image of the acquired image based on the calculated model for the contour of the shadow so as to detect pixels corresponding to the shadow area of the golf club as effective pixels.

### Claim 5 (depends on 1)

The method according to claim 1, wherein the detecting the golf club includes:
calculating a model for the center line of the club shaft from the information on the shadow area of the golf club; and
detecting the golf club by converting the two-dimensional coordinates according to the model for the center line of the club shaft into three-dimensional coordinates.

### Claim 6 (depends on 1)

The method according to claim 1, wherein the detecting the golf club includes:
calculating center point candidate data through fitting using Taylor series from the information on the shadow area of the golf club;
calculating a model for a center line of the club shaft through fitting on the center point candidate data from which outliers are removed; and
detecting the golf club by converting the two-dimensional coordinates according to the calculated model for the center line of the club shaft into three-dimensional coordinates.

### Claim 7 (depends on 1)

The method according to claim 1, wherein the calculating information on the shadow area of the golf club includes:
detecting a shadow estimation area of the golf club from the structural relationship of the camera, a lighting source, and a bottom surface so as to calculate a model for the shadow contour from the shadow estimation area;
generating a check window having a size corresponding to the model for the shadow contour so that each of the pixels is a center pixel of the check window in the detected shadow estimation area in a difference image of the acquired image;
determining whether the center pixel is an effective pixel by checking all pixels inside the generated check window; and
calculating information on the shadow area including information on the determined effective pixels by determining the effective pixels among all pixels in the shadow estimation area.

### Claim 8

A method for detecting a golf club using a sensing device including a camera, the method comprising:
estimating an outline of a shadow of a golf club held by a golf swing user;
detecting effective pixels corresponding to the shadow by checking pixels in the estimated outline of the shadow on the image using an image acquired by the camera in a field of view including the golf club, and calculating information on the shadow area of the golf club therefrom; and
detecting the golf club through analysis of the information on the shadow area.

### Claim 9 (depends on 8)

The method according to claim 8, wherein the calculating information on the shadow area includes,
detecting the effective pixels within the estimated outline from the difference image of the acquired image, and calculating a model for the shadow determined by the detected effective pixels, and
wherein the detecting the golf club through analysis includes,
calculating a model for the center line of the club shaft through the data on the image defined by the calculated model for the shadow, and detecting the golf club by converting the two-dimensional coordinates according to the model for the center line of the club shaft into three-dimensional coordinates.

### Claim 10 (depends on 8)

The method according to claim 8, wherein the calculating information on the shadow area includes,
detecting a club-fitted line approximated to a club shaft of the golf club by analyzing the image; and
calculating information on the shadow area of the golf club including information on pixels corresponding to the shadow area of the golf club formed on a bottom surface from the image based on a straight line component projected onto the bottom surface of the detected club-fitted line; and
detecting the golf club through analysis of information on the shadow area.

### Claim 11

A sensing device for detecting a golf club during a golf swing, comprising:
a camera that acquires an image at an angle of view including the golf club held by a golf swing user; and
a sensing processor that specifies a shadow area of the golf club formed on a bottom surface from the image and detecting the golf club through analysis of information on the specified shadow area of the golf club.

### Claim 12 (depends on 11)

The sensing device according to claim 11, wherein the sensing processor is configured to:
estimate an outline of the shadow of the golf club,
specify a shadow area of the golf club by checking pixels in the estimated outline of the shadow from the image so as to detect effective pixels corresponding to the shadow area,
calculate a model for a center line of a club shaft of the golf club from data corresponding to the specified shadow area of the golf club, and
detect the golf club by converting the two-dimensional coordinates according to the model for the center line of the club shaft into three-dimensional coordinates.
