# US 9,039,537 B2 · Light gun and method for determining shot position > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,039,537 B2 - Document ID: US9039537B2 - Status: Granted - Kind: B2 - Application number: 13/693,051 - Filed: 2012-12-04 - Published: 2013-11-21 - Granted: 2015-05-26 - Earliest claimed: 2012-05-16 - Assignees: Zhongshan Innocloud Intellectual Property Services Co., Ltd. - Applicants: Zhongshan Innocloud Intellectual Property Services Co., Ltd. - Inventors: Hou-Hsien Lee; Chang-Jung Lee; Chih-Ping Lo - Web page: https://patentgrep.com/patent/US9039537B2 ## CPC - A63F 13/837: Shooting of targets - A63F 13/213: comprising photodetecting means, e.g. cameras, photodiodes or infrared cells (A63F13/219 takes precedence) - A63F 13/219: for aiming at specific areas on the display, e.g. light-guns - A63F 13/426: involving on-screen location information, e.g. screen coordinates of an area at which the player is aiming with a light gun - A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR ## Abstract In a method for determining a shot position of a light gun on a display screen, a current image is captured by an image capturing device of the light gun. The method detects a screen area in the current image, calculates coordinates of an aimed point of the light gun on the display screen when the screen area has been detected, and transmits the coordinates of the aimed point of the light gun to a host computer so that a shot result of the light gun is displayed on the display screen by the host computer according to the coordinates of the aimed point of the light gun on the display screen. ## Claims ### Claim 1 A computer-implemented method for determining a shot position of a light gun on a display screen, the method comprising: obtaining a current image captured by an image capturing device of the light gun; detecting a screen area in the current image by comparing the current image with a screen template of the display screen, the current image comprising distance information between a lens of the image capturing device and each point of the screen area in the current image; calculating actual coordinates of the aimed point of the light gun on the display screen according to a virtual size of the screen area and an actual size of the display screen; and transmitting the actual coordinates to a host computer in response to receiving a shot command of the light gun, and displaying a shot result of the light gun on the display screen using the host computer according to the actual coordinates. ### Claim 2 (depends on 1) The method according to claim 1, wherein the screen template comprises a sub-image of a preset area enclosing the display screen and a reference distance between the lens of the image capturing device and the display screen in the preset area. ### Claim 3 (depends on 2) The method according to claim 2, wherein the reference distance is determined as a distance between the lens of the image capturing device and a feature point in the preset area. ### Claim 4 (depends on 2) The method according to claim 2, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that each of the current distances is equal to the reference distance, the current ratio is equal to the reference ratio, and the current size is equal to the reference size. ### Claim 5 (depends on 2) The method according to claim 2, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that a first deviation value between each of the current distances and the reference distance falls in a first preset range, a second deviation value between the current ratio and the reference ratio falls in a second preset range, and a third deviation value between the current size and the reference size falls in a third preset range. ### Claim 6 (depends on 2) The method according to claim 2, wherein the actual coordinates of the aimed point of the light gun on the display screen are calculated by: creating a virtual coordinate system of the screen area and obtaining virtual coordinates of the aimed point of the light gun in the screen area; creating an actual coordinate system of the display screen, and transforming the virtual coordinates to the actual coordinates of the aimed point of the light gun on the display screen according to a ratio between the virtual size of screen area and the actual size of the display screen. ### Claim 7 A light gun, comprising: a storage device; at least one processor; and one or more modules that are stored in the storage device and are executed by the at least one processor, the one or more modules comprising: an image obtaining module that obtains a current image captured by an image capturing device of the light gun; a screen area detection module that detects a screen area in the current image by comparing the current image with a screen template of the display screen, the current image comprising distance information between a lens of the image capturing device and each point of the screen area in the current image; a coordinate calculation module that calculates actual coordinates of an aimed point of the light gun on a display screen according to a virtual size of the screen area and an actual size of the display screen; and transmitting the actual coordinates to a host computer in response to receiving a shot command of the light gun, and displaying a shot result of the light gun on the display screen using the host computer according to the actual coordinates. ### Claim 8 (depends on 7) The light gun according to claim 7, wherein the screen template comprises a sub-image of a preset area enclosing the display screen and a reference distance between the lens of the image capturing device and the display screen in the preset area. ### Claim 9 (depends on 8) The light gun according to claim 8, wherein the reference distance is determined as a distance between the lens of the image capturing device and a feature point in the preset area. ### Claim 10 (depends on 8) The light gun according to claim 8, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that each of the current distances is equal to the reference distance, the current ratio is equal to the reference ratio, and the current size is equal to the reference size. ### Claim 11 (depends on 8) The light gun according to claim 8, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that a first deviation value between each of the current distances and the reference distance falls in a first preset range, a second deviation value between the current ratio and the reference ratio falls in a second preset range, and a third deviation value between the current size and the reference size falls in a third preset range. ### Claim 12 (depends on 8) The light gun according to claim 8, wherein the coordinate calculation module calculates actual coordinates by: creating a virtual coordinate system of the screen area and obtaining virtual coordinates of the aimed point of the light gun in the screen area; creating an actual coordinate system of the display screen, and transforming the virtual coordinates to the actual coordinates of the aimed point of the light gun on the display screen according to a ratio between the virtual size of screen area and the actual size of the display screen. ### Claim 13 A non-transitory storage medium having stored thereon instructions that, when executed by a processor of a light gun, causes the light gun to perform a method for determining a shot position of the light gun on a display screen, the method comprising: obtaining a current image captured by an image capturing device of the light gun; detecting a screen area in the current image by comparing the current image with a screen template of the display screen, the current image comprising distance information between a lens of the image capturing device and each point of the screen area in the current image; calculating actual coordinates of the aimed point of the light gun on the display screen according to a virtual size of the screen area and an actual size of the display screen; and transmitting the actual coordinates to a host computer in response to receiving a shot command of the light gun, and displaying a shot result of the light gun on the display screen using the host computer according to the actual coordinates. ### Claim 14 (depends on 13) The non-transitory storage medium according to claim 13, wherein the screen template comprises a sub-image of a preset area enclosing the display screen and a reference distance between the lens of the image capturing device and the display screen in the preset area. ### Claim 15 (depends on 14) The non-transitory storage medium according to claim 14, wherein the reference distance is determined as a distance between the lens of the image capturing device and a feature point in the preset area. ### Claim 16 (depends on 14) The non-transitory storage medium according to claim 14, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that each of the current distances is equal to the reference distance, the current ratio is equal to the reference ratio, and the current size is equal to the reference size. ### Claim 17 (depends on 14) The non-transitory storage medium according to claim 14, wherein the screen area is detected by: obtaining the reference distance from the screen template, a reference ratio between a width and a height of the preset area in the screen template, and a reference size of the preset area in the screen template; obtaining an image sub-area in the current image and a specified number of points in the image sub-area, and determining a current distance between each of the specified number of points and the lens of the image capturing device, a current ratio between a width and a height of the image sub-area, and a current size of the image sub-area; and determining that the image sub-area is the screen area upon the condition that a first deviation value between each of the current distances and the reference distance falls in a first preset range, a second deviation value between the current ratio and the reference ratio falls in a second preset range, and a third deviation value between the current size and the reference size falls in a third preset range. ### Claim 18 (depends on 14) The non-transitory storage medium according to claim 14, wherein the actual coordinates of the aimed point of the light gun on the display screen are calculated by: creating a virtual coordinate system of the screen area and obtaining virtual coordinates of the aimed point of the light gun in the screen area; creating an actual coordinate system of the display screen, and transforming the virtual coordinates to the actual coordinates of the aimed point of the light gun on the display screen according to a ratio between the virtual size of screen area and the actual size of the display screen.