# US 12,179,059 B2 · System and method for monitoring activity in a gym environment > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,179,059 B2 - Document ID: US12179059B2 - Status: Granted - Kind: B2 - Application number: 17/571,122 - Filed: 2022-01-07 - Published: 2022-09-08 - Granted: 2024-12-31 - Earliest claimed: 2021-03-05 - Assignees: Sony Group Corporation - Applicants: Sony Group Corporation - Inventors: Jakob Håkansson; Axel Mulder - Web page: https://patentgrep.com/patent/US12179059B2 ## CPC - A63B 24/0062: {Monitoring athletic performances, e.g. for determining the work of a user on an exercise apparatus, the completed jogging or cycling distance} - H04L 67/1396: specially adapted for monitoring users' activity - A61B 5/0024: {for multiple sensor units attached to the patient, e.g. using a body or personal area network} - A61B 5/1113: {Local tracking of patients, e.g. in a hospital or private home} - A61B 5/1118: {Determining activity level} - A61B 5/1126: {using a particular sensing technique} - A63B 71/0622: {Visual, audio or audio-visual systems for entertaining, instructing or motivating the user} - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06V 20/46: {Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/10: Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands - G06V 40/23: {Recognition of whole body movements, e.g. for sport training} - H04B 5/70: specially adapted for specific purposes - H04L 67/12: specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks - H04L 67/535: {Tracking the activity of the user (network monitoring arrangements H04L43/00; recording of computer activity G06F11/34)} - H04L 67/54: Presence management, e.g. monitoring or registration for receipt of user log-on information, or the connection status of the users - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - A63B 2220/05: Image processing for measuring physical parameters - A63B 2220/806: Video cameras - A63B 2225/54: Transponders, e.g. RFID - G06T 2207/10016: Video; Image sequence - G06T 2207/30196: Human being; Person - G06T 2207/30221: Sports video; Sports image - G06T 2207/30232: Surveillance - A63B: APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT (apparatus for passive exercising, massage A61H) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04B: TRANSMISSION - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A system for monitoring activity in a gym environment includes a monitoring system configured to identify human representations in the gym environment and track movement of the human representations; a transceiver unit for receiving communication signals within the gym environment; a waypoint transmitter arranged at a predetermined location in the gym environment and configured to transmit a near field wireless signal; a control system configured to assign a specific human representation to an electronic device, responsive to the monitoring system detecting presence of the specific human representation at said location at a point in time associated with reception in the electronic device of the near field wireless signal. ## Claims ### Claim 1 A system for monitoring activity in a gym environment, wherein the system comprises: a monitoring system configured to identify one or more human representations in the gym environment and track movement of the one or more human representations, wherein the monitoring system includes: a plurality of cameras having overlapping fields of view, and logic configured to process video streams from the plurality of cameras for detection of key points of an object, and to associate said key points to positions on a human body; a transceiver unit for receiving communication signals from a plurality of electronic devices within the gym environment; a waypoint transmitter arranged at a predetermined location in the gym environment and configured to transmit a near field wireless signal detectable by the plurality of electronic devices; a control system configured to: assign a specific human representation of the one or more human representations to a specific electronic device of the plurality of electronic devices, responsive to the monitoring system detecting presence of the specific human representation at the predetermined location at a point in time associated with reception in the specific electronic device of the near field wireless signal, wherein the specific electronic device is associated with a user corresponding to the specific human representation; and store exercise activity data associated with the specific electronic device, wherein the exercise data is based on movement detected by the monitoring system of the specific human representation assigned to the specific electronic device. ### Claim 2 (depends on 1) The system of claim 1, further being configured to output a message indicating a test motion, wherein the control system is configured to assign the specific human representation to the specific electronic device based on the monitoring system detecting a movement of the specific human representation corresponding to said test motion. ### Claim 3 (depends on 2) The system of claim 2, wherein the control system is configured to control the transceiver unit to transmit said message to the specific electronic device. ### Claim 4 (depends on 2) The system of claim 2, wherein the control system is configured to output said message on an interface arranged at the predetermined location. ### Claim 5 (depends on 2) The system of claim 2, wherein the control system is configured to assign the specific human representation to the specific electronic device based on the monitoring system detecting the movement corresponding to said test motion within a predetermined time period. ### Claim 6 (depends on 2) The system of claim 2, wherein said test motion is randomly selected from a group of test motions. ### Claim 7 (depends on 1) The system of claim 1, further being configured to determine a physical characteristic of the specific human representation, and to assign the specific human characteristic to the specific electronic device based on the determined physical characteristic matching prestored characteristic data associated with the specific electronic device. ### Claim 8 (depends on 1) The system of claim 1, wherein the control system is configured to control the transceiver unit to transmit an acknowledgment signal to the specific electronic device, responsive to successful assignment of the specific human representation to the specific electronic device. ### Claim 9 (depends on 1) The system of claim 1, wherein the control system is configured to determine the point in time associated with reception based on a wireless communication signal received in the transceiver unit from the specific electronic device. ### Claim 10 A method for monitoring activity in a gym environment, the method comprising: identifying a human representation in the gym environment and tracking movement of the human representation, using a monitoring system having a plurality of cameras having overlapping fields of view, and logic configured to process video streams from the plurality of cameras for detection of key points of an object, and to associate said key points to positions on a human body; receiving an indication of reception in an electronic device associated with a user of a near field wireless signal transmitted from a waypoint transmitter arranged at a predetermined location in the gym environment; assigning the identified human representation to the electronic device associated with the user, responsive to detecting presence of the identified human representation at said location at a point in time associated with the reception in the electronic device of the near field wireless signal, wherein the user corresponds to the identified human representation; and storing exercise activity data associated with the electronic device, wherein the exercise activity data is based on movement detected by the monitoring system of the identified human representation assigned to the electronic device. ### Claim 11 (depends on 10) The method of claim 10, comprising: outputting a message indicating a test motion, wherein the assigning of the identified human representation to the electronic device is carried out based on detecting a movement of the identified human representation corresponding to said test motion. ### Claim 12 (depends on 11) The method of claim 11, wherein the message is transmitted to the electronic device for output on the electronic device. ### Claim 13 (depends on 12) The method of claim 12, wherein the message is output on an interface arranged at the predetermined location. ### Claim 14 (depends on 11) The method of claim 11, wherein the assigning is carried out based on detecting the movement corresponding to said test motion within a predetermined time period. ### Claim 15 (depends on 11) The method of claim 11, comprising: randomly selecting said test motion from a group of test motions. ### Claim 16 (depends on 11) The method of claim 11, further comprising: determining a physical characteristic of the identified human representation, wherein the assigning is carried out based on the determined physical characteristic matching prestored characteristic data associated with the electronic device. ### Claim 17 (depends on 10) The method of claim 10, comprising: transmitting an acknowledgment signal to the electronic device, responsive to successful assignment of the identified human representation to the electronic device.