# US 12,190,697 B2 · System and method for intelligent walking guard > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,190,697 B2 - Document ID: US12190697B2 - Status: Granted - Kind: B2 - Application number: 17/992,437 - Filed: 2022-11-22 - Published: 2023-05-25 - Granted: 2025-01-07 - Earliest claimed: 2021-11-23 - Applicants: Isabella H. Schwartz - Inventors: Isabella H. Schwartz - Web page: https://patentgrep.com/patent/US12190697B2 ## CPC - G08B 21/02: Alarms for ensuring the safety of persons - G08B 21/182: {Level alarms, e.g. alarms responsive to variables exceeding a threshold} - H04W 4/029: Location-based management or tracking services - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract The present teaching relates to method, system, medium, and implementations for guarding a walking environment. When it is automatically detected when a user is actively interacting with a device while walking, information surrounding the walking user is monitored based on sensor data from a plurality of sensors deployed on the device to detect surrounding obstacles around the walking user from the sensor data. When it is determined that some of the obstacles satisfy certain pre-determined criteria, warning messages are delivered on the device alerting the user about the surrounding. ## Claims ### Claim 1 A method implemented on at least one processor, a memory, and a communication platform for guarding a walking environment, comprising: detecting automatically that a user is actively interacting with a device while walking; allocating, if the user is interacting with the device while walking, different ones of a plurality of sensors deployed at different locations of the device for capturing sensor data in corresponding distinct directions around the user, wherein the allocation is based on proximity of the device with respect to the head of the user and orientation thereof; detecting, based on sensor data from each of the dynamically allocated sensors to monitor in a corresponding distinct direction, whether an obstacle is present; determining whether the obstacle detected in a corresponding direction satisfies certain pre-determined criteria; and delivering, with respect to the obstacle in a corresponding direction, one or more warning messages via the device to the user alerting the user about the obstacle in the corresponding direction. ### Claim 2 (depends on 1) The method of claim 1, wherein the step of detecting that a user is actively interacting with a device while walking comprises: determining whether the device is in motion based on information from the device; determining whether there is a user activity indicative of interaction with an application running on the device; reporting, if the device is in motion and there is a user activity, that the user is actively interacting with the device while walking. ### Claim 3 (depends on 1) The method of claim 1, wherein the step of allocating comprises: receiving information from a special one of the plurality of sensors for monitoring what is in front of a screen of the device; determining the proximity between the head of the user and the device as well as the orientation of the device based on the information from the special one of the plurality of sensors; based on the proximity and the orientation, dynamically designating a first set of the plurality of sensors to monitor surrounding in front of the user, a second set of the plurality of sensors to monitor surrounding on left side of the user, and a third set of the plurality of the sensors to monitor surrounding on right side of the user; activating the first, second, and third sets of sensors to acquire the sensor data. ### Claim 4 (depends on 1) The method of claim 1, wherein the step of determining comprises: accessing the predetermined criteria that specify at least one alert distance condition; and with respect to the obstacle in the corresponding direction, estimating a distance from the user to the obstacle based on the sensor data acquired by a sensor allocated for monitoring the corresponding direction, and assessing whether the distance satisfies the at least one alert distance condition. ### Claim 5 (depends on 1) The method of claim 1, wherein the step of delivering comprises: obtaining a configuration specifying an alert preference with respect to a warning message in alerting obstacles detected in different regions around the user; determining a region in the corresponding direction in which the obstacle is detected; and generating content of a warning message to alert the user about presence of the obstacle in the region based on the alert preference specified with respect to the region, wherein the warning message provides information to the user about the region in the corresponding direction and a distance between the user and the obstacle. ### Claim 6 (depends on 5) The method of claim 5, further comprising: analyzing the configuration to extract information specifying a manner by which the content of a warning message is to be delivered to the user; determining one or more parameters to be used to deliver the warning message in the manner based on the configuration and/or at least one feature associated with the at least some obstacles. ### Claim 7 (depends on 6) The method of claim 6, further comprising: ranking the at least some obstacles based on the at least one feature associated with the at least some obstacles to generate an ordered list of the warning messages for warning the at least some obstacles; transmitting each of the warning messages in the ordered list in the order specified for a corresponding obstacle to the user in the manner based on the one or more parameters in accordance with the order. ### Claim 8 Machine readable and non-transitory medium having information recorded thereon for guarding a walking environment, wherein the information, when read by the machine, causes the machine to perform the following steps: detecting automatically that a user is actively interacting with a device while walking; allocating, if the user is interacting with the device while walking, different ones of a plurality of sensors deployed at different locations of the device for capturing sensor data in corresponding distinct directions around the user, wherein the allocation is based on proximity of the device with respect to the head of the user and orientation thereof; detecting, based on sensor data from each of the dynamically allocated sensors to monitor in a corresponding distinct direction, whether an obstacle is present; determining whether the obstacle detected in a corresponding direction satisfies certain pre-determined criteria; and delivering, with respect to the obstacle in a corresponding direction, one or more warning messages via the device to the user alerting the user about the obstacle in the corresponding direction. ### Claim 9 (depends on 8) The medium of claim 8, wherein the step of detecting that a user is actively interacting with a device while walking comprises: determining whether the device is in motion based on information from the device; determining whether there is a user activity indicative of interaction with an application running on the device; reporting, if the device is in motion and there is a user activity, that the user is actively interacting with the device while walking. ### Claim 10 (depends on 8) The medium of claim 8, wherein the step of allocating comprises: receiving information from a special one of the plurality of sensors for monitoring what is in front of a screen of the device; determining the proximity between the head of the user and the device as well as the orientation of the device based on the information from the special one of the plurality of sensors; based on the proximity and the orientation, dynamically designating a first set of the plurality of sensors to monitor surrounding in front of the user, a second set of the plurality of sensors to monitor surrounding on left side of the user, and a third set of the plurality of the sensors to monitor surrounding on right side of the user; activating the first, second, and third sets of sensors to acquire the sensor data. ### Claim 11 (depends on 8) The medium of claim 8, wherein the step of determining comprises: accessing the predetermined criteria that specify at least one alert distance condition; and with respect to the obstacle in the corresponding direction, estimating a distance from the user to the obstacle based on the sensor data acquired by a sensor allocated for monitoring the corresponding direction, and assessing whether the distance satisfies the at least one alert distance condition. ### Claim 12 (depends on 8) The medium of claim 8, wherein the step of delivering comprises: obtaining a configuration specifying an alert preference with respect to a warning message in alerting obstacles detected in different regions around the user; determining a region in the corresponding direction in which the obstacle is detected; and generating content of a warning message to alert the user about presence of the obstacle in the region based on the alert preference specified with respect to the region, wherein the warning message provides information to the user about the region in the corresponding direction and a distance between the user and the obstacle. ### Claim 13 (depends on 12) The medium of claim 12, wherein the information, when read by the machine, further causes the machine to perform the following steps: analyzing the configuration to extract information specifying a manner by which the content of a warning message is to be delivered to the user; determining one or more parameters to be used to deliver the warning message in the manner based on the configuration and/or at least one feature associated with the at least some obstacles. ### Claim 14 (depends on 13) The medium of claim 13, wherein the information, when read by the machine, further causes the machine to perform the following steps: ranking the at least some obstacles based on the at least one feature associated with the at least some obstacles to generate an ordered list of the warning messages for warning the at least some obstacles; transmitting each of the warning messages in the ordered list in the order specified for a corresponding obstacle to the user in the manner based on the one or more parameters in accordance with the order. ### Claim 15 A system for guarding a walking environment, comprising: a device activity detector implemented by a processor and configured for detecting automatically that a user is actively interacting with a device while walking; a sensor designation determiner implemented by a processor and configured for allocating, if the user is interacting with the device while walking, different ones of a plurality of sensors deployed at different locations of the device for capturing sensor data in corresponding distinct directions around the user, wherein the allocation is based on proximity of the device with respect to the head of the user and orientation thereof; one or more obstacle distance determiners implemented by a processor each of which is configured for: detecting, based on sensor data from each of the dynamically allocated sensors to monitor in a corresponding distinct direction, whether an obstacle is present and determining whether the obstacle detected in a corresponding direction satisfies certain pre-determined criteria; and one or more obstacle warning units implemented by a processor, each of which is configured for delivering, with respect to the obstacle in a corresponding direction, one or more warning messages via the device to the user alerting the user about the obstacle in the corresponding direction. ### Claim 16 (depends on 15) The system of claim 15, wherein the step of detecting that a user is actively interacting with a device while walking comprises: determining whether the device is in motion based on information from the device; determining whether there is a user activity indicative of interaction with an application running on the device; reporting, if the device is in motion and there is a user activity, that the user is actively interacting with the device while walking. ### Claim 17 (depends on 15) The system of claim 15, wherein the sensor designation determiner is configured for: receiving information from a special one of the plurality of sensors for monitoring what is in front of a screen of the device; determining the proximity between the head of the user and the device as well as the orientation of the device based on the information from the special one of the plurality of sensors; based on the proximity and the orientation, dynamically designating, a first set of the plurality of sensors to monitor surrounding in front of the user, a second set of the plurality of sensors to monitor surrounding on left side of the user, and a third set of the plurality of the sensors to monitor surrounding on right side of the user; activating the first, second, and third sets of sensors to acquire the sensor data. ### Claim 18 (depends on 15) The system of claim 15, wherein the step of determining comprises: accessing the predetermined criteria that specify at least one alert distance condition; and with respect to the obstacle in the corresponding direction, estimating a distance from the user to the obstacle based on the sensor data acquired by a sensor allocated for monitoring the corresponding direction, and assessing whether the distance satisfies the at least one alert distance condition. ### Claim 19 (depends on 15) The system of claim 15, further comprising an alert content generator implemented by a processor and configured for: obtaining a configuration specifying an alert preference with respect to a warning message in alerting obstacles detected in different regions around the user; determining a region in the corresponding direction in which the obstacle is detected; and generating content of a warning message to alert the user about presence of the obstacle in the region based on the alert preference specified with respect to the region, wherein the warning message provides information to the user about the region in the corresponding direction and a distance between the user and the obstacle. ### Claim 20 (depends on 15) The system of claim 15, further comprising a message output controller implemented by a processor and configured for: ranking the at least some obstacles based on at least one feature associated with the at least some obstacles to generate an ordered list of the warning messages for warning the at least some obstacles; transmitting each of the warning messages in the ordered list in the order specified for each corresponding obstacle to the user.