# US 12,222,213 B2 · Digital twin based binaural audio echolocation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,222,213 B2 - Document ID: US12222213B2 - Status: Granted - Kind: B2 - Application number: 17/490,043 - Filed: 2021-09-30 - Published: 2023-03-30 - Granted: 2025-02-11 - Earliest claimed: 2021-09-30 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Partho Ghosh; Vinod A. Valecha; Aruna Ratna Kumari Peketi; Liliya Bojkova-Popova - Web page: https://patentgrep.com/patent/US12222213B2 ## CPC - G01C 21/3407: {specially adapted for specific applications} - G01C 21/3629: {Guidance using speech or audio output, e.g. text-to-speech (text to speech systems per se G10L13/00)} - G01C 21/3644: {Landmark guidance, e.g. using POIs or conspicuous other objects} - G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads - G01S 15/86: Combinations of sonar systems with lidar systems; Combinations of sonar systems with systems not using wave reflection - G01S 15/93: for anti-collision purposes - G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES ## Abstract A processor may receive an information dataset. The information dataset may include object information and environment information. A processor may generate a digital twin of a physical environment. The digital twin of the physical environment may be based, at least in part, on the information dataset. A processor may simulate one or more factors on the digital twin of the physical environment. A processor may determine, responsive to simulating the one or more factors, one or more pathways to a destination. The destination may be in the physical environment. ## Claims ### Claim 1 A method of managing navigation in a physical environment, the method comprising: receiving, by a processor, an information dataset from a real-time data feed, wherein the information dataset includes object information, user information, and environment information; generating a digital twin of a physical environment and a user, wherein the digital twin of the physical environment is based, at least in part, on the information dataset, and wherein the digital twin of the physical environment and the user are actively changing as the real-time data feed provides continuously updated data associated with the information dataset; simulating one or more factors on the digital twin of the physical environment; identifying a dynamic landmark from the digital twin, wherein the dynamic landmark is a particular parameter change associated with the physical environment; determining an accuracy level of the information dataset based on observing the dynamic landmark in the physical environment and the digital twin; predicting, responsive to simulating the one or more factors, one or more pathways to a destination, wherein the destination is in the physical environment; identifying a user limitation from the user information and digital twin, wherein the user limitation reflects a physical condition suffered by the user; identifying a particular pathway from the one or more pathways, based on the user limitation; and generating one or more binaural auditory notations to the user associated with the particular pathway. ### Claim 2 (depends on 1) The method of claim 1, wherein the information dataset is received from the real-time data feed associated with one or more data collection devices. ### Claim 3 (depends on 1) The method of claim 1, wherein the one or more binaural auditory notations direct the user to a primary pathway of the one or more pathways. ### Claim 4 (depends on 1) The method of claim 1, wherein predicting the one or more pathways to the destination, includes: detecting a static obstacle in the environment from the environment information; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the static obstacle. ### Claim 5 (depends on 1) The method of claim 1, wherein predicting the one or more pathways to the destination, includes: detecting the dynamic obstacle in the physical environment from the environment information; receiving a real-time data feed from one or more data collection devices, wherein the real-time data feed includes environment information associated with the dynamic obstacle; simulating the digital twin of the physical environment to predict a position of the dynamic obstacle; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the dynamic obstacle. ### Claim 6 (depends on 1) The method of claim 1, further comprising: generating one or more updated binaural auditory notations, wherein the one or more updated binaural auditory notations are based, at least in part, on the digital twin. ### Claim 7 (depends on 1) The method of claim 1, wherein the dynamic landmark includes a pressure landmark associated with one or more changes in pressure at one or more different location points in the physical environment. ### Claim 8 A system for managing navigation in a physical environment, the system comprising: a memory; and a processor in communication with the memory, the processor being configured to perform operations comprising: receiving an information dataset from a real-time data feed, wherein the information dataset includes object information, user information, and environment information; generating a digital twin of a physical environment and a user, wherein the digital twin of the physical environment is based, at least in part, on the information dataset, and wherein the digital twin of the physical environment and the user are actively changing as the real-time data feed provides continuously updated data associated with the information dataset; simulating one or more factors on the digital twin of the physical environment; identifying a dynamic landmark from the digital twin, wherein the dynamic landmark is a particular parameter change associated with the physical environment; determining an accuracy level of the information dataset based on observing the dynamic landmark in the physical environment and the digital twin; predicting, responsive to simulating the one or more factors, one or more pathways to a destination, wherein the destination is in the physical environment; identifying a user limitation from the user information and digital twin, wherein the user limitation reflects a physical condition suffered by the user; identifying a particular pathway from the one or more pathways, based on the user limitation; and generating one or more binaural auditory notations to the user associated with the particular pathway. ### Claim 9 (depends on 8) The system of claim 8, wherein the information dataset is received from the real-time data feed associated with one or more data collection devices. ### Claim 10 (depends on 8) The system of claim 8, wherein the one or more binaural auditory notations direct the user to a primary pathway of the one or more pathways. ### Claim 11 (depends on 8) The system of claim 8, wherein predicting the one or more pathways to the destination, includes: detecting a static obstacle in the environment from the environment information; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the static obstacle. ### Claim 12 (depends on 8) The system of claim 8, wherein predicting the one or more pathways to the destination, includes: detecting the dynamic obstacle in the physical environment from the environment information; receiving a real-time data feed from one or more data collection devices, wherein the real-time data feed includes environment information associated with the dynamic obstacle; simulating the digital twin of the physical environment to predict a position of the dynamic obstacle; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the dynamic obstacle. ### Claim 13 (depends on 8) The system of claim 8, further comprising: generating one or more updated binaural auditory notations, wherein the one or more updated binaural auditory notations are based, at least in part, on the digital twin. ### Claim 14 (depends on 8) The system of claim 8, wherein the dynamic landmark includes a pressure landmark associated with one or more changes in pressure at one or more different location points in the physical environment. ### Claim 15 A computer program product for managing navigation in a physical environment, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processors to perform a function, the function comprising: receiving an information dataset from a real-time data feed, wherein the information dataset includes object information, user information, and environment information; generating a digital twin of a physical environment and a user, wherein the digital twin of the physical environment is based, at least in part, on the information dataset, and wherein the digital twin of the physical environment and the user are actively changing as the real-time data feed provides continuously updated data associated with the information dataset; simulating one or more factors on the digital twin of the physical environment; identifying a dynamic landmark from the digital twin, wherein the dynamic landmark is a particular parameter change associated with the physical environment; determining an accuracy level of the information dataset based on observing the dynamic landmark in the physical environment and the digital twin; predicting, responsive to simulating the one or more factors, one or more pathways to a destination, wherein the destination is in the physical environment; identifying a user limitation from the user information and digital twin, wherein the user limitation reflects a physical condition suffered by the user; identifying a particular pathway from the one or more pathways, based on the user limitation; and generating one or more binaural auditory notations to the user associated with the particular pathway. ### Claim 16 (depends on 15) The computer program product of claim 15, wherein the information dataset is received from the real-time data feed associated with one or more data collection devices. ### Claim 17 (depends on 15) The computer program product of claim 15, wherein the one or more binaural auditory notations direct the user to a primary pathway of the one or more pathways. ### Claim 18 (depends on 15) The computer program product of claim 15, wherein predicting the one or more pathways to the destination, includes: detecting a static obstacle in the environment from the environment information; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the static obstacle. ### Claim 19 (depends on 15) The computer program product of claim 15, wherein predicting the one or more pathways to the destination, includes: detecting the dynamic obstacle in the physical environment from the environment information; receiving a real-time data feed from one or more data collection devices, wherein the real-time data feed includes environment information associated with the dynamic obstacle; simulating the digital twin of the physical environment to predict a position of the dynamic obstacle; and identifying a primary pathway from the one or more pathways, wherein the primary pathway avoids the dynamic obstacle. ### Claim 20 (depends on 15) The computer program product of claim 15, wherein the dynamic landmark includes a pressure landmark associated with one or more changes in pressure at one or more different location points in the physical environment.