# US 10,482,900 B2 · Organization of signal segments supporting sensed features > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,482,900 B2 - Document ID: US10482900B2 - Status: Granted - Kind: B2 - Application number: 15/436,684 - Filed: 2017-02-17 - Published: 2018-07-19 - Granted: 2019-11-19 - Earliest claimed: 2017-01-18 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Vijay Mital; Olivier Colle; Robin Abraham - Web page: https://patentgrep.com/patent/US10482900B2 ## CPC - G10L 25/48: specially adapted for particular use - G06F 18/2414: {Smoothing the distance, e.g. radial basis function networks [RBFN]} - G06N 3/006: based on simulated virtual individual or collective life forms, e.g. social simulations or particle swarm optimisation [PSO] - G06N 5/045: Explanation of inference; Explainable artificial intelligence [XAI]; Interpretable artificial intelligence - G06V 10/764: using classification, e.g. of video objects - G06V 10/82: using neural networks - G10L 25/30: using neural networks - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract The managing of sensed signals used to sense features of physical entities over time. A computer-navigable graph of sensed features is generated. For each sensed feature, a signal segment that was used to sense that feature is computer-associated with the sensed feature. Later, the graph of sensed features may be navigated to that features. The resulting signal segment(s) may then be access allowing for rendering of the signal evidence that resulted in the sensed feature. Accordingly, the principles described herein allow for sophisticated and organized navigation to sensed features of physical entities in the physical world, and allow for rapid rendering of the signals that evidence that sensed features. ## Claims ### Claim 1 A computing system for performing a method for managing sensed signals used to sense features of physical entities over time, the system comprising: one or more processors; one or more computer-readable media having thereon computer-executable instructions that, when executed by the one or more processors, cause the computing system to perform the method for managing sensed signals used to sense features of physical entities over time, the method comprising: creating a computer-navigable graph of a plurality of sensed features of a plurality of sensed physical entities over a plurality of times, the sensed features determined from analysis of sensor signals observed of the plurality of sensed physical entities; and for at least one of the sensed features of at least one of the sensed plurality of entities, associating within the computer-navigable graph a signal segment with the at least one sensed feature such that computer-navigation to the sensed feature also allows for computer-navigation to the signal segment, wherein the associated signal segment is a particular signal segment of the at least one sensed entity which had been analyzed to determine the at least one sensed feature. ### Claim 2 (depends on 1) The computing system in accordance with claim 1, the signal segment comprising an identification of a sensor that resulted in sensing of the sensed feature. ### Claim 3 (depends on 2) The computing system in accordance with claim 2, the signal segment excluding at least one or more signal segments from the identified sensor that were not used to sense the sensed feature. ### Claim 4 (depends on 1) The computing system in accordance with claim 1, the signal segment comprising a video signal, the signal segment comprising one or more frames of a video signal generated by a sensor. ### Claim 5 (depends on 4) The computing system in accordance with claim 4, wherein for at least one of the frames of the video signal, the signal segment includes just a portion of the frame. ### Claim 6 (depends on 1) The computing system in accordance with claim 1, the signal segment comprising an image signal captured by a sensor. ### Claim 7 (depends on 6) The computing system in accordance with claim 6, the signal segment including just a portion of the image captured by the sensor. ### Claim 8 (depends on 1) The computing system in accordance with claim 1, the sensed signal being an audio signal captured by a sensor. ### Claim 9 (depends on 1) The computing system in accordance with claim 1, the sensed signal being a filtered version of a signal captured by a sensor. ### Claim 10 (depends on 9) The computing system in accordance with claim 9, the filtered version being filtered by frequency. ### Claim 11 (depends on 1) The computing system in accordance with claim 1, the sensed signal being transformed. ### Claim 12 (depends on 1) The computing system in accordance with claim 1, the method further comprising: navigating the navigable graph to a particular sensed feature of the plurality of features; and navigating to the sensed signal computer-associated with the particular sensed feature using the computer-association between the particular sensed feature and the associated sensor signal. ### Claim 13 (depends on 12) The computing system in accordance with claim 12, the navigating the navigable graph to the particular sensed feature being performed in response to user input. ### Claim 14 (depends on 13) The computing system in accordance with claim 13, the navigating to the sensed signal occurring automatically upon performing the act of navigating to the particular sensed feature. ### Claim 15 (depends on 13) The computing system in accordance with claim 13, the navigating to the sensed signal occurring in response to user input received after the act of navigating the navigable graph to the particular sensed feature. ### Claim 16 (depends on 12) The computing system in accordance with claim 12, the navigating to the particular sensed feature being performed in response to a user query. ### Claim 17 (depends on 12) The computing system in accordance with claim 12, the method further comprising rendering the sensed signal. ### Claim 18 A computer implemented method for managing sensed signals used to sense features of physical entities over time, the method comprising: executing computer-executable instructions on one or more processors of a computing system, thereby causing the computing system to perform the method comprising: creating a computer-navigable graph of a plurality of sensed features of a plurality of sensed physical entities over a plurality of times, the sensed features determined from analysis of sensor signals observed of the plurality of sensed physical entities; and for at least one of the sensed features of at least one of the sensed plurality of entities, associating within the computer-navigable graph a signal segment with the at least one sensed feature such that computer-navigation to the sensed feature also allows for computer-navigation to the signal segment, wherein the associated signal segment is a particular signal segment of the at least one sensed entity which had been analyzed to determine the at least one sensed feature. ### Claim 19 (depends on 18) The method in accordance with claim 18, further comprising: navigating the navigable graph to a particular sensed feature of the plurality of features; and navigating to the sensed signal computer-associated with the particular sensed feature using the computer-association between the particular sensed feature and the associated sensor signal. ### Claim 20 A computer program product for managing sensed signals used to sense features of physical entities over time, the computer program product comprising one or more computer-readable storage media having thereon computer-executable instructions that, when executed by one or more processors of a computing system, cause the computing system to perform a method for managing sensed signals used to sense features of physical entities over time, the method comprising: creating a computer-navigable graph of a plurality of sensed features of a plurality of sensed physical entities over a plurality of times, the sensed features determined from analysis of sensor signals observed of the plurality of sensed physical entities; and for at least one of the sensed features of at least one of the sensed plurality of entities, associating within the computer-navigable graph a signal segment with the at least one sensed feature such that computer-navigation to the sensed feature also allows for computer-navigation to the signal segment, wherein the associated signal segment is a particular signal segment of the at least one sensed entity which had been analyzed to determine the at least one sensed feature.