# US 11,122,099 B2 · Device, system and method for providing audio summarization data from video > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,122,099 B2 - Document ID: US11122099B2 - Status: Granted - Kind: B2 - Application number: 16/205,786 - Filed: 2018-11-30 - Published: 2020-06-04 - Granted: 2021-09-14 - Earliest claimed: 2018-11-30 - Assignees: Motorola Solutions, Inc. - Applicants: Motorola Solutions, Inc. - Inventors: Yan Pin Ong; Fan Sin Khew; Wei Sheng Chin; ZhenYang Ong; Chiew Yeong Ng; Choon Chiat Khor - Web page: https://patentgrep.com/patent/US11122099B2 ## CPC - H04L 65/762: {at the source (reformatting of additional data in video distribution servers H04N21/2355)} - G06V 20/20: in augmented reality scenes - G06V 20/47: {Detecting features for summarising video content} - G08B 1/08: using electric transmission {; transformation of alarm signals to electrical signals from a different medium, e.g. transmission of an electric alarm signal upon detection of an audible alarm signal} - G08B 13/19671: {Addition of non-video data, i.e. metadata, to video stream} - G10L 25/27: characterised by the analysis technique - G10L 25/48: specially adapted for particular use - H04L 65/1059: End-user terminal functionalities specially adapted for real-time communication - H04L 65/1083: In-session procedures - H04L 65/1095: Inter-network session transfer or sharing - H04L 65/61: for supporting one-way streaming services, e.g. Internet radio - H04L 65/80: Responding to QoS - H04N 7/06: Systems for the simultaneous transmission of one television signal, i.e. both picture and sound, by more than one carrier {(H04N7/084, H04N7/087 take precedence)} - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 7/183: {for receiving images from a single remote source} - H04N 21/2743: Video hosting of uploaded data from client - H04N 21/4394: {involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams (arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/44245: {Monitoring the upstream path of the transmission network, e.g. its availability, bandwidth} - H04N 21/631: {Multimode Transmission, e.g. transmitting basic layers and enhancement layers of the content over different transmission paths or transmitting with different error corrections, different keys or with different transmission protocols} - H04N 21/8549: Creating video summaries, e.g. movie trailer {(retrieval in video databases by using presentations in form of a video summary G06F16/739)} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An example device: transmits, to one or more receiving terminals, first frames of video captured by a video camera; determines, after transmission of the first frames of the video, that a signal strength associated with the first network falls below a predetermined threshold; generates audio summarization data corresponding to one or more objects of interest identified in second frames of the video, the second frames captured by the video camera after the first frames; selects a portion of the audio summarization data based on a context associated with a receiving terminal of the one or more receiving terminals; and transmits, using the communication unit, via one or more of the first network and a second network, the portion of the audio summarization data to the receiving terminal. ## Claims ### Claim 1 A method of operating a portable media streaming device, the method comprising: transmitting, via a first network, using the portable media streaming device, to one or more receiving terminals, first frames of video captured by the portable media streaming device; determining, at the portable media streaming device, after transmission of the first frames of the video, that a signal strength associated with the first network falls below a predetermined threshold; identifying one or more objects of interest in second frames of the video captured by the portable media streaming deivce after the first frames, the one or more objects identified using one or more of video analytics on the second frames and audio analytics on audio of the second frames; after the one or more objects of interest are identified, generating, at the portable media streaming device, audio summarization data corresponding to the one or more objects, the audio summarization data comprising an audio description that describes the one or more objects identified in the second frames of the video; selecting, at the portable media streaming device, a portion of the audio summarization data based on a context associated with a receiving terminal of the one or more receiving terminals, the portion of the audio summarization data comprising an identifier of the context; and transmitting, via one or more of the first network and a second network, at the portable media streaming device, the portion of the audio summarization data to all of the one or more receiving terminals, the identifier of the context being configured for use in filtering the portion of the audio summarization data at each of the one or more receiving terminals. ### Claim 2 (depends on 1) The method of claim 1, wherein the one or more objects of interest comprises one or more of a person, a given object, and an entity. ### Claim 3 (depends on 1) The method of claim 1, wherein the first network comprises a broadband network and the second network comprises a narrowband network, the first frames of the video transmitted via the broadband network prior to the signal strength associated with the first network falling below the predetermined threshold, and the portion of the audio summarization data transmitted to the receiving terminal via the narrowband network after the signal strength associated with the first network falls below the predetermined threshold. ### Claim 4 (depends on 1) The method of claim 1, further comprising: selecting, at the portable media streaming device, respective portions of the audio summarization data based on a respective context associated with respective receiving terminals of the one or more receiving terminals; and transmitting, via one or more of the first network and the second network, at the portable media streaming device, the respective portions of the audio summarization data to the respective receiving terminals. ### Claim 5 (depends on 4) The method of claim 4, wherein at least two of the one or more receiving terminals have different respective contexts such that at least two of the respective portions are different from one another. ### Claim 6 (depends on 4) The method of claim 4, wherein each of the respective portions are customized according to respective contexts of the respective receiving terminals. ### Claim 7 (depends on 1) The method of claim 1, further comprising: receiving, via the first network, at the portable media streaming device, from a server associated with the one or more receiving terminals, prior to the signal strength associated with the first network falling below the predetermined threshold, the context of the receiving terminal. ### Claim 8 (depends on 1) The method of claim 1, wherein the context comprises a role associated with a user of the receiving terminal. ### Claim 9 A portable media streaming device comprising: a communication unit configured to communicate with a first network and a second network; and a controller in communication with a video camera, the controller configured to: transmit, using the communication unit, via the first network, to one or more receiving terminals, first frames of video captured by the video camera; determine, after transmission of the first frames of the video, that a signal strength associated with the first network falls below a predetermined threshold; identify one or more objects of interest in second frames of the video captured by the video camera after the first frames, the one or more objects identified using one or more of video analytics on the second frames and audio analytics on audio of the second frames; after the one or more objects of interest are identified, generate audio summarization data corresponding to the one or more objects, the audio summarization data comprising an audio description that describes the one or more objects identified in the second frames of the video; select a portion of the audio summarization data based on a context associated with a receiving terminal of the one or more receiving terminals, the portion of the audio summarization data comprising an identifier of the context; and transmit, using the communication unit, via one or more of the first network and a second network, the portion of the audio summarization data to all of the one or more receiving terminals, the identifier of the context being configured for use in filtering the portion of the audio summarization data at each of the one or more receiving terminals. ### Claim 10 (depends on 9) The portable media streaming device of claim 9, wherein the controller is further configured to: receive, using the communication unit, via the first network, from a server associated with the one or more receiving terminals, prior to the signal strength associated with the first network falling below the predetermined threshold, the context of the receiving terminal. ### Claim 11 (depends on 9) The portable media streaming device of claim 9, wherein the context comprises a role associated with a user of the receiving terminal. ### Claim 12 (depends on 9) The portable media streaming device of claim 9, wherein the one or more objects of interest comprises one or more of a person, a given object, and an entity. ### Claim 13 (depends on 9) The portable media streaming device of claim 9, wherein the first network comprises a broadband network and the second network comprises a narrowband network, the first frames of the video transmitted via the broadband network prior to the signal strength associated with the first network falling below the predetermined threshold, and the portion of the audio summarization data transmitted to the receiving terminal via the narrowband network after the signal strength associated with the first network falls below the predetermined threshold. ### Claim 14 (depends on 9) The portable media streaming device of claim 9, wherein the controller is further configured to: select respective portions of the audio summarization data based on a respective context associated with respective receiving terminals of the one or more receiving terminals; and transmit, using the communication unit, via one or more of the first network and the second network, the respective portions of the audio summarization data to the respective receiving terminals. ### Claim 15 (depends on 14) The portable media streaming device of claim 14, wherein at least two of the one or more receiving terminals have different respective contexts such that at least two of the respective portions are different from one another. ### Claim 16 (depends on 14) The portable media streaming device of claim 14, wherein each of the respective portions are customized according to respective contexts of the respective receiving terminals.