# US 11,115,227 B2 · Terminal and method for bidirectional live sharing and smart monitoring > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,227 B2 - Document ID: US11115227B2 - Status: Granted - Kind: B2 - Application number: 15/321,488 - Filed: 2014-09-15 - Published: 2020-04-30 - Granted: 2021-09-07 - Earliest claimed: 2014-06-26 - Assignees: Ainemo Inc. - Applicants: Ainemo Inc - Inventors: Chenfeng Song - Web page: https://patentgrep.com/patent/US11115227B2 ## CPC - H04L 12/1831: {Tracking arrangements for later retrieval, e.g. recording contents, participants activities or behavior, network status} - H04N 7/15: Conference systems - G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units} - G09G 5/10: Intensity circuits - H04L 12/1822: {Conducting the conference, e.g. admission, detection, selection or grouping of participants, correlating users to one or more conference sessions, prioritising transmission} - H04M 3/567: {Multimedia conference systems} - H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)} - H04N 7/152: {Multipoint control units therefor} - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - G09G 2320/0626: for control of overall brightness - G09G 2370/20: Details of the management of multiple sources of image data - H04N 7/155: {involving storage of or access to video conference sessions (tracking arrangements for later retrieval of a computer conference content or participants activities H04L12/1831)} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) ## Abstract Provided is a terminal and method for bidirectional live sharing and smart monitoring. In some embodiments, the terminal comprises: a video capture unit, an audio capture unit, a display, a speaker and a transceiver. The video capture unit captures video in real time and the audio capture unit captures audio in real time. The transceiver identifies whether a person or a specific person, a specific action, or an abnormal condition exists in the video and the audio respectively captured by the video capture unit and the audio capture unit, and transmits a first notification information when identifvina the person or the specific person, the specific action, or the abnormal condition from the video and audio. ## Claims ### Claim 1 A terminal for bi-directional live sharing and smart monitoring, comprising: a video capture unit, an audio capture unit, a display, a speaker and a transceiver; wherein the transceiver is configured to transmit a video and an audio respectively captured by the video capture unit and the audio capture unit in real time to a specific address via a dedicated channel and receive a video and an audio from the specific address in real time through the dedicated channel, then output respectively through the display and the speaker; the transceiver is configured to: in response to receiving the video and the audio from the specific address, identify whether a person or a specific person, a specific action, or an abnormal condition exists in the video and the audio respectively captured by the video capture unit and the audio capture unit; and in response to identifying the person or the specific person, the specific action, or the abnormal condition from the video and audio respectively captured by the video capture unit and the audio capture unit, send a first notification information to the specific address in real time; wherein the dedicated channel is established in advance, and at each time when the transceiver sends the video and audio in real time to the specific address or receives the video and audio from the specific address, there is no need to re-establish a call, and the terminal is used for a trusted fixed place: and wherein the transceiver is further configured to receive, from the specific address, a second notification information indicating that the person, the specific person, the specific action or the abnormal condition is identified by a terminal at the specific address. ### Claim 2 (depends on 1) The terminal according to claim 1, further comprising a recorder configured to start recording the video and audio in response to identifying the person or the specific person, the specific action, or the abnormal condition from the captured video and audio, and stop recording in response to the person or the specific person, or the specific action, or the abnormal condition disappears, wherein the transceiver is configured to transmit a recorded content to the specific address when the recording is stopped. ### Claim 3 (depends on 1) The terminal according to claim 1, wherein the terminal at the specific address is bound with a specific mobile terminal, wherein the transceiver is further configured to: in response to identifying the person or the specific person, or the specific action, or the abnormal condition from the captured video and audio, send the first notification information to the specific mobile terminal bound with the terminal at the specific address, and/or send the video and audio captured by the video capture unit and the audio capture unit in real time to the specific mobile terminal bound with the terminal at the specific address. ### Claim 4 (depends on 1) The terminal according to claim 1, wherein the first notification information includes at least one of the following: information for requesting the terminal at the specific address enhances the display brightness of the video collected by the video capture unit; information for requesting the terminal at the specific address enhances the brightness of the identified person or specific person or the specific action or abnormal condition; information for requesting the terminal at the specific address superimposes a specific text or picture on the display; information for requesting the terminal at the specific address outputs a specific sound; and information for requesting the terminal at the specific address automatically records the video and the audio including the identified person or specific person or the specific action or abnormal condition respectively collected by the video capture unit and the audio capture unit sent by the transceiver. ### Claim 5 (depends on 1) The terminal according to claim 1, wherein in response to receiving the second notification information, the terminal is configured to perform at least one of the following: enhancing the brightness of displayed video received by the display; enhancing the brightness of the person or the specific person or the specific action or the abnormal condition identified by the terminal at the specific address; superimposing a specific text or picture on the display; the speaker outputting a specific sound; and automatically recording the video and the audio including the identified person or specific person or the specific action or abnormal condition received by the transceiver in real-time. ### Claim 6 (depends on 1) The terminal of claim 1, wherein the transceiver is configured to sends a message to the specific address in response to the specific action being recognized as a departure from home. ### Claim 7 (depends on 6) The terminal according to claim 6, wherein the terminal at the specific address is bound with a specific mobile terminal, and the transceiver is configured to: in response to the specific action identified being that the specific person leaves home, send a text message and/or a voice message set by the specific person to the specific mobile terminal bound with the terminal at the specific address. ### Claim 8 (depends on 1) The terminal according to claim 1, wherein the terminal is bound with a user's mobile terminal, and the transceiver is configured to: in response to the transceiver receiving a text and/or voice message, identify whether the person or the specific person exists in the video and audio respectively collected from the video capture unit and the audio capture unit; in response to not identifying the person or the specific person from video or audio captured by the video capture unit or the audio capture unit, forwarding the received text and/or voice message to the user's mobile terminal bound with the terminal. ### Claim 9 (depends on 1) The terminal according to claim 1, wherein the specific address is a plurality of specific addresses. ### Claim 10 (depends on 9) The terminal according to claim 9, wherein the dedicated channel is a set of dedicated channels formed by server transfer between the terminal and the plurality of specific addresses. ### Claim 11 (depends on 1) The terminal of claim 1, wherein the abnormal conditions are identified by identifying one or more of: audio captured by the audio capture unit above a certain threshold; and a predetermined event identified based on the video and audio respectively captured by the video capture unit and the audio capture unit, wherein a model of the predetermined event has been established in advance and a predetermined event is identified by searching for an event matched with an established model from video and audio respectively acquired based on the video capture unit and the audio capture unit. ### Claim 12 A method for bi-directional live sharing and smart monitoring comprising: transmitting a collected video and audio to a specific address in real time through a dedicated channel and receiving a video and audio from the specific address in real time over the dedicated channel; in response to receiving the video and the audio from the specific address, identify whether a person or a specific person, a specific action, or an abnormal condition exists in the collected video and audio video; and in response to identifying the person or the specific person, or the specific action, or the abnormal condition from the collected video and audio, sending a first notification information to the specific address in real time, wherein the dedicated channel is established in advance, and at each time when sending the video and audio in real time to the specific address or receiving the video and audio from the specific address, there is no need to re-establish a call; and the method further comprises: receiving from the specific address, a second notification information indicating that the person, the specific person, the specific action or the abnormal condition is identified by a terminal at the specific address. ### Claim 13 (depends on 12) The method of claim 12, further comprising: starting recording the video and audio in response to identifying the person or the specific person, or the specific action, or the abnormal condition from the collected video and audio; stopping the recording in response to the person or the specific person, or the specific action, or the abnormal condition disappearing; and sending a recorded content to the specific address in response to stopping the recording. ### Claim 14 (depends on 12) The method according to claim 12, wherein the terminal at the specific address is bound with a specific mobile terminal, and the method further comprises: in response to identifying the person or the specific person, or the specific action, or the abnormal condition from the collected video and audio, sending the first notification information to the specific mobile terminal bound with the terminal at the specific address, and/or sending the collected video and audio in real time to the specific mobile terminal bound with the terminal at the specific address. ### Claim 15 (depends on 12) The method of claim 12, wherein the first notification information includes at least one of: information for requesting the terminal at the specific address enhances the display brightness of the collected video; information for requesting the terminal at the specific address enhances the brightness of the identified person or specific person or the specific action or abnormal condition; information for requesting the terminal at the specific address superimposes a specific text or picture on the display; information for requesting the terminal at the specific address outputs a specific sound; and information for requesting the terminal at the specific address automatically records the video and the audio including the identified person or specific person or the specific action or abnormal condition sent to the specific address. ### Claim 16 (depends on 12) The method of claim 12, further comprising: in response to receiving the second notification information, performing at least one of the following: enhancing the brightness of displayed video; enhancing the brightness of the person or the specific person or the specific action or the abnormal condition identified by the terminal at the specific address; superimposing a specific text or picture on the display; outputting a specific sound; and automatically recording the received video and audio including the identified person or specific person or the specific action or abnormal condition. ### Claim 17 (depends on 12) The method of claim 12, further comprising transmitting a message set by the specific person to the specific address in response to the specific action identified being that the specific person leaves the home. ### Claim 18 (depends on 17) The method according to claim 17, wherein the message set by the specific person is a text message and/or a voice message, wherein the text message is input by the specific person on an interface of the display, the voice message is recorded by the specific person through an audio capture unit.