# US 11,451,750 B2 · Event generation based on user feedback by doorbell camera system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,451,750 B2 - Document ID: US11451750B2 - Status: Granted - Kind: B2 - Application number: 17/155,189 - Filed: 2021-01-22 - Published: 2021-07-22 - Granted: 2022-09-20 - Earliest claimed: 2020-01-22 - Assignees: Hanwha Techwin Co., Ltd. - Applicants: Hanwha Techwin Co., Ltd. - Inventors: Myung-hwa Son; Jongho Kim; Brian Sung - Web page: https://patentgrep.com/patent/US11451750B2 ## CPC - H04N 7/186: {Video door telephones} - G06N 3/04: Architecture, e.g. interconnection topology - G06N 3/0442: characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU] - G06N 3/09: Supervised learning - G06V 10/764: using classification, e.g. of video objects - G06V 10/774: Generating sets of training patterns; Bootstrap methods, e.g. bagging or boosting - G06V 10/7784: {based on feedback from supervisors} - G06V 10/7788: {the supervisor being a human, e.g. interactive learning with a human teacher} - G06V 10/82: using neural networks - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/174: {Facial expression recognition} - G06N 3/044: Recurrent networks, e.g. Hopfield networks - G06N 3/045: Combinations of networks - G06N 3/084: Backpropagation, e.g. using gradient descent - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A method for generating an event, which is performed by a doorbell camera system disclosed in the present disclosure may include acquiring video of a visitor, outputting the acquired video of the visitor to a user, learning the user's feedback on the visitor, storing information of the visitor and a learning result of the user's feedback on the visitor, and generating an event based on the information of the visitor and the learning result of the user's feedback. ## Claims ### Claim 1 A doorbell device for generating an event for a visitor at a doorbell camera system, comprising: a transceiver configured to transceive a wireless signal through an antenna; and a processor functionally connected to the transceiver and configured to: receive first input data related to the visitor including at least one of video or audio of the visitor; transmit the first input data to a user terminal and receive second input data related to a user's feedback on the first input data from the user terminal; learn the first input data based on at least one first learning algorithm to generate first output data related to the event, and learn the second input data based on at least one second learning algorithm to generate second output data related to the event; and determine a danger level for the visitor based on at least one of the first output data or the second output data, and generate the event based on the danger level, wherein the second output data comprises facial expression information of the user, and wherein the facial expression information of the user is generated as JSON data obtained by data-converting a human facial expression into numbers and alphabets. ### Claim 2 (depends on 1) The doorbell device of claim 1, wherein the first output data comprises at least one of face information, body feature information, clothing information, and belongings information, of the visitor. ### Claim 3 (depends on 2) The doorbell device of claim 2, wherein in the face information of the visitor, a face region of the visitor is detected from the first input data based on a deep neural network (DNN) algorithm, and a face of the visitor is recognized from the detected face region based on a Res Net algorithm. ### Claim 4 (depends on 2) The doorbell device of claim 2, wherein the body feature information of the visitor is learned based on at least one of a Mel frequency cepstral coefficient (MFCC) algorithm, a linear predictive coding (LPC) algorithm, or a long short-term memory (LSTM) algorithm. ### Claim 5 (depends on 2) The doorbell device of claim 2, wherein the belongings information of the visitor is learned based on a you-only-look-once (Yolo) algorithm. ### Claim 6 (depends on 1) The doorbell device of claim 1, wherein the danger level is low, medium, or high. ### Claim 7 (depends on 1) The doorbell device of claim 1, wherein the event is doorbell ignore, door unlock, emergency call connection, or non-face-to-face payment module activation. ### Claim 8 A doorbell device for generating an event for a visitor at a doorbell camera system, comprising: a transceiver configured to transceive a wireless signal through an antenna; and a processor functionally connected to the transceiver and configured to: receive first input data related to the visitor including at least one of video or audio of the visitor; learn the first input data based on at least one first learning algorithm to generate first output data related to the event, and learn second input data based on at least one second learning algorithm to generate second output data related to the event; perform an initial access procedure with a server for downlink synchronization and reception of system information, and perform a random access procedure with the server for uplink synchronization, wherein the initial access procedure is performed by a synchronization signal block including a first synchronization signal, a second synchronization signal, and a broadcast channel, wherein the synchronization signal block includes four consecutive OFDM symbols, and the first synchronization signal, the broadcast channel, and the second synchronization signal are transmitted for each OFDM symbol, wherein each of the first synchronization signal and the second synchronization signal includes one OFDM symbol and 127 subcarriers, and wherein the broadcast channel includes three OFDM symbols and 576 subcarriers; receive an uplink grant from the server, transmit the first input data to the user terminal based on the uplink grant, receive a downlink grant from the server, and receive the second input data related to the user's feedback on the first input data from the user terminal based on the downlink grant; and generate the event based on the first output data or the second output data. ### Claim 9 (depends on 8) The doorbell device of claim 8, wherein the first output data comprises at least one of face information, body feature information, clothing information, and belongings information, of the visitor. ### Claim 10 (depends on 8) The doorbell device of claim 8, wherein the second output data comprises at least one of facial expression information, voice information, and behavior information of the user. ### Claim 11 (depends on 9) The doorbell device of claim 9, wherein the processor is configured to perform the random access procedure by transmitting a random access preamble sequence to the server and receiving a random access response message from the server. ### Claim 12 (depends on 11) The doorbell device of claim 11, wherein the random access preamble sequence comprises a long sequence and a short sequence having different lengths, and the length of the long sequence is 839, and the length of the short sequence is 139. ### Claim 13 A doorbell device for generating an event for a visitor at a doorbell camera system, comprising: a transceiver configured to transceive a wireless signal through an antenna; and a processor functionally connected to the transceiver and configured to: receive first input data related to the visitor including at least one of video or audio of the visitor; learn the first input data based on at least one first learning algorithm to generate first output data related to the event, and learn second input data based on at least one second learning algorithm to generate second output data related to the event; perform an initial access procedure with a server for downlink synchronization and reception of system information, and perform a random access procedure with the server for uplink synchronization, wherein the initial access procedure is performed by a synchronization signal block including a first synchronization signal, a second synchronization signal, and a broadcast channel, wherein the synchronization signal block includes four consecutive OFDM symbols, and the first synchronization signal, the broadcast channel, and the second synchronization signal are transmitted for each OFDM symbol, wherein each of the first synchronization signal and the second synchronization signal includes one OFDM symbol and 127 subcarriers, and wherein the broadcast channel includes three OFDM symbols and 576 subcarriers; transmit the first input data to a user terminal, receive second input data related to a user's feedback on the first input data from the user terminal, receive an uplink grant and a downlink grant from the server, transmit the first output data and the second output data to the server based on the uplink grant, and receive danger level information indicating a danger level for the visitor from the server based on the downlink grant; and generate the event based on the danger level. ### Claim 14 (depends on 13) The doorbell device of claim 13, wherein the first output data comprises at least one of face information, body feature information, clothing information, and belongings information, of the visitor. ### Claim 15 (depends on 13) The doorbell device of claim 13, wherein the second output data comprises at least one of facial expression information, voice information, and behavior information of the user. ### Claim 16 (depends on 13) The doorbell device of claim 13, wherein the danger level is low, medium, or high, and the event is doorbell ignore, door unlock, emergency call connection, or non-face-to-face payment module activation.