# US 10,872,231 B2 · Systems and methods of activity based recording for camera applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,231 B2 - Document ID: US10872231B2 - Status: Granted - Kind: B2 - Application number: 16/175,726 - Filed: 2018-10-30 - Published: 2019-05-09 - Granted: 2020-12-22 - Earliest claimed: 2017-11-07 - Assignees: Ooma, Inc. - Applicants: Ooma, Inc. - Inventors: Govind Vaidya; Behnam Nader; Shaival Shah - Web page: https://patentgrep.com/patent/US10872231B2 ## CPC - G06V 40/172: {Classification, e.g. identification} - G06V 20/41: {Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49)} - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/168: {Feature extraction; Face representation} - G08B 13/19695: {Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves} - G10L 25/51: for comparison or discrimination - G11B 27/036: Insert-editing - H04N 5/77: between a recording apparatus and a television camera - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 5/91: Television signal processing therefor - H04N 7/183: {for receiving images from a single remote source} - H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)} - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - H04N 23/65: Control of camera operation in relation to power supply - H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes - H04R 1/04: Structural association of microphone with electric circuitry therefor (in electric hearing aids H04R25/00) - H04R 1/326: {for microphones (H04R1/34 and H04R1/40 take precedence)} - G06V 20/52: Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) - G06V 40/16: Human faces, e.g. facial parts, sketches or expressions - G08B 13/19671: {Addition of non-video data, i.e. metadata, to video stream} - H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K) ## Abstract Systems and methods for activity based recording by a smart camera system are described herein. Activity based recording provides a smart and automated method to enable and disable the camera recording, such that potentially significant events or activities are detected and recorded. A camera located in a physical space detects a triggering event and begins recording video and/or audio for a predetermined time period, resulting in a captured video. The triggering event may be detected by one or more sensors associated with the camera, including but not limited to, a camera sensor, a passive infrared sensor, and a microphone. A metadata file is added to the captured video. Certain video frames are added to the beginning of the captured video, resulting in a finalized video recording. The finalized video recording is transmitted and presented to a user computing device. ## Claims ### Claim 1 A system for activity based recording via a camera system, the system comprising: a camera comprising: a lens; a camera sensor; a passive infrared (PIR) sensor; a microphone; and a first processor and a first memory, configured to: cause the camera to enter a low power mode; detect a triggering event in a physical space around the camera based upon first data received from one or more of the PIR sensor and the microphone; cause the camera to enter a capture video mode comprising a variable enabled period based on a detected type of the triggering event, the variable enabled period comprising a predetermined period for the camera to remain in the capture video mode for the detected type of triggering event, the type of triggering event detected being one from a plurality of types of triggering events; record video in response to detecting the triggering event, resulting in a captured video; store at least some of the video frames of the captured video in a buffer; detect another triggering event in the physical space around the camera based upon second data received from the camera sensor; record another video for a predetermined time period, in response to detecting the another triggering event, resulting in another captured video; and transmit the at least some of the video frames and the another captured video with a metadata file associated with the another captured video to a video analysis system, the metadata file including at least some of the second data; and the video analysis system comprising: a second processor and a second memory, the second processor configured to: receive the at least some of the video frames, the another captured video, and the metadata file from the camera; examine the another captured video, based on information in the metadata file; add the at least some of the video frames to the another captured video, resulting in a finalized video recording; and transmit the finalized video recording to a user computing device in communication with the video analysis system. ### Claim 2 (depends on 1) The camera system of claim 1, wherein the another captured video further comprises audio. ### Claim 3 (depends on 1) The camera system of claim 1, wherein the detected triggering event is a loud noise in the physical space around the camera that is detected by the microphone. ### Claim 4 (depends on 1) The camera system of claim 1, wherein the detected triggering event is a movement in the physical space around the camera that is detected by at least one sensor. ### Claim 5 (depends on 1) The camera system of claim 1, further comprising an accelerometer that can detect a triggering event in the physical space around the camera. ### Claim 6 (depends on 1) The camera system of claim 1, wherein the lens is a custom capsule lens positioned in front of the PIR sensor. ### Claim 7 (depends on 1) The camera system of claim 1, wherein the first processor is a specialized video processor. ### Claim 8 (depends on 1) The camera system of claim 1, wherein the video analysis system further comprises a database communicatively coupled to the second processor. ### Claim 9 (depends on 1) The camera system of claim 1, wherein the adding the at least some of the video frames further comprises prepending the at least some of the video frames to a beginning of the another captured video. ### Claim 10 (depends on 1) The camera system of claim 1, wherein the plurality of types of triggering events comprise noise, motion, temperature, smoke, humidity, and gaseous substances detectable in the physical space around the camera system. ### Claim 11 (depends on 1) The camera system of claim 1, wherein the second processor is configured to prepend a plurality of time-stamped historical video frames to the recorded video. ### Claim 12 A method for activity based recording via a camera system, the camera system including a camera, a camera sensor, a passive infrared (PIR) sensor, and a microphone, the method comprising: causing the camera to enter a low power mode; detecting a triggering event in a physical space around the camera based upon first data received from one or more of the PIR sensor and the microphone; causing the camera to enter a capture video mode comprising a variable enabled period based on a detected type of the triggering event, the variable enabled period comprising a predetermined period for the camera to remain in the capture video mode for the detected type of triggering event, the type of triggering event detected being one from a plurality of types of triggering events; recording video in response to detecting the triggering event, resulting in a captured video; storing at least some of the video frames of the captured video in a buffer; detecting another triggering event in the physical space around the camera based upon second data received from the camera sensor; recording another video for a predetermined time period, in response to detecting the another triggering event, resulting in another captured video; transmitting the at least some of the video frames and the another captured video with a metadata file associated with the another captured video to a video analysis system, the metadata file including at least some of the second data; receiving the at least some of the video frames, the another captured video, and the metadata file from the camera; examining the another captured video, based on information in the metadata file; adding the at least some of the video frames to the another captured video, resulting in a finalized video recording; and transmitting the finalized video recording to a user computing device in communication with the camera. ### Claim 13 (depends on 12) The method of claim 12, wherein the detected triggering event is a loud noise in the physical space around the camera that is detected by the microphone. ### Claim 14 (depends on 12) The method of claim 12, wherein the detected triggering event is a movement in the physical space around the camera that is detected by at least one sensor. ### Claim 15 (depends on 12) The method of claim 12, wherein a first processor is a specialized video processor. ### Claim 16 (depends on 12) The method of claim 12, wherein the video analysis system further comprises a database communicatively coupled to a second processor. ### Claim 17 (depends on 12) The method of claim 12, wherein the predetermined time period is less than one minute. ### Claim 18 (depends on 12) The method of claim 12, wherein the camera system further includes a custom capsule lens positioned in front of the PIR sensor. ### Claim 19 (depends on 12) The method of claim 12, wherein the adding the at least some of the video frames further comprises prepending the at least some of the video frames to a beginning of the another captured video. ### Claim 20 (depends on 12) The method of claim 12, wherein the plurality of types of triggering events comprise noise, motion, temperature, smoke, humidity, and gaseous substances detectable in the physical space around the camera system. ### Claim 21 (depends on 12) The method of claim 12, further comprising prepending a plurality of time-stamped historical video frames to the recorded video. ### Claim 22 A system for activity based recording via a camera system, the system comprising: a camera comprising: a lens; a camera sensor; a passive infrared (PIR) sensor; a microphone; and an accelerometer; a first processor and a first memory, configured to: cause the camera to enter a low power mode; detect a triggering event in a physical space around the camera based upon first data received from one or more of the PIR sensor, the microphone, and the accelerometer; cause the camera to enter a capture video mode comprising a variable enabled period based on a detected type of the triggering event, the variable enabled period comprising a predetermined period for the camera to remain in the capture video mode for the detected type of triggering event, the type of triggering event detected being one from a plurality of types of triggering events; record video in response to detecting the triggering event, resulting in a captured video; store at least some of the video frames of the captured video in a buffer; detect another triggering event in the physical space around the camera based upon second data received from the camera sensor; record another video for a predetermined time period, in response to detecting the another triggering event, resulting in another captured video; and transmit the at least some of the video frames and the another captured video with a metadata file associated with the another captured video to a video analysis system, the metadata file including at least some of the second data; and the video analysis system comprising: a second processor and a second memory, the second processor configured to: receive the at least some of the video frames, the another captured video, and the metadata file from the camera; examine the another captured video, based on information in the metadata file; add the at least some of the video frames to the another captured video, resulting in a finalized video recording; and transmit the finalized video recording to a user computing device in communication with the video analysis system.