Back to results
US 10,593,184 B2Granted
Baby monitoring with intelligent audio cueing based on an analyzed video stream
AssigneeGoogle Inc.
InventorsWilliam Greene, Michael Dixon
Life of this patent
Estimating the term…
Abstract
Various arrangements are presented for issuing an alert based on a baby's behavior. A video stream that images a baby may be received. The video stream may be analyzed to determine the baby is in a non-auditory discomfort state. A notification may be determined to be output to a caregiver based on the determined non-auditory discomfort state. An alert may be output that is indicative of the non-auditory discomfort state to an end-user device.
Claims17
A method for issuing alerts based on baby behavior, the method comprising:
- receiving, by a cloud-based baby monitoring system, via the Internet, a video stream and an audio stream, wherein:
- the video stream and the audio stream is linked with a user account;
- and
- a baby is present within frames of the video stream;
- determining, by the cloud-based baby monitoring system, that less than a threshold amount of sound is present within the audio stream;
- in response to determining that less than the threshold amount of sound is present within the audio stream, analyzing, by the cloud-based baby monitoring system, the video stream to determine the baby is in a non-auditory discomfort state, wherein analyzing the video steam comprises:
- performing motion detection of the baby within the frames of the video stream to determine an amount of motion of the baby;
- and
- determining that the baby is in the non-auditory discomfort state based on the amount of motion of the baby exceeding a movement threshold;
- determining, by the cloud-based baby monitoring system, to output a notification to a caregiver based on the determined non-auditory discomfort state;
- and
- transmitting, by the cloud-based baby monitoring system, an alert indicative of the non-auditory discomfort state to an end-user device that is linked with the user account.
9 more elements
A system for issuing an alert based on a baby's behavior, comprising:
- a cloud-based host system, comprising:
- a storage arrangement that receives and stores video and audio streams from a plurality of streaming video cameras;
- and
- a baby monitoring system, comprising:
- one or more processors;
- and
- a memory communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions which, when executed by the one or more processors, cause the one or more processors to:
- receive a video stream and an audio stream, wherein:
- a baby is present within frames of the video stream;
- and
- the video stream and the audio stream is linked with a user account;
- determine that less than a threshold amount of sound is present within the audio stream;
- in response to determining that less than the threshold amount of sound is present within the audio stream, analyze the video stream and the audio stream to determine the baby is in a non-auditory discomfort state, wherein analyzing the video stream comprises:
- performing motion detection of the baby within the frames of the video stream to determine an amount of motion of the baby;
- and
- determining that the baby is in the non-auditory discomfort state based on the amount of motion of the baby exceeding a movement threshold;
- determine to output a notification to a caregiver based on the determined non-auditory discomfort state;
- and
- transmit an alert indicative of the non-auditory discomfort state to an end-user device that is linked with the user account.
16 more elements
A baby monitoring system for issuing an alert based on a baby's behavior, the baby monitoring system comprising:
- a cloud-based host system, comprising:
- a storage arrangement that receives and stores video and audio streams from a plurality of streaming video cameras;
- and
- a streaming video camera comprising an integrated baby monitoring system, comprising:
- one or more processors;
- and
- a memory communicatively coupled with and readable by the one or more processors and having stored therein processor-readable instructions which, when executed by the one or more processors, cause the one or more processors to:
- receive a video stream and an audio stream, wherein:
- the video stream and the audio stream is linked with a user account;
- and
- a baby is present within frames of the video stream;
- determine that less than a threshold amount of sound is present within the audio stream;
- in response to determining that less than the threshold amount of sound is present within the audio stream, analyze the video stream and the audio stream to determine the baby is in a non-auditory discomfort state, wherein analyzing the video steam comprises:
- performing motion detection of the baby within the frames of the video stream to determine an amount of motion of the baby;
- and
- determining that the baby is in the non-auditory discomfort state based on the amount of motion of the baby exceeding a movement threshold;
- determine to output a notification to a caregiver based on the determined non-auditory discomfort state;
- and
- transmit an alert indicative of the non-auditory discomfort state to an end-user device that is linked with the user account.
16 more elements
Dependencies are inferred from the claim text.