Method for determining a noteworthy sub-sequence of a monitoring image sequence

A monitoring device configured to determine a noteworthy sub-sequence of a monitoring image sequence of a monitoring area of a monitored environment that has been generated by an imaging system, the monitoring device configured to:

• provide an audio signal from the monitoring area, which at least partially corresponds to a time period of the monitoring image sequence;
• provide the monitoring image sequence;
• determine at least one segment of the audio signal from the provided audio signal, which has unusual noises that have one or more audio characteristics predefined as being unusual;
• determine at least one segment of the monitoring image sequence having, within the monitored environment, unusual movements that have one or more image characteristics predefined as being unusual;
• and
• determine a correlation between the at least one segment of the audio signal having the unusual noises and the at least one segment of the monitoring image sequence having the unusual movement to determine the noteworthy sub-sequence of the monitoring image sequence;
• wherein the monitoring device is configured to at least one of:
• (I) determine the at least one noteworthy sub-sequence of the monitoring image sequence by subtracting from the monitoring image sequence at least one sub-sequence in which an expression of the correlation between the at least one segment of the monitoring image sequence having the unusual movements and the at least one segment of the audio signal having the unusual noises below a limit value is determined;
• and
• (II) determine the unusual movements in the monitoring area based on a change in an amount of effort required to compress successive images of the monitoring image sequence.

A non-transitory computer-readable medium on which is stored a computer program including instructions for determining a noteworthy sub-sequence of a monitoring image sequence of a monitoring area of a monitored environment that has been generated by an imaging system, the instructions, when executed by a computer, causing the computer to perform the following steps:

• providing an audio signal from the monitoring area, which at least partially corresponds to a time period of the monitoring image sequence;
• providing the monitoring image sequence;
• determining at least one segment of the audio signal from the provided audio signal, which has unusual noises that have one or more audio characteristics predefined as being unusual;
• determining at least one segment of the monitoring image sequence having, within the monitored environment, unusual movements that have one or more image characteristics predefined as being unusual;
• and
• determining a correlation between the at least one segment of the audio signal having the unusual noises and the at least one segment of the monitoring image sequence having the unusual movement to determine the noteworthy sub-sequence of the monitoring image sequence;
• wherein the non-transitory computer-readable medium includes at least one of the following two features (I)-(II):
• (I) the at least one noteworthy sub-sequence of the monitoring image sequence is determined by subtracting from the monitoring image sequence at least one sub-sequence in which an expression of the correlation between the at least one segment of the monitoring image sequence having the unusual movements and the at least one segment of the audio signal having the unusual noises below a limit value is determined;
• and
• (II) the unusual movements in the monitoring area are determined based on a change in an amount of effort required to compress successive images of the monitoring image sequence.