Image processing apparatus, system, image processing method, and image processing program

A system comprising:

• an image sensor configured to acquire image information;
• one or plural directional microphones configured to acquire sound information that is generated for at least a partial region in a field of the image sensor;
• and
• a terminal apparatus including
• a first reception section configured to receive the image information,
• a second reception section configured to receive the sound information,
• an association processing section configured to associate the sound information with a pixel address of the image information indicating a position in the field,
• an object detection section configured to detect, from the image information, at least a part of an object that is present in the field, and
• a process execution section configured to execute a predetermined process on the object, on a basis of a result of the association performed by the association processing section,
• wherein the predetermined process is a function of whether or not the position in the field at which the sound information is associated overlaps with an area within the field at which the object is located, and
• wherein the process execution section operates to distinguish between determinations that:
• (i) the object appears to be moving and is actually moving in the field based on a determination that the sound information indicates an acoustic level above a predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located;
• and
• (ii) the object appears to be moving and is not actually moving in the field based on a determination that the sound information indicates an acoustic level not above the predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located.

An image processing method comprising:

• receiving image information acquired by an image sensor;
• receiving sound information that is acquired by one or plural directional microphones and that is generated for at least a partial region in a field of the image sensor;
• associating the sound information with a pixel address of the image information indicating a position in the field;
• detecting, from the image information, at least a part of an object that is present in the field;
• and
• executing a predetermined process on the object on a basis of a result of the association,
• wherein the predetermined process is a function of whether or not the position in the field at which the sound information is associated overlaps with an area within the field at which the object is located, and
• wherein the executing includes distinguishing between determinations that:
• (i) the object appears to be moving and is actually moving in the field based on a determination that the sound information indicates an acoustic level above a predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located;
• and
• (ii) the object appears to be moving and is not actually moving in the field based on a determination that the sound information indicates an acoustic level not above the predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located.

A non-transitory, computer readable storage medium containing a program, which when executed by a computer, causes the computer to perform an image processing method by carrying out actions, comprising:

• receiving image information acquired by an image sensor;
• receiving sound information that is acquired by one or plural directional microphones and that is generated for at least a partial region in a field of the image sensor;
• associating the sound information with a pixel address of the image information indicating a position in the field;
• detecting, from the image information, at least a part of an object that is present in the field;
• and
• executing a predetermined process on the object on a basis of a result of the association,
• wherein the predetermined process is a function of whether or not the position in the field at which the sound information is associated overlaps with an area within the field at which the object is located, and
• wherein the executing includes distinguishing between determinations that:
• (i) the object appears to be moving and is actually moving in the field based on a determination that the sound information indicates an acoustic level above a predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located;
• and
• (ii) the object appears to be moving and is not actually moving in the field based on a determination that the sound information indicates an acoustic level not above the predetermined threshold and the position in the field that is associated overlaps with the area within the field at which the object is located.