Method and system of image processing for action classification

At least one non-transitory machine-readable medium comprising a plurality of instructions that in response to being executed on a computing device, cause the computing device to operate by:

• obtaining image data of frames of a video sequence with content showing at least one person in motion;
• determining action attribute values each as an output of a same neural network receiving input data associated with the image data, wherein different output attribute value combinations indicate different actions or none of the actions;
• and
• determining whether any of the actions are being performed by the at least one person in the content by using the attribute values.

A computer-implemented system comprising:

• at least one memory to store image data of frames of a video sequence with content showing at least one person in motion;
• and
• at least one processor communicatively coupled to the memory and being arranged to operate by:
• determining action attribute values each as an output of a same neural network receiving input data associated with the image data, wherein different output attribute value combinations of different output states indicate different actions or none of the actions, and
• determining whether any of the actions are being performed by the at least one person in the content by using the attribute values.

At least one non-transitory machine-readable medium comprising a plurality of instructions that in response to being executed on a computing device, causes the computing device to operate by:

• obtaining image data of frames of a video sequence with content showing at least one person in motion;
• determining an action prediction initial score of individual frames of the video sequence;
• determining action attribute values each as an output of a same neural network receiving input data associated with the image data, wherein different output attribute value combinations indicate different actions or none of the actions;
• using the action attribute values to determine which frames of the video sequence are relevant frames that indicate an action is occurring;
• and
• providing the initial scores only of the relevant frames to perform further action-related processing.

A method of image processing comprising:

• obtaining image data of frames of a video sequence with content showing at least one person in motion;
• determining an action prediction initial score of individual frames of the video sequence based on image data of a first resolution;
• determining action attribute values each as an output of a same neural network receiving input data associated with a version of the image data in a second resolution different than the first resolution, wherein different output attribute value combinations indicate different actions or none of the actions;
• and
• using the action attribute values to determine which of the frames are relevant to an action and should be provided for further action-related processing.