Systems and methods for remote proctoring
AssigneeIdemia Identity & Security USA LLC
InventorsXiao Gao, Firat Karadag, Kaustubh Deshpande
Life of this patent
Estimating the term…
Abstract
A system and method for supervised remote proctoring includes an administrator device, a client device, a database, and an analysis module. During proctoring, a live video feed is captured from client device and sent to analysis module for processing. Analysis module performs behavioral analysis and object detection on received video footage and images. If an abnormality is detected by analysis module, an alert is generated and sent to administrator device to notify a proctor, and any information relating to the abnormality is sent to the database for storage and future reference.
Claims20
A proctoring system for self-enrollment comprising at least one processor in communication with at least one memory, wherein the at least one processor is configured to:
- receive at least one video feed from at least one camera;
- detect, using a first machine learning component, at least one image abnormality in a frame of the at least one video feed;
- detect, using a second machine learning component, at least one behavioral abnormality in a segment of the video feed;
- and
- transmit an alert to an administrator device upon detecting at least one abnormality.
At least one non-transitory computer-readable storage medium with instructions stored thereon that, in response to execution by at least one processor, cause the at least one processor to:
- receive at least one video feed from at least one camera;
- detect, using a first machine learning component, at least one image abnormality in a frame of the at least one video feed;
- detect, using a second machine learning component, at least one behavioral abnormality in a segment of the video feed;
- and
- transmit an alert to an administrator device upon detecting at least one abnormality.
The at least one non-transitory computer-readable storage medium of 10, wherein the second machine learning component comprises a long-short term memory network, and wherein detecting at least one behavioral abnormality further includes referencing at least one previous segment of the video feed.
The at least one non-transitory computer-readable storage medium of 10, wherein the at least one processor is further configured to train the second machine learning component on at least one training data including one or more example enrollment processes, where the training further includes altering the at least one training data with at least one of:
- downsizing, grayscaling, manual data review, and consecutive frame selection.
The at least one non-transitory computer-readable storage medium of 10, wherein the at least one processor is further configured to:
- store one or more unaddressed alerts into a queue;
- and
- store, using a database, at least one abnormality information about at least one detected abnormality as stored abnormality data.
A method for autonomous proctoring implemented by at least one processor in communication with at least one memory, the method comprising:
- receiving at least one video feed from at least one camera;
- detecting, using a first machine learning component, at least one image abnormality in a frame of the at least one video feed, where the detecting is based on comparing at least one measured value to at least one threshold value;
- detecting, using a second machine learning component, at least one behavioral abnormality in a segment of the video feed;
- and
- transmitting an alert to an administrator device upon detecting at least one abnormality.
Dependencies are inferred from the claim text.