# US 2021/0241013 A1 · Spoof detection by estimating subject motion from captured image frames > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0241013 A1 - Document ID: US20210241013A1 - Status: Published application - Kind: A1 - Application number: 17/234,350 - Filed: 2021-04-19 - Published: 2021-08-05 - Earliest claimed: 2019-06-21 - Assignees: Advanced New Technologies Co., Ltd. - Applicants: Advanced New Technologies Co., Ltd. - Inventors: Gregory Lee Storm; Reza R. Derakhshani - Web page: https://patentgrep.com/patent/US20210241013A1 ## CPC - G06V 40/45: {Detection of the body part being alive} - H04M 1/72454: according to context-related or environment-related conditions - G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments - G06T 7/73: using feature-based methods - G06V 40/167: {using comparisons between temporally consecutive images} - G06V 40/169: {Holistic features and representations, i.e. based on the facial image taken as a whole} - G06T 2207/10016: Video; Image sequence - G06T 2207/30196: Human being; Person - H04M 1/724631: {by limiting the access to the user interface, e.g. locking a touch-screen or a keypad} - H04M 2250/52: including functional features of a camera - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A method includes receiving a first image and a second image, wherein the first and second images represent first and second relative locations, respectively, of an image acquisition device with respect to a subject. The method also includes determining, using the first and second images, a total relative displacement of the subject with respect to the image acquisition device between a time of capture of the first image and a time of capture of the second image, and determining, based on sensor data associated with one or more sensors associated with the image acquisition device, a component of the total relative displacement associated with a motion of the image acquisition device. The method also includes determining, based on a difference between the first total relative displacement and the component, that the first subject is an alternative representation of a live person, and in response, preventing access to a secure system. ## Claims ### Claim at position 1 -18. (canceled) ### Claim 19 A method comprising: receiving, at one or more processing devices, a first image and a second image, wherein the first image represents a first relative location of an image acquisition device with respect to a first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject; determining, by the one or more processing devices and using the first image and the second image, a first total relative displacement of the first subject with respect to the image acquisition device between a time of capture of the first image and a time of capture of the second image; determining, based on sensor data associated with one or more sensors associated with the image acquisition device, motion information associated with the image acquisition device; determining, based on (i) the first total relative displacement and (ii) the motion information associated with the image acquisition device, a motion of the first subject; in response to determining that the motion of the first subject is below a threshold, determining that the first subject is an alternative representation of a live person; and responsive to determining that the first subject is an alternative representation of a live person, preventing access to a system. ### Claim 20 (depends on 19) The method of claim 19, wherein the image acquisition device is a camera disposed on a mobile device, and the first and second images is a part of a sequence of images captured as the mobile device is moved relative to the first subject. ### Claim 21 (depends on 19) The method of claim 19, wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device. ### Claim 22 (depends on 19) The method of claim 19, wherein determining the first total relative displacement comprises: identifying multiple points of interest in the first image; identifying, in the second image, points corresponding to each of the multiple points of interest; determining displacement of the multiple points of interest from the first image to the second image with respect to a reference point; and determining the first total relative displacement of the first subject based on the displacement of the multiple points of interest using (i) an estimated distance between the image acquisition device and the first subject, and (ii) one or more parameters of the image acquisition device. ### Claim 23 (depends on 22) The method of claim 22, further comprising determining a fundamental matrix indicative of a difference between orientations of the image acquisition device at the times of capture of the first image and second image, respectively. ### Claim 24 (depends on 19) The method of claim 19, further comprising: receiving, at the one or more processing devices, a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies; selecting, by the one or more processing devices, a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject; determining, by the one or more processing devices and using the third image and the fourth image, a second total relative displacement of the second subject with respect to the image acquisition device between a time of capture of the third image and a time of capture of the fourth image; determining, based on second sensor data associated with the one or more sensors associated with the image acquisition device, a component of the second total relative displacement associated with a motion of the image acquisition device; calculating a difference between the second total relative displacement and the component of the second total relative displacement associated with the motion of the image acquisition device; in response to determining that the calculated difference between the second total relative displacement and the component of the second total relative displacement associated with the second motion of the image acquisition device is above a threshold difference, determining that the second subject is a live person; and responsive to determining that the second subject is a live person, initiating an authentication process for determining if the live person is authorized to access the system. ### Claim 25 (depends on 19) The method of claim 19, wherein the motion information comprises a component of the first total relative displacement associated with a motion of the image acquisition device. ### Claim 26 (depends on 25) The method of claim 25, further comprising: calculating a difference between the first total relative displacement and the component of the first total relative displacement associated with the motion of the image acquisition device, wherein determining that the first subject is the alternative representation of the live person is in response to determining that the calculated difference between the first total relative displacement and the component of the first total relative displacement associated with the motion of the image acquisition device is below a threshold value. ### Claim 27 A system comprising: an image acquisition device that captures a first sequence of images of a first subject over a time period in which relative locations of the image acquisition device with respect to the first subject varies; and an image analysis engine comprising one or more processing devices, the image analysis engine configured to: receive the first sequence of images, select a first image and a second image from the first sequence of images, wherein the first image represents a first relative location of the image acquisition device with respect to the first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject, determine, using the first image and the second image, a first total relative displacement of the first subject with respect to the image acquisition device between a time of capture of the first image and a time of capture of the second image, determine, based on sensor data associated with one or more sensors associated with the image acquisition device, motion information associated with the image acquisition device, determining, based on (i) the first total relative displacement and (ii) the motion information associated with the image acquisition device, a motion of the first subject, in response to determining that the motion of the first subject is below a threshold, determine that the first subject is an alternative representation of a live person, and responsive to determining that the first subject is an alternative representation of a live person, prevent access to a system. ### Claim 28 (depends on 27) The system of claim 27, wherein the image acquisition device comprises a camera disposed on a mobile device, and the first sequence of images are captured as the mobile device is moved relative to the first subject. ### Claim 29 (depends on 28) The system of claim 28, wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device. ### Claim 30 (depends on 27) The system of claim 27, wherein determining the first total relative displacement comprises: identifying multiple points of interest in the first image; identifying, in the second image, points corresponding to each of the multiple points of interest; determining displacement of the multiple points of interest from the first image to the second image with respect to a reference point; and determining the first total relative displacement of the first subject based on the displacement of the multiple points of interest using (i) an estimated distance between the image acquisition device and the first subject, and (ii) one or more parameters of the image acquisition device. ### Claim 31 (depends on 30) The system of claim 30, wherein the image analysis engine determines a fundamental matrix indicative of a difference between orientations of the image acquisition device at the times of capture of the first image and second image, respectively. ### Claim 32 (depends on 27) The system of claim 27, wherein the image analysis engine: receives a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies; selects a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject; determines, using the third image and the fourth image, a second total relative displacement of the second subject with respect to the image acquisition device between a time of capture of the third image and a time of capture of the fourth image; determines, based on second sensor data associated with the one or more sensors associated with the image acquisition device, a component of the second total relative displacement associated with a second motion of the image acquisition device; calculate a difference between the second total relative displacement and the component of the second total relative displacement associated with the second motion of the image acquisition device; in response to determining that the calculated difference between the second total relative displacement and the component of the second total relative displacement associated with the second motion of the image acquisition device is above a threshold difference, determines that the second subject is a live person; and responsive to determining that the second subject is a live person, initiates an authentication process for determining if the live person is authorized to access the secure system. ### Claim 33 One or more non-transitory machine-readable storage devices having encoded thereon computer readable instructions for causing one or more processing devices to perform operations comprising: obtaining a first sequence of images of a first subject captured by an image acquisition device over a time period in which relative locations of the image acquisition device with respect to the first subject varies; selecting a first image and a second image from the first sequence of images, wherein the first image represents a first relative location of the image acquisition device with respect to the first subject, and the second image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the first subject; determining, using the first image and the second image, a first total relative displacement of the first subject with respect to the image acquisition device between a time of capture of the first image and a time of capture of the second image; determining, based on sensor data associated with one or more sensors associated with the image acquisition device, motion information associated with the image acquisition device; determining, based on (i) the first total relative displacement and (ii) the motion information associated with the image acquisition device, a motion of the first subject; in response to determining that the motion of the first subject is below a threshold, determining that the first subject is an alternative representation of a live person; and responsive to determining that the first subject is an alternative representation of a live person, preventing access to a system. ### Claim 34 (depends on 33) The one or more non-transitory machine-readable storage devices of claim 33, wherein the image acquisition device is a camera disposed on a mobile device, and the first sequence of images are captured as the mobile device is moved relative to the first subject. ### Claim 35 (depends on 33) The one or more non-transitory machine-readable storage devices of claim 33, wherein the alternative representation of the live person comprises a photograph of the live person printed on paper, or presented on a display device. ### Claim 36 (depends on 33) The one or more non-transitory machine-readable storage devices of claim 33, wherein determining the first total relative displacement comprises: identifying multiple points of interest in the first image; identifying, in the second image, points corresponding to each of the multiple points of interest; determining displacement of the multiple points of interest from the first image to the second image with respect to a reference point; and determining the first total relative displacement of the first subject based on the displacement of the multiple points of interest using (i) an estimated distance between the image acquisition device and the first subject, and (ii) one or more parameters of the image acquisition device. ### Claim 37 (depends on 36) The one or more non-transitory machine-readable storage devices of claim 36, further comprising determining a fundamental matrix indicative of a difference between orientations of the image acquisition device at the times of capture of the first image and second image, respectively. ### Claim 38 (depends on 33) The one or more non-transitory machine-readable storage devices of claim 33, having encoded thereon instructions for performing operations comprising: obtaining a second sequence of images of a second subject captured by the image acquisition device over a time period in which relative locations of the image acquisition device with respect to the second subject varies; selecting a third image and a fourth image from the second sequence of images, wherein the third image represents a first relative location of the image acquisition device with respect to the second subject, and the fourth image represents a second relative location, different from the first relative location, of the image acquisition device with respect to the second subject; determining, using the third image and the fourth image, a second total relative displacement of the second subject with respect to the image acquisition device between a time of capture of the third image and a time of capture of the fourth image determining, based on second sensor data associated with the one or more sensors associated with the image acquisition device, a component of the second total relative displacement associated with a second motion of the image acquisition device; calculating a difference between the second total relative displacement and the component of the second total relative displacement associated with the second motion of the image acquisition device; in response to determining that the calculated difference between the second total relative displacement and the component of the second total relative displacement associated with the second motion of the image acquisition device is above a threshold difference, determining that the second subject is a live person; and responsive to determining that the second subject is a live person, initiating an authentication process for determining if the live person is authorized to access the secure system.