System and method of book leaf tracking
AssigneeSony Computer Entertainment Europe Limited
InventorsThomas Lucas-Woodley, Nicholas Andrew Lord, William Oliver Sykes, Adrien Bain
Life of this patent
Estimating the term…
Abstract
A method of book leaf tracking comprises receiving a video image comprising a book, estimating the current position and orientation of the book within the video image in response to a fiduciary marker of the book visible in the image, estimating the visibility of one or more predetermined features of the book, calculating a range of leaf turning angles that is consistent with the detected visibility of the or each predetermined feature of the book for the estimated current position and orientation of the book, and estimating the angle of a turning leaf of the book responsive to the calculated range.
Claims16
A method of book leaf tracking, comprising:
- receiving a video image comprising a book;
- estimating a current position and orientation of the book within the video image in response to a fiduciary marker of the book visible in the video image;
- estimating a position and orientation of one or more predetermined markings of the book within the video image in response to the estimated current position and orientation of the book and based on a known physical relationship between the one or more predetermined markings and a leaf of the book;
- detecting visibility of the one or more predetermined markings of the book at each respective estimated position and orientation thereof;
- calculating a range of hypothetical leaf turning angles that is constrained in accordance with the estimated visibility of at least one of the predetermined markings of the book at the estimated position and orientation of the at least one predetermined marking for the estimated current position and orientation of the book;
- and
- estimating an angle of a turning leaf of the book responsive to the calculated range.
A non-transitory computer program product comprising computer program instructions that when performed by a processor implement a method comprising the steps of:
- receiving a video image comprising a book;
- estimating a current position and orientation of the book within the video image in response to a fiduciary marker of the book visible in the video image;
- estimating a position and orientation of one or more predetermined markings of the book within the video image in response to the estimated current position and orientation of the book and based on a known physical relationship between the one or more predetermined markings and a leaf of the book;
- detecting visibility of the one or more predetermined markings of the book at each respective estimated position and orientation thereof;
- calculating a range of hypothetical leaf turning angles that is constrained in accordance with the estimated markings of at least one of the predetermined features of the book at the estimated position and orientation of the at least one predetermined marking for the estimated current position and orientation of the book;
- and
- estimating an angle of a turning leaf of the book responsive to the calculated range.
An entertainment device, comprising:
- a video input operable to receive a video image comprising a book;
- a processor configured to estimate a current position and orientation of the book within the video image in response to a fiduciary marker of the book visible in the video image;
- a processor configured to estimate a position and orientation of one or more predetermined markings of the book within the video image in response to the estimated current position and orientation of the book and based on a known physical relationship between the one or more predetermined markings and a leaf of the book;
- a processor configured to detect visibility of the one or more predetermined markings of the book at each respective estimated position and orientation thereof;
- a processor configured to calculate a range of hypothetical leaf turning angles that is constrained in accordance with the estimated visibility of at least one of the predetermined markings of the book at the estimated position and orientation of the at least one predetermined marking for the estimated current position and orientation of the book;
- and
- a processor configured to estimate an angle of a turning leaf of the book responsive to the calculated range.
Dependencies are inferred from the claim text.