Augmented reading systems
AssigneeChegg, Inc.
InventorsVincent Le Chevalier, Charles F. Geiger
Life of this patent
Estimating the term…
Abstract
An augmented reading system distributes electronic content related to paper documents. A user reading a paper document captures an image of a page of the paper document via a computing device communicatively coupled to the augmented reading system. The augmented reading system receives the image and correlates the image to electronic documents to identify the paper document. The augmented reading system may perform an image-based comparison or a character-based comparison to correlate the image with electronic documents. Additional electronic content related to the identified document is retrieved and delivered to the computing device of the user. Accordingly, the augmented reading system provides a bridge between paper documents and digital content and services.
Claims21
A method for distributing electronic content related to paper documents, the method comprising:
- receiving at a server, an image of at least a portion of a page of a paper document, the image captured by a device of a user reading the paper document, the device communicatively coupled to the server;
- determining a page layout of the page of the paper document based on the image, the page layout including a spatial arrangement of elements of the paper document with respect to the page;
- correlating the page layout of the page of the paper document with page layouts of a plurality of electronic documents by an image based comparison, each electronic document comprising markup language page elements that collectively reconstruct the electronic document while preserving page layouts of a corresponding paper document, the correlating further comprising:
- using linear discriminant analysis to determine low-dimensional structures of the received image and of the plurality of electronic documents;
- and
- establishing a correlation factor between the received image and each of the plurality of electronic documents, the correlation factor based upon the low-dimensional structures;
- identifying, based on the correlation, one of the electronic documents best matching the page of the paper document;
- retrieving additional electronic content related to the identified document;
- and
- sending the additional electronic content to a connected device of the user for display to the user.
A system for distributing electronic content related to paper documents, the system comprising:
- a correlation system configured for:
- receiving an image of at least a portion of a page of a paper document, the image captured by a device of a user reading the paper document;
- determining a page layout of the page of the paper document based on the image, the page layout including a spatial arrangement of elements of the paper document with respect to the page;
- correlating the page layout of the page of the paper document with page layouts of a plurality of electronic documents by an image based comparison, each electronic document comprising markup language page elements that collectively reconstruct the electronic document while preserving page layouts of a corresponding paper document, the correlating further comprising:
- using linear discriminant analysis to determine low-dimensional structures of the received image and of the plurality of electronic documents;
- and
- establishing a correlation factor between the received image and each of the plurality of electronic documents, the correlation factor based upon the low-dimensional structures;
- identifying, based on the correlation, the page of the paper document;
- retrieving additional electronic content related to the identified document;
- and
- a distribution system configured for sending the additional electronic content to a connected device of the user for display to the user.
A method for distributing electronic content related to paper documents, the method comprising:
- indexing contents of a plurality of electronic documents into sections;
- receiving user-generated notes;
- linking the user-generated notes to corresponding ones of the sections;
- for each of the electronic documents, aggregating the indexed content and sections into a table of contents;
- receiving at a server, an image of at least a portion of a page of a paper document, the image captured by a device of a user reading the paper document, the device communicatively coupled to the server;
- determining a page layout of the page of the paper document based on the image, the page layout including a spatial arrangement of elements of the paper document with respect to the page;
- correlating the page layout of the page of the paper document with page layouts of a plurality of electronic documents by an image based comparison, each electronic document comprising markup language page elements that collectively reconstruct the electronic document while preserving page layouts of a corresponding paper document;
- identifying, based on the correlation, a section of one of the electronic documents best matching the page of the paper document;
- retrieving user-generated notes linked to the section of the electronic document based on the index of the table of contents;
- and
- sending the user-generated notes to a connected device of the user for display to the user.
Dependencies are inferred from the claim text.