US 9,311,048 B1Granted

Electronic template generation, data extraction and response detection

AssigneePearson Education, Inc.

InventorsVishal Kapoor, Miles Loring, Cole Cecil, Jesse Peterson, Umamakeswaran Veerasingam, Sanjay Zope

Life of this patent

Estimating the term…

Loading patent…

Abstract

A file receiver receives an electronic structure file that includes structure-file data associated with a spatial arrangement and detects a content object for processing that includes content-object data. A file transformation engine transforms the structure-file data from the structure file into an electronic record. A rendering engine renders an image of the transformed structure-file data arranged in the spatial arrangement. An interface engine detects an input corresponding to specification of a position of a data segment. A parsing engine defines a segment-position specification indicative of the position. A template engine generates an electronic template that associates an identifier of the data segment with the segment-position specification and associates the electronic template with a template identifier. A record classifier determines that the content object corresponds to the template identifier. The parsing engine further extracts, using the segment-position specification, a portion of the content-object data that corresponds to the data segment.

Claims17

Dependent claims

A content management system for generating electronic templates and using the electronic templates to extract response data from assessment from content objects, the content management system comprising:

One or more processors coupled to a memory;
a file receiver that:
receives an electronic structure file that corresponds to an assessment and includes structure-file data, the structure-file data including a region of interest where a response to a question on the assessment is to be provided;
and detects a content object for processing that includes content-object data;
a rendering engine that renders an image of the structure-file data or processed version of the structure-file data, the rendered image representing the region of interest;
an interface engine that detects a first input provided during a presentation of the rendered image corresponding to specification of a position of the region of interest;
and detects a second input identifying a target data element corresponding to the question;
a parsing engine that, using the one or more processors:
defines a segment-position specification indicative of the position of the region of interest;
and extracts, using the segment position specification of an electronic template, a portion of the content-object data that corresponds to the region of interest, the portion of the content-object data including a response to the question on the assessment;
a template engine that generates the electronic template, the electronic template associating an identifier of the question with the segment-position specification;
a record classifier that determines that the content object for processing corresponds to the electronic template;
and
a response classifier that:
evaluates the portion of the content-object data to identify the response to the question included in portion of the content-object data;
determines an evaluation quality metric reflecting a confidence in the identification of the response;
and
determines whether a quality criterion is satisfied based on the evaluation quality metric;
wherein the interface engine further, when it is determined that the quality criterion is not satisfied:
facilitates a presentation that includes the portion of the content-object data;
and
receives a third input corresponding to an identification of a score corresponding to the response.

19 more elements

A method for generating electronic templates and using the electronic templates to extract response data from assessment content objects, the method comprising:

receiving an electronic structure file that corresponds to an assessment and includes structure-file data, the structure-file data including a region of interest where a response to a question on the assessment is to be provided;
rendering an image of the structure-file data or processed version of the structure-file data, the rendered image representing the region of interest;
detecting a first input provided during a presentation of the rendered image corresponding to specification of a position of the region of interest;
defining a segment-position specification indicative of the position of the region of interest;
generating an electronic template that associates an identifier of the question-with the segment-position specification;
detecting a second input identifying a target data element corresponding to the question;
detecting a content object for processing that includes content-object data;
determining that the content object for processing corresponds to the electronic template;
extracting, using the segment-position specification of the template, a portion of the content-object data that corresponds to the region of interest, the portion of the content-object data including a response to the question on the assessment;
evaluating the portion of the content-object data to identify the response to the question included in portion of the content-object data;
determining an evaluation quality metric reflecting a confidence in the identification of the response;
and
determining whether a quality criterion is satisfied based on the evaluation quality metric;
and
when it is determined that the quality criterion is not satisfied:
facilitating a presentation that includes the portion of the content-object data;
and
receiving a third input corresponding to an identification of a score corresponding to the response.

15 more elements

A computer-program product tangibly embodied in a non-transitory machine-readable storage medium, including instructions configured to cause one or more data processors to perform actions including:

accessing an electronic structure file that corresponds to an assessment and includes structure-file data, the structure-file data including a region of interest where a response to a question on the assessment is to be provided
rendering an image of the structure-file data or processed version of the structure-file data, the rendered image representing the region of interest;
detecting a first input provided during a presentation of the rendered image corresponding to specification of a position of the region of interest;
detecting a second input identifying a target data element corresponding to the question;
defining a segment-position specification indicative of the position of the region of interest;
generating an electronic template that associates an identifier of the question with the segment-position specification;
detecting a content object for processing that includes content-object data;
determining that the content object for processing corresponds to the electronic template;
extracting, using the segment-position specification of the template, a portion of the content-object data that corresponds to the region of interest, the portion of the content-object data including a response to the question on the assessment;
evaluating the portion of the content-object data to identify the response to the question included in portion of the content-object data;
determining an evaluation quality metric reflecting a confidence in the identification of the response;
and
determining whether a quality criterion is satisfied based on the evaluation quality metric;
and
when it is determined that the quality criterion is not satisfied:
facilitating a presentation that includes the portion of the content-object data;
and
receiving a third input corresponding to an identification of a score corresponding to the response.

15 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/640,597Filed 6 Mar 2015
Granted: 12 Apr 2016
Term ends: Not estimatedThe source records don’t support an estimate.

Classification11 codes

G06F 16/2462
Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries: approximate or statistical queries
G06F 16/116
File system administration, e.g. details of archiving or snapshots: details of conversion of file system types or formats
G06F 16/1727
Details of further file system functions: details of free space management performed by the file system
G06F 16/24578
With adaptation to user needs: using ranking