Implementing interface for rapid ground truth binning
AssigneeInternational Business Machines Corporation
InventorsChristopher F. Ackermann, Charles E. Beller, Michael Drzewucki
Life of this patent
Estimating the term…
Abstract
A method, system and computer program product are provided for implementing an interface for rapid ground truth binning. A set of documents are received wherein each document has at least one entity in a set of entities. A user interface is provided for each received document allowing a user to view passages and select options related to confirming or denying an equivalence between the entity in the received document and an output document entity bin including the entity. Responsive to the user utilizing the user interface and confirming the equivalence, combining the received document with the output document entity bin with reference to the entity.
Claims13
A system for implementing an interface for rapid ground truth binning comprising:
- a ground truth binning control logic;
- said ground truth binning control logic tangibly embodied in a non-transitory machine readable medium used to implement rapid ground truth binning;
- said ground truth binning control logic, receiving a first set of documents wherein each document in the first set has at least one reference to a first entity;
- said ground truth binning control logic, receiving an unbinned document wherein the unbinned document has at least one reference to a second entity;
- said ground truth binning control logic, providing a user interface for each received document allowing a user to view passages and select options related to confirming or denying an equivalence between the second entity in the unbinned document and the first entity, wherein providing the user interface comprises:
- displaying a name of the first entity;
- displaying a title of each document in the first set of documents;
- displaying a set of references to the first entity, wherein each reference from the set of references is found in a document in the first set of documents;
- displaying a similarity between the first entity and the second entity;
- and
- said ground truth binning control logic, responsive to the user utilizing the user interface and confirming the equivalence, combining the unbinned document with the first set of documents.
A method for implementing an interface for rapid ground truth binning comprising:
- providing a ground truth binning control logic;
- said ground truth binning control logic tangibly embodied in a non-transitory machine readable medium used to implement rapid ground truth binning comprising;
- receiving a first set of documents wherein each document in the first set has at least one reference to a first entity;
- receiving an unbinned document wherein the unbinned document has at least one reference to a second entity;
- providing a user interface allowing a user to view passages and select options related to confirming or denying an equivalence between the second entity in the unbinned document and the first entity, wherein providing the user interface comprises:
- displaying a name of the first entity;
- displaying a title of each document in the first set of documents;
- displaying a set of references to the first entity, wherein each reference from the set of references is found in a document in the first set of documents;
- displaying a similarity between the first entity and the second entity;
- and
- responsive to the user utilizing the user interface and denying the equivalence, creating a new output document entity bin for the unbinned document.
A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:
- provide a ground truth binning control logic;
- receive a first set of documents wherein each document in the first set has at least one reference to a first entity;
- receive an unbinned document wherein the unbinned document has at least one reference to a second entity;
- provide a user interface allowing a user to view passages and select options related to confirming or denying an equivalence between the second entity in the unbinned document and the first entity, wherein providing the user interface comprises:
- displaying a name of the first entity;
- displaying a title of each document in the first set of documents;
- displaying a set of references to the first entity, wherein each reference from the set of references is found in a document in the first set of documents;
- displaying a similarity between the first entity and the second entity;
- and
- responsive to the user utilizing the user interface and confirming the equivalence, combining the unbinned document with the first set of documents.
Dependencies are inferred from the claim text.