US 2026/0310883 A1 · SYSTEM AND METHOD FOR AUTOMATED END-TO-END COMPUTATIONAL REPRODUCIBILITY AUDITING OF SCIENTIFIC RESEARCH

Abstract

A system for automated computational reproducibility auditing of scientific research comprises an input processing pipeline comprising identity resolution, paper retrieval, and resource discovery modules, an analysis pipeline comprising text extraction, a result extraction, and bill of materials construction modules, a reconstruction and execution environment comprising workspace reconstruction, analysis execution module, and result comparison modules, and a computing system to perform a method comprising receiving as input a paper identifier or informal descriptor, acquiring a digital form of the identified paper, extracting structured information from the paper, identifying key results from the paper, constructing a bill of materials for paper, obtaining necessary data files and code, synthesizing a scientific workflow specification, synthesizing a computation environment specification, constructing a workspace, executing analysis of the scientific workflow, comparing results obtained through reproduction with the key results extracted from the original paper, and synthesizing a report documenting the entire reproduction attempt.

Claims20

Dependent claims

A system for automated computational reproducibility auditing of scientific research, comprising:

an input processing pipeline comprising an identity resolution module, a paper retrieval module, and a resource discovery module;
an analysis pipeline comprising a text extraction module, a result extraction module, and a bill of materials construction module;
a reconstruction and execution environment comprising a workspace reconstruction module, an analysis execution module, and a result comparison module;
and
a computing system communicatively connected to the input processing pipeline, analysis pipeline, and reconstruction and execution environment, comprising a processor and a non-transitory computer-readable medium with instructions stored thereon, which when executed by the processor, perform steps comprising:
receiving as input a paper identifier or informal descriptor;
acquiring a digital form of the identified paper;
extracting structured information from the paper;
identifying key results from the paper which will be targeted for reproduction;
constructing a bill of materials for the scientific work described in the paper;
obtaining necessary data files and code;
synthesizing a scientific workflow specification;
synthesizing a computation environment specification;
constructing a workspace;
executing analysis of the scientific workflow;
comparing results obtained through reproduction with the key results extracted from the original paper;
and
synthesizing a report documenting the entire reproduction attempt.

15 more elements

Dependencies are inferred from the claim text.

System and method for automated end-to-end computational reproducibility auditing of scientific research

Life of this patent

System and method for automated end-to-end computational reproducibility auditing of scientific research

Life of this patent

Abstract

Claims20