Back to results
US 12,424,013 B2Granted
Image enhancement in a genealogy system
AssigneeAncestry.com Operations Inc.
InventorsMichael Benjamin Brodie, Gopalkrishna Balkrishna Veni, Jack Reese, Azadeh Moghtaderi, Randon Morford
Life of this patent
Estimating the term…
Abstract
Methods, systems, and computer-program products for image enhancement include receiving an image and optionally a user request, classify the image, crop image components of the image, restore cropped image components of the image, colorized restored image components, and reconstruct the image from the colorized, restored image components and other components. The other components may include text components that are restored in a separate treatment pipeline.
Claims20
A computer-implemented method, comprising:
- receiving, by a genealogy server, an image that is digitalized from a physical record, the image associated with a genealogy record or an individual profile of the genealogy server;
- identifying a sub-region of the image as a target region for image enhancement;
- classifying that the sub-region includes a type of image component;
- enhancing the sub-region based on the classified type of the image component to generate an enhanced sub-region, enhancing the sub-region comprising restoring or colorizing the image component, wherein enhancing the sub-region is performed at least partially by a machine learning model and the machine learning model comprises a generative adversarial network that is trained using a plurality of image records stored in the genealogy server and faux-real images generated by randomly oversaturating real images;
- and
- merging the enhanced sub-region with one or more other sub-regions or an original version of the image.
3 more elements
A system comprising:
- one or more processors;
- and
- memory configured to store code comprising instructions, the instructions, when executed by the one or more processors, cause the one or more processors to perform steps comprising:
- receiving an image that is digitalized from a physical record, the image associated with a genealogy record or an individual profile of a genealogy server;
- identifying a sub-region of the image as a target region for image enhancement;
- classifying that the sub-region includes a type of image component;
- enhancing the sub-region based on the classified type of the image component to generate an enhanced sub-region, enhancing the sub-region comprising restoring or colorizing the image component, wherein enhancing the sub-region is performed at least partially by a machine learning model and the machine learning model is trained using a plurality of image records stored in the genealogy server, and wherein enhancing the sub-region comprises restoring the image component by:
- adjusting a size of the image in response to determining that the size of the image exceeds a predetermined size threshold;
- generating a modified image by merging a restored image component into the image that has the size adjusted;
- and
- restoring the modified image to an original image size and an original image aspect ratio;
- and
- merging the enhanced sub-region with one or more other sub-regions or an original version of the image.
10 more elements
A system comprising:
- a graphical user interface configured to:
- provide a user an interface to upload an image that is digitalized from a physical record;
- and
- receive one or more options from the user on image enhancement of the image;
- and
- a genealogy server in communication with the graphical user interface, the genealogy server comprising one or more processors and memory, the memory configured to store code comprising instructions, the instructions, when executed by the one or more processors, cause the one or more processors to perform steps comprising:
- receiving the image, the image to be associated with a genealogy record or an individual profile of the genealogy server;
- identifying a sub-region of the image as a target region for image enhancement;
- classifying that the sub-region includes a type of image component;
- enhancing the sub-region based on the classified type of the image component to generate an enhanced sub-region, enhancing the sub-region comprising restoring or colorizing the image component, wherein enhancing the sub-region is performed at least partially by a machine learning model and the machine learning model is trained using a plurality of image records stored in a genealogy server, and wherein enhancing the sub-region comprises performing a facial enhancement by:
- expanding a face detected in the sub-region;
- and
- enhancing the expanded face using an image-processing machine learning model that is trained specifically for enhancing faces;
- and
- merging the enhanced sub-region with one or more other sub-regions or an original version of the image.
12 more elements
Dependencies are inferred from the claim text.