Back to results
US 2023/0146144 A1Published application
Digital image classification and annotation
AssigneeGoogle Inc.
InventorsMaryam Garrett, Wan Fen Nicole Quah, Gordon Sims
Life of this patent
Estimating the term…
Abstract
Implementations are described herein for automatically annotating or curating digital images using various signals generated by individual users, in addition to or instead of content of the digital images themselves, thereby to enable the digital images to be retrieved from a searchable database based on their annotations. In particular, techniques are described herein for identifying events associated with a user, e.g., based on natural language input provided by a user, and automatically classifying/annotating images inferred to be related to those events.
Claims20
A method implemented using one or more processors, comprising:
- obtaining a natural language input provided by a user via one or more input components of a computing device, wherein the natural language input is directed by the user to an automated assistant executing at least in part on the computing device;
- analyzing the natural language input to determine an event associated with the user, one or more tokens of the natural language input that describe the event, and a date associated with the event;
- identifying a plurality of digital images captured on the date;
- comparing a degree of image manipulation that has been applied to each of the identified plurality of digital images via one or more image manipulation applications relative to respective degrees of image manipulation applied to other digital images of the identified plurality of digital images via one or more of the image manipulation applications;
- based on the comparing, classifying a subset of the plurality of digital images captured on the date as being related to the event, wherein other digital images of the plurality of digital images captured on the date are not classified as being related to the event;
- and
- storing, in a searchable database, data indicative of one or more of the tokens that describe the event in association with the subset of the plurality of digital images that were classified as being related to the event, wherein the digital images in the searchable database are searchable based on the one or more tokens that are stored in association with the digital images.
4 more elements
A system comprising one or more processors and memory storing instructions that, in response to execution by the one or more processors, cause the one or more processors to:
- obtain a natural language input provided by a user via one or more input components of a computing device, wherein the natural language input is directed by the user to an automated assistant executing at least in part on the computing device;
- analyze the natural language input to determine an event associated with the user, one or more tokens of the natural language input that describe the event, and a date associated with the event;
- identify a plurality of digital images captured on the date;
- compare a degree of image manipulation that has been applied to each of the identified plurality of digital images via one or more image manipulation applications relative to respective degrees of image manipulation applied to other digital images of the identified plurality of digital images via one or more of the image manipulation applications;
- based on the comparison, classify a subset of the plurality of digital images captured on the date as being related to the event, wherein other digital images of the plurality of digital images captured on the date are not classified as being related to the event;
- and
- store, in a searchable database, data indicative of one or more of the tokens that describe the event in association with the subset of the plurality of digital images that were classified as being related to the event, wherein the digital images in the searchable database are searchable based on the one or more tokens that are stored in association with the digital images.
4 more elements
At least one non-transitory computer-readable medium comprising instructions that, when executed by one or more processors, cause the one or more processors to:
- obtain a natural language input provided by a user via one or more input components of a computing device, wherein the natural language input is directed by the user to an automated assistant executing at least in part on the computing device;
- analyze the natural language input to determine an event associated with the user, one or more tokens of the natural language input that describe the event, and a date associated with the event;
- identify a plurality of digital images captured on the date;
- compare a degree of image manipulation that has been applied to each of the identified plurality of digital images via one or more image manipulation applications relative to respective degrees of image manipulation applied to other digital images of the identified plurality of digital images via one or more of the image manipulation applications;
- based on the comparison, classify a subset of the plurality of digital images captured on the date as being related to the event, wherein other digital images of the plurality of digital images captured on the date are not classified as being related to the event;
- and
- store, in a searchable database, data indicative of one or more of the tokens that describe the event in association with the subset of the plurality of digital images that were classified as being related to the event, wherein the digital images in the searchable database are searchable based on the one or more tokens that are stored in association with the digital images.
4 more elements
Dependencies are inferred from the claim text.