Back to results
US 10,043,069 B1Granted
Item recognition using context data
AssigneeAmazon Technologies, Inc.
InventorsYue Liu, Utkarsh Prateek, Avnish Sikka, Matthew Daniel Hart, Emilie Noelle McConville, Sonjeev Jahagirdar
Life of this patent
Estimating the term…
Abstract
A system for recognizing objects and/or text in image data may use context data to perform object/text recognition. The system may also use context data when determining potential functions to execute in response to recognizing the object/text. Context data may be gathered based on device sensor data, user profile data such as the behavior of a user or the behavior of those in a user's social network, or other factors. Recognition processing and/or function selection may be configured to account for context data when operating to improve output results.
Claims25
A computer-implemented method, comprising:
- receiving social network data associated with a first user profile corresponding to a mobile computing device, the social network data including information related to one or more different user profiles linked, within a social network, to the first user profile;
- receiving image data from the mobile computing device;
- performing image processing on the image data to identify text in the image data;
- recognizing actionable text in the identified text;
- determining a plurality of potential user-executable functions, wherein the determining is based at least in part on the actionable text and wherein the plurality of potential user-executable functions includes at least one of creating a new contact entry based on the actionable text, adding information in the actionable text to an existing contact, showing a map based on the actionable text, dialing a telephone number included in the actionable text, or accessing a website included in the actionable text;
- determining, based at least in part on the social network data, a primary user-executable function of the plurality of potential user-executable functions;
- causing the mobile computing device to display an icon, the icon including at least two user-selectable portions including:
- a first user-selectable portion that, when selected, causes execution of the primary user-executable function, and
- a second user-selectable portion that, when selected, causes execution of an action to display additional user-executable functions of the plurality of potential user-executable functions;
- receiving an indication of a user selection of the first user-selectable portion corresponding to the primary user-executable function;
- and
- executing the primary user-executable function.
9 more elements
A computing system, comprising:
- at least one processor;
- and
- a computer-readable medium encoded with instructions which, when executed by the at least one processor, cause the computing system to:
- to receive image data, the image data including text data;
- to receive social network data associated with a first user profile corresponding to the computing system, the social network data including information related to one or more different user profiles linked, within a social network, to the first user profile;
- to perform character recognition of the text data;
- to determine a plurality of potential user-selectable functions based at least in part on recognized characters of the text data;
- to determine, based at least in part on the social network data, a first user-selectable function of the plurality of potential user-selectable functions;
- to cause display of an icon to the user, the icon including at least two user-selectable portions including:
- a first user-selectable portion that, when selected, causes execution of the first user-selectable function;
- and
- a second user-selectable portion that, when selected, causes execution of an action to cause display of additional user-selectable functions of the plurality of potential user-selectable functions.
9 more elements
A non-transitory computer-readable storage medium encoded with instructions which, when executed by at least one processor of a computing system, cause the computing system:
- to receive image data, the image data including text data;
- to receive social network data associated with a first user profile corresponding to the computing system, the social network data including information related to one or more different user profiles linked, within a social network, to the first user profile;
- to perform character recognition of the text data;
- to determine a plurality of potential user-selectable functions based at least in part on recognized characters of the text data;
- to determine, based at least in part on the user social network data, a first user-selectable function of the plurality of potential user-selectable functions;
- to cause display of an icon to a user, the icon including at least two user-selectable portions including:
- a first user-selectable portion that, when selected, causes execution of the first user-selectable function;
- and
- a second user-selectable portion that, when selected, causes execution of an action to cause display of additional user-selectable functions of the plurality of potential user-selectable functions.
6 more elements
Dependencies are inferred from the claim text.