Back to results
US 9,179,278 B2Granted
Systems and methods involving augmented menu using mobile device
AssigneeQUALCOMM Incorporated
InventorsSaumitra Mohan Das, Vinay Sridhara, Behrooz Khorashadi
Life of this patent
Estimating the term…
Abstract
The subject matter disclosed herein relates to a method comprising displaying in a camera view of a mobile device a captured image of one or more items listed in a menu of items available for selection at a point of interest identifiable, at least in part, by a location. A method may further include transmitting a message comprising parsed text of the one or more items and information representative of the location, and receiving, in response to the transmission of the message, annotations to be displayed in the camera view.
Claims32
A method comprising:
- displaying in a camera view of a mobile device a captured image of one or more items available for selection at a point of interest, wherein the point of interest is identifiable, at least in part, by a location determined based, at least in part, on information associated with a location context identifier, wherein the location context identifier pertains to information to identify an area of a building;
- transmitting, by the mobile device to a server, a message comprising the location context identifier and parsed text of a particular item selected from among the one or more items based upon a user-input detected by the mobile device, wherein the transmitted location context identifier is separate from the captured image and is usable to search for information related to the particular item;
- and
- receiving, in response to said transmission of said message, one or more annotations that include information about the particular item to be displayed in said camera view, wherein said one or more annotations are superimposed in a portion of said camera view including said captured image of said particular item.
1 more element
An apparatus comprising:
- means for displaying in a camera view of a mobile device a captured image of one or more items available for selection at a point of interest, wherein the point of interest is identifiable, at least in part, by a location determined based, at least in part, on information associated with a location context identifier, wherein the location context identifier pertains to information to identify an area of a building;
- means for transmitting, from the mobile device to a server, a message comprising the location context identifier and parsed text of a particular item selected from among the one or more items based upon a user-input detected by the mobile device, wherein the transmitted location context identifier is separate from the captured image and is usable to search for information related to the particular item;
- and
- means for receiving, in response to said transmission of said message, one or more annotations that include information about the particular item for display in said camera view, wherein said one or more annotations are superimposed in a portion of said camera view including said captured image of said particular item.
1 more element
An apparatus comprising:
- a processor configured to provide to a display device a camera view of a captured image of one or more items available for selection at a point of interest, wherein the point of interest is identifiable, at least in part, by a location determined based, at least in part, on information associated with a location context identifier, wherein the location context identifier pertains to information to identify an area of a building;
- a transmitter configured to transmit to a server a message comprising the location context identifier and parsed text of a particular item selected from among the one or more items based upon a user-input detected by the apparatus, wherein the transmitted location context identifier is separate from the captured image and is usable to search for information related to the particular item;
- and
- a receiver configured to receive, in response to said transmission of said message, one or more annotations that include information about the particular item to be displayed in said camera view, wherein said one or more annotations are superimposed in a portion of said camera view including said captured image of said particular item.
1 more element
A method comprising:
- at a camera of a mobile device, capturing an image of a menu listing menu items available for selection at a point of interest that is identifiable by a location context identifier;
- displaying the captured image of said menu in a camera view of said mobile device;
- parsing, by the mobile device, particular text in the displayed image to identify a particular menu item selected from among said displayed menu items based upon a user-input detected by the mobile device;
- associating a location of said mobile device and said particular parsed text with a previously captured image of said particular menu item as presented to a customer, wherein associating said location and said particular parsed text with said previously captured image includes transmitting said location context identifier and said particular parsed text to a remote server;
- and
- receiving from the remote server one or more annotations that include information about said particular menu item for display in said camera view, wherein said one or more annotations are superimposed in a portion of said camera view including said captured image of said particular menu item.
3 more elements
An apparatus comprising:
- at a camera of a mobile device, means for capturing an image of a menu listing menu items available for selection at a point of interest that is identifiable by a location context identifier;
- means for displaying the captured image of said menu in a camera view of said mobile device;
- means for parsing particular text in the displayed image to identify a particular menu item selected from among said displayed menu items based upon a user-input detected by the mobile device;
- means for associating a location of said mobile device and said particular parsed text with a previously captured image of said particular menu item as presented to a customer, wherein associating said location and said particular parsed text with said previously captured image includes transmitting said location context identifier and said particular parsed text to a remote server;
- and
- means for receiving from said remote server at least one annotation that includes information about the particular menu item, wherein said at least one annotation is superimposed in a portion of said camera view including said captured image of said particular menu item.
3 more elements
An apparatus comprising:
- a display of a mobile device configured to display a captured image of a menu;
- a user interface configured to receive a user-selection of particular text from among a plurality of distinct text displayed in the displayed image of said menu;
- and
- a processor configured to parse said particular text to identify a particular menu item of a plurality of items of said menu responsive to said selection of said particular text, wherein said processor is capable of associating a location of said mobile device, wherein the location is identifiable by a location context identifier, and said particular parsed text with a previously captured image of said particular menu item, wherein associating said location and said particular parsed text with said previously captured image includes transmitting said location context identifier and said particular parsed text to a remote server, and wherein at least one annotation that includes information about the particular menu item is received from said remote server and is superimposed in a portion of a camera view of said mobile device including said captured image of said particular menu item.
1 more element
An article comprising:
- a non-transitory storage medium comprising machine-readable instructions stored thereon that are executable by a special purpose computing device configured to:
- process signals of an image from a camera including a listing of menu items available for selection at a location where said menu items are available for selection, wherein the location is at a business establishment identifiable by a location context identifier;
- process signals to display the captured image in a camera view of a mobile device;
- parse particular text in the displayed image to identify a particular menu item selected from among said displayed menu items based upon a user-input detected by the mobile device;
- and
- associate said location and said particular parsed text with a previously captured image of said particular menu item as presented to a customer, wherein associating said location and said particular parsed text with said previously captured image includes transmitting said location context identifier and said particular parsed text to a remote server, and wherein at least one annotation that includes information about the particular menu item is received from said remote server and is superimposed in a portion of said camera view including said captured image of said particular menu item.
3 more elements
An article comprising:
- a non-transitory storage medium comprising machine-readable instructions stored thereon that are executable by a special purpose computing device configured to:
- display in a camera view of a mobile device a captured image of one or more items available for selection at a point of interest, wherein the point of interest is identifiable, at least in part, by a location determined based, at least in part, on information associated with a location context identifier, wherein the location context identifier pertains to information to identify an area of a building;
- transmit to a server a message comprising the location context identifier and parsed text of a particular item selected from among the one or more items based upon a user-input detected by the mobile device, wherein the transmitted location context identifier is separate from the captured image and is usable to search for information related to the particular item;
- and
- receive, in response to said transmission of said message, one or more annotations that include information about the particular item to be displayed in said camera view, wherein said one or more annotations are superimposed in a portion of said camera view including said captured image of said particular item.
2 more elements
Dependencies are inferred from the claim text.