US 10,257,341 B2Granted

Using a smartphone for remote interaction with visual user interfaces

AssigneeeBay Inc.

InventorIevgenii Ivashyn

Life of this patent

Estimating the term…

Loading patent…

Abstract

Methods and systems are provided for establishing an interaction session between a visual interface on any of a wide range of devices (e.g., POS, ATM, computer, television, or other visual display) and a smartphone having a camera by using the smartphone camera to scan or capture a special image (e.g., a QR code) presented on the visual interface. The special image serves as a token mark that can graphically encode information about the visual interface and the operator or owner of the device presenting the visual interface. Upon scanning the token mark, an application on the smartphone may establish a connection between the application and a server in communication with the visual interface. The application may then present some of actions provided by the visual interface on the smartphone display so that the user can select actions using the smartphone with the selected actions being performed on the visual interface.

Claims20

Dependent claims

A system, comprising:

one or more processors;
and
one or more storage devices storing instructions that, responsive to execution by the one or more processors, cause the system to perform operations comprising:
communicating, using a visual control server, with a visual interface control client application at a client device effective to cause the client device to display a token mark associated with a visual interface displayed by the client device, the visual interface comprising one or more data entry fields;
receiving, from a visual interface control application at a user device, information associated with the token mark displayed by the client device;
establishing an interaction session between the user device and the client device;
determining, using the information, one or more selectable options associated with the visual interface for interacting with the one or more data entry fields displayed by the client device;
forwarding, to the user device, the one or more selectable options effective to cause the one or more selectable options to be displayed on the user device;
receiving, from the user device, a notification of selection of one of the one or more selectable options;
forwarding the notification of selection to the client device effective to cause the client device to perform an action associated with the notification, the action comprising an interaction with at least one of the one or more data entry fields;
receiving, from the user device, a disconnect command;
and
terminating the interaction session between the user device and the client device.

10 more elements

A method, comprising:

receiving, using a visual control server and from a visual interface control application at a user device, token information associated with a token mark displayed on a client device and scanned by the user device, the token information comprising a visual interface view identifier that identifies a particular view displayed at the client device;
establishing an interaction session between the visual interface control application at the user device and a visual interface control client application at the client device based, at least in part, on the token information;
determining, using the token information, one or more selectable options associated with the particular view for interacting with the particular view based, at least in part, on the visual interface view identifier, at least one option of the one or more selectable options comprising an interaction with an interactive feature displayed on the particular view;
forwarding, to the user device, the one or more selectable options effective to cause the one or more selectable options to be displayed at the user device;
receiving, from the user device, a notification that the at least one option has been selected;
and
forwarding, to the client device, the notification that the at least one option has been selected effective to cause the client device to perform the interaction with the interactive feature and provide visual feedback of the interaction;
receiving, from the user device, a disconnect command;
and
terminating the interaction session between the user device and the client device.

7 more elements

A storage device storing instructions, that responsive to execution by one or more processors of a computing device, cause the computing device to perform operations comprising:

receiving, using a visual control server and from a visual interface control application at a user device, token information associated with a token mark that is displayed on a client device and scanned by the user device, the token information comprising a visual interface view identifier that identifies a particular view displayed at the client device;
establishing an interaction session between the visual interface control application at the user device and a visual interface control client application at the client device based, at least in part, on the token information;
determining, using the token information, one or more selectable options associated with the particular view for interacting with the particular view based, at least in part, on the visual interlace view identifier, at least one option of the one or more selectable options comprising an interaction with an interactive feature displayed on the particular view;
forwarding, to the user device, the one or more selectable options effective to cause the one or more selectable options to be displayed at the user device;
receiving, from the user device, a notification that the at least one option has been selected;
forwarding, to the client device, the notification that the at least one option has been selected effective to cause the client device to perform the interaction with the interactive feature and provide visual feedback of the interaction;
receiving, from the user device, a disconnect command;
and
terminating the interaction session between the user device and the client device.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application: 14/069,725Filed 1 Nov 2013
Published: US 2015/0127714 A17 May 2015
Granted: 9 Apr 2019
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

H04M 1/72445
With means for local support of applications that increase the functionality: for supporting Internet browser applications
G06F 21/41
User authentication: where a single sign-on provides access to a plurality of computers
G06F 21/42
User authentication: using separate channels for security data
H04W 12/06
Security arrangements; Authentication; Protecting privacy or anonymity: authentication