Establishing a communication session using a handshake process with light signals
AssigneeMaplebear Inc.
InventorRobert Russel Adams
Life of this patent
Estimating the term…
Abstract
An online concierge system for establishing a communication session between devices using a light signal. A first client device captures video data depicting a light emitter of another client device. The first client device detects a light signal transmitted by the light emitter in the video data. The first client device extracts a handshake identifier from the light signal by decoding the light signal. A machine learning model may be used to translate the light signal into a numerical or an alphanumerical identifier. The first client device established a communication session with the other client device by transmitting a request to establish the communication session via an online concierge system. The request contains the extracted handshake identifier.
Claims17
A method comprising, at a computer system comprising a processor and a computer-readable medium:
- capturing, by a camera of a first smartphone associated with a first user, video data depicting a light emitter of a second smartphone associated with a second user;
- detecting, in the video data by the processor, a light signal transmitted by the light emitter of the second smartphone, wherein detecting the light signal comprises applying a machine learning model to the captured video data, wherein the machine learning model is trained to detect a light signal depicted in video data;
- extracting, by the processor, a handshake identifier from the light signal by decoding the light signal;
- establishing, by the processor, a communication session with the second smartphone by transmitting a request to establish the communication session to an online system, wherein the request comprises the handshake identifier;
- receiving, through a user interface of the first smartphone, a text input by the first user, the text input describing a message from the first user to the second user;
- and
- transmitting, by the first smartphone, the text input to second smartphone via the communication session, wherein transmitting the text input to the second smartphone via the communication session causes the second smartphone to display the text input to the second user.
A non-transitory computer-readable medium having instructions encoded thereon that, when executed by a processor, cause the processor to:
- capture, by a camera of a first smartphone associated with a first user, video data depicting a light emitter of a second smartphone associated with a second user;
- detect, in the video data, a light signal transmitted by the light emitter of the second smartphone, wherein detecting the light signal comprises applying a machine learning model to the captured video data, wherein the machine learning model is trained to detect a light signal depicted in video data;
- extract a handshake identifier from the light signal by decoding the light signal;
- establish a communication session with the second smartphone other client device by transmitting a request to establish the communication session to an online system, wherein the request comprises the handshake identifier;
- receive, through a user interface of the first smartphone, a text input by the first user, the text input describing a message from the first user to the second user;
- and
- transmit, by the first smartphone, the text input to second smartphone via the communication session, wherein transmitting the text input to the second smartphone via the communication session causes the second smartphone to display the text input to the second user.
A system comprising:
- at least one processor;
- at least one non-transitory computer-readable medium storing instructions that, when executed by the at least one processor, cause the at least one processor to:
- capture, by a camera of a first smartphone associated with a first user, video data depicting a light emitter of a second smartphone associated with a second user;
- detect, in the video data, a light signal transmitted by the light emitter of the second smartphone, wherein detecting the light signal comprises applying a machine learning model to the captured video data, wherein the machine learning model is trained to detect a light signal depicted in video data;
- extract a handshake identifier from the light signal by decoding the light signal;
- establish a communication session with the second smartphone by transmitting a request to establish the communication session to an online system, wherein the request comprises the handshake identifier;
- receive, through a user interface of the first smartphone, a text input by the first user, the text input describing a message from the first user to the second user;
- and
- transmit, by the first smartphone, the text input to second smartphone via the communication session, wherein transmitting the text input to the second smartphone via the communication session causes the second smartphone to display the text input to the second user.
Dependencies are inferred from the claim text.