# US 11,029,905 B2 · Integrated learning using multiple devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,029,905 B2
- Document ID: US11029905B2
- Status: Granted
- Kind: B2
- Application number: 16/696,932
- Filed: 2019-11-26
- Published: 2020-03-26
- Granted: 2021-06-08
- Earliest claimed: 2013-06-26
- Assignees: Sap SE
- Applicants: Sap SE
- Inventors: Lars Satow; Joerg Habon
- Web page: https://patentgrep.com/patent/US11029905B2

## CPC

- G06F 3/14: Digital output to display device {; Cooperation and interconnection of the display device with other functional units}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/03: Arrangements for converting the position or the displacement of a member into a coded form
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display}
- G06F 9/453: {Help systems}
- G06K 7/1092: {sensing by means of TV-scanning}
- G09B 5/02: with visual presentation of the material to be studied, e.g. using film strip
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

An access code can be generated by a primary device and interpreted by a secondary device for the purpose of presenting, on the secondary device, additional content related to an application running on the primary device. The access code can be a two dimensional graphic or QR code that can be easily captured by a camera unit of the secondary device. Once captured, additional content related to the running application can be identified and displayed on the secondary device.

## Claims

### Claim 1

A computer-implemented method comprising:
capturing, by a first computing device, an access code generated by and presented on a display of a second computing device;
based on the access code, decoding, by the first computing device, application metadata describing a current state of an application operating on the second computing device, wherein the application metadata is collected by the second computing device in response to the second computing device detecting a help event triggered while application content is being displayed and interacted with on a display of the second computing device, wherein the application metadata identifies the application;
retrieving, by the first computing device, additional application content based on an identification of the application and the current state of the application, the additional application content is related to assisting a user with the application; and
presenting, by the first computing device, the additional content on the display of the first computing device.

### Claim 2 (depends on 1)

The computer-implemented method of claim 1, wherein the help event is associated with an error generated during execution of the application.

### Claim 3 (depends on 1)

The computer-implemented method of claim 1, wherein the access code includes a plurality of fields configured to store application metadata.

### Claim 4 (depends on 1)

The computer-implemented method of claim 1, wherein retrieving the additional application content comprises retrieving the additional content from a storage of the first computing device.

### Claim 5 (depends on 4)

The computer-implemented method of claim 4, wherein the additional application content is presented on the display of the first computing device at the same time as the application content is being presented on the display of the second computing device.

### Claim 6 (depends on 1)

The computer-implemented method of claim 1 further comprising sending, by the first computing device, a signal to the second computing device indicating that the first computing device has read the access code displayed on the display of the second computing device.

### Claim 7 (depends on 1)

The computer-implemented method of claim 1, wherein the access code is an audible noise outputted by the second computing device through a speaker of the second computing device, wherein capturing the access code comprises using a microphone of the first computing device to capture the access code.

### Claim 8

A non-transitory computer readable storage medium storing a program executable by at least one processing unit of a first computing device, the programs comprising sets of instructions for:
capturing an access code generated by and presented on a display of a second computing device;
based on the access code, decoding application metadata describing a current state of an application operating on the second computing device, wherein the application metadata is collected by the second computing device in response to the second computing device detecting a help event triggered while application content is being displayed and interacted with on a display of the second computing device, wherein the application metadata identifies the application;
retrieving additional application content based on an identification of the application and the current state of the application, the additional application content is related to assisting a user with the application; and
presenting the additional content on the display of the first computing device.

### Claim 9 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the help event is associated with an error generated during execution of the application.

### Claim 10 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the access code includes a plurality of fields configured to store application metadata.

### Claim 11 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein retrieving the additional application content comprises retrieving the additional content from a storage of the first computing device.

### Claim 12 (depends on 11)

The non-transitory computer readable storage medium of claim 11, wherein the additional application content is presented on the display of the first computing device at the same time as the application content is being presented on the display of the second computing device.

### Claim 13 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the program further comprises a set of instructions for sending a signal to the second computing device indicating that the first computing device has read the access code displayed on the display of the second computing device.

### Claim 14 (depends on 8)

The non-transitory computer readable storage medium of claim 8, wherein the access code is an audible noise outputted by the second computing device through a speaker of the second computing device, wherein capturing the access code comprises using a microphone of the first computing device to capture the access code.

### Claim 15

A system comprising
a first display;
a set of processing units; and
a non-transitory computer-readable medium storing instructions that when executed by at least one processing unit in the set of processing units cause the at least one processing unit to:
capture an access code generated by and presented on a display of a second computing device;
based on the access code, decode application metadata describing a current state of an application operating on the second computing device, wherein the application metadata is collected by the second computing device in response to the second computing device detecting a help event triggered while application content is being displayed and interacted with on a display of the second computing device, wherein the application metadata identifies the application;
retrieve additional application content based on an identification of the application and the current state of the application, the additional application content is related to assisting a user with the application; and
present the additional content on the display of the first computing device.

### Claim 16 (depends on 15)

The system of claim 15, wherein the access code includes a plurality of fields configured to store application metadata.

### Claim 17 (depends on 15)

The system of claim 15, wherein retrieving the additional application content comprises retrieving the additional content from a storage of the first computing device.

### Claim 18 (depends on 17)

The system of claim 17, wherein the additional application content is presented on the display of the first computing device at the same time as the application content is being presented on the display of the second computing device.

### Claim 19 (depends on 15)

The system of claim 15, wherein the instructions further cause the at least one processing unit to send a signal to the second computing device indicating that the first computing device has read the access code displayed on the display of the second computing device.

### Claim 20 (depends on 15)

The system of claim 15, wherein the access code is an audible noise outputted by the second computing device through a speaker of the second computing device, wherein capturing the access code comprises using a microphone of the first computing device to capture the access code.
