# US 2021/0342906 A1 · Digital assistant interacting with mobile devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0342906 A1
- Document ID: US20210342906A1
- Status: Published application
- Kind: A1
- Application number: 16/873,531
- Filed: 2020-04-30
- Published: 2021-11-04
- Earliest claimed: 2020-04-30
- Inventors: Wesley John Boudville
- Web page: https://patentgrep.com/patent/US20210342906A1

## CPC

- G06Q 30/08: Auctions
- A63F 13/215: comprising means for detecting acoustic signals, e.g. using a microphone
- A63F 13/42: by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 16/90332: {Natural language query formulation or dialogue systems}
- G06F 16/953: Querying, e.g. by the use of web search engines
- G06F 16/9535: Search customisation based on user profiles and personalisation
- G06K 7/1413: {1D bar codes}
- G06K 7/1417: {2D bar codes}
- G06K 19/06028: {using bar codes}
- G06K 19/06037: {multi-dimensional coding}
- G06N 5/043: Distributed expert systems; Blackboards
- G06Q 20/123: {Shopping for digital content}
- G06Q 20/3223: {Realising banking transactions through M-devices}
- G06Q 30/0613: {using intermediate agents}
- G06Q 30/0627: {by specifying product or service characteristics, e.g. product dimensions}
- A63F 13/48: Starting a game, e.g. activating a game device or waiting for other players to join a multiplayer session
- A63F 2300/636: involving process of starting or resuming a game
- G06F 3/048: Interaction techniques based on graphical user interfaces [GUI]
- G06N 5/04: Inference or reasoning models
- G06Q 10/08: Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q 10/40: Business processes related to social networking or social networking services
- G06Q 30/0611: {Request for offers or quotes}
- G06Q 30/0631: {Recommending goods or services}
- G06T 15/005: {General purpose rendering architectures}
- G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- A63F: CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06K: GRAPHICAL DATA READING (image or video recognition or understanding G06V); PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A digital assistant (“Ann”) interacts with the owner's mobile device. He sees a product on a third party website. If she sells it cheaper, he buys from her. Ann gets more business. A non-owner near Ann cannot buy directly from her. He says he wants to buy on his device. Ann says an URL. His device decodes and shows the page from Ann. He buys from it. Ann gets more business. A user near Ann asks to analyse a news page on his device. She advises if the page is real or “fake news”. Two users with mobile devices near Ann use her to play a game, on website or app. A user uses a Virtual Reality device near Ann. He interacts with her via voice. She advises on what he sees and can do in the VR. Two digital assistants from different firms are near each other and a person with a mobile device. An assistant benchmarks itself against the other by passive and active means. Ann can have a barcode, that lets users pass information between her and their devices.

## Claims

### Claim at position 1

1: A system of a digital assistant (DA) device, a server on the Internet and a virtual reality (VR) device;
the DA is configured to connect to the server;
the DA is configured to make audio output;
the VR is configured to play a program experienced by a user;
the VR is configured to emit a first audio, encoding data about one or more of (a) the program, (b) a state of the user in the program;
the DA is configured to decode the first audio;
the DA is configured to send the data to the server;
the server is configured to analyze the data;
the server is configured to send the analysis to the DA;
the DA is configured to convert and emit the analysis as a second audio to be heard by the user.

### Claim at position 2 (depends on 1)

2: The system of claim 1 where:
the VR is connected to the Internet;
the server is configured to query the VR on the Internet;
the VR is configured to provide an answer;
the server is configured to use the answer as an input into making the analysis.

### Claim at position 3 (depends on 1)

3: The system of claim 1 where:
the program shows a three dimensional world to the user;
the VR is configured to accept a command from the user to move the user or an avatar of the user through the world.

### Claim at position 4 (depends on 2)

4: The system of claim 2 where:
the DA is configured to decode an audio query from the user, to find a virtual item outside the VR;
the DA is configured to send the query to the server;
the server to configured to obtain the virtual item;
the server is configured to send the virtual item to the VR;
the VR is configured to let the user use the virtual item in the VR.

### Claim at position 5 (depends on 4)

5: The system of claim 4 where:
the server participates in an electronic auction to obtain the virtual item.

### Claim at position 6 (depends on 5)

6: The system of claim 5 where:
the server is the winning bidder in the auction.

### Claim 7 (depends on 4)

The system of claim 4 where:
the server has an inventory of items;
the server is configured to search the inventory;
the server finds the desired virtual item in the inventory.

### Claim at position 8 (depends on 4)

8: The system of claim 4 where:
the server is configured to sell the virtual item to the user.

### Claim at position 9

9: A system of a digital assistant (DA) device, a server on the Internet and a virtual reality (VR) device;
the DA is configured to connect to the server;
the DA is configured to make audio output;
the VR is connected to the Internet;
the VR is configured to play a program experienced by a user;
the server is configured to connect to the VR on the Internet;
the server is configured to obtain, from the VR, data about one or more of (a) the program, (b) a state of the user in the program;
the server is configured to analyze the data;
the server is configured to send the analysis to the DA;
the DA is configured to convert and emit the analysis as a first audio to be heard by the user.

### Claim at position 10 (depends on 9)

10: The system of claim 9, where:
the program shows a three dimensional world to the user;
the VR is configured to accept a command from the user to move the user or an avatar of the user through the world.

### Claim at position 11 (depends on 9)

11: The system of claim 9 where:
the DA is configured to decode an audio query from the user, to find a virtual item outside the VR;
the DA is configured to send the query to the server;
the server to configured to obtain the virtual item;
the server is configured to send the virtual item to the VR;
the VR is configured to let the user use the virtual item in the VR.

### Claim at position 12 (depends on 11)

12: The system of claim 11 where:
the server participates in an electronic auction to obtain the virtual item.

### Claim at position 13 (depends on 12)

13: The system of claim 12 where:
the server is the winning bidder in the auction.

### Claim at position 14 (depends on 11)

14: The system of claim 11 where:
the server has an inventory of items;
the server is configured to search the inventory;
the server finds the desired virtual item in the inventory.

### Claim at position 15 (depends on 11)

15: The system of claim 11 where:
the server is configured to sell the virtual item to the user.

### Claim at position 16 (depends on 9)

16: The system of claim 9 where:
the DA is configured to decode a second audio from the user, into a command;
the DA is configured to send the command to the server;
the server is configured to send the command to the VR;
the VR is configured to execute the command, to change the images shown to the user.
