# US 2021/0240403 A1 · Converting voice command into text code blocks that support printing services

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0240403 A1
- Document ID: US20210240403A1
- Status: Published application
- Kind: A1
- Application number: 17/049,718
- Filed: 2018-10-11
- Published: 2021-08-05
- Earliest claimed: 2018-05-31
- Assignees: Hewlett-Packard Development Company, L.P.
- Applicants: Hewlett-Packard Development Company, L.P.
- Inventors: Sung Jin PARK
- Web page: https://patentgrep.com/patent/US20210240403A1

## CPC

- G06F 3/1205: {resulting in increased flexibility in print job configuration, e.g. job settings, print requirements, job tickets}
- G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F 3/1222: {Increasing security of the print job}
- G06F 3/1236: {Connection management}
- G06F 3/1275: {Print workflow management, e.g. defining or changing a workflow, cross publishing}
- G06F 3/1289: {in server-client-printer device configuration, e.g. the server does not see the printer}
- G06F 3/1292: {Mobile client, e.g. wireless printing}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06F 21/32: using biometric data, e.g. fingerprints, iris scans or voiceprints
- G06F 21/608: {Secure printing}
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L 17/24: the user being prompted to utter a password or a predefined phrase
- G06F 3/122: {with regard to computing resources, e.g. memory, CPU}
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

A cloud server for converting a voice command into text code blocks that support a printing service is presented. The cloud server includes a communicator, a processor, and a memory storing instructions executable by the processor. The processor executes the instructions to convert a voice command received from a user terminal through the communicator into text code blocks supporting a printing service and to control the communicator to transmit the text code blocks to the user terminal.

## Claims

### Claim 1

A cloud server comprising:
a communicator;
a processor; and
a memory to store instructions executable by the processor,
wherein the processor executes the instructions to:
convert a voice command received from a user terminal through the communicator into text code blocks supporting a printing service, and control the communicator to transmit the text code blocks to the user terminal.

### Claim 2 (depends on 1)

The cloud server of claim 1, wherein the processor further executes the instructions to:
analyze a relationship between the received voice command and a previous voice command,
determine a context of a printing job according to a request of the user terminal, and
convert the received voice command into the text code blocks based on the context.

### Claim 3 (depends on 1)

The cloud server of claim 1, wherein the processor further executes the instructions to convert the received voice command into the text code blocks based on an instructions mapping table specialized for the printing service.

### Claim 4 (depends on 1)

The cloud server of claim 1, wherein the processor further executes the instructions to convert the received voice command into the text code blocks based on a learned language habit of a user.

### Claim 5 (depends on 1)

The cloud server of claim 1, wherein the processor further executes the instructions to:
search for at least one text code block corresponding to a command that is similar to a command of the text code blocks in terms of pronunciation or function, and
control the communicator to transmit the found at least one text code block to the user terminal.

### Claim 6 (depends on 1)

The cloud server of claim 1, wherein the processor further executes the instructions to:
confirm whether voice passwords respectively received from the image forming apparatus and the user terminal that receives an advertising signal repeatedly transmitted by the image forming apparatus match each other, and
perform user authentication.

### Claim 7 (depends on 6)

The cloud server of claim 6, wherein the voice passwords respectively received from the image forming apparatus and the user terminal comprise sound information generated in the image forming apparatus and a keyword phrase spoken by a user, obtained by the image forming apparatus and the user terminal when the user terminal is located in a predetermined space with the image forming apparatus.

### Claim 8 (depends on 6)

The cloud server of claim 6, wherein, when the advertising signal comprises at least one of a Bluetooth low energy (BLE) beacon signal or a wireless fidelity (Wi-Fi) aware signal.

### Claim 9

A user terminal comprising:
a user interface device;
a communicator;
a processor; and
a memory storing instructions executable by the processor,
wherein the processor executes the instructions to:
transmit a voice command obtained from a user to a cloud server providing a printing service,
control the communicator to receive text code blocks converted from the voice command and supporting the printing service from the cloud server, and
control the user interface device to display the text code blocks on the user interface device.

### Claim 10 (depends on 9)

The user terminal of claim 9, wherein, in response to a user manipulation selecting one of the text code blocks, the user interface device displays at least one text code block corresponding to a command that is similar to a command of the selected text code block in terms of pronunciation or function below the selected text code block.

### Claim 11 (depends on 9)

The user terminal of claim 9, wherein, in response to a user manipulation moving one of the text code blocks, the user interface device changes and displays an order of the text code blocks according to a position of the moved text code block.

### Claim 12 (depends on 9)

The user terminal of claim 9, wherein, in response to a user manipulation to overlap any one of sets of text code blocks respectively corresponding to a plurality of voice commands with another set, the user interface device displays the overlapped sets as one merged set of text code blocks.

### Claim 13 (depends on 9)

The user terminal of claim 9, wherein the user interface device interacts with a user interface device of an image forming apparatus performing a printing job according to a request for execution of the user terminal and simultaneously processes multiple manipulations of a user for progress of the printing job with the user interface device of an image forming apparatus.

### Claim 14 (depends on 13)

The user terminal of claim 13,
wherein a real time interaction between the user interface device of the user terminal and the user interface device of the image forming apparatus is performed using a wireless local area network between the user terminal and the image forming apparatus, and
wherein printing data for the printing job is transmitted to the image forming apparatus through the cloud server.

### Claim 15 (depends on 9)

The user terminal of claim 9, wherein, when replaceable information is included in the text code blocks and corresponds to information stored in the user terminal, the replaceable information is replaced with the corresponding information stored in the user terminal as part of execution of the printing job and transmitted to the image forming apparatus through the cloud server.
