# US 2012/0075178 A1 · Apparatus and method for generating dynamic response

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0075178 A1
- Document ID: US20120075178A1
- Status: Published application
- Kind: A1
- Application number: 13/243,308
- Filed: 2011-09-23
- Published: 2012-03-29
- Earliest claimed: 2010-09-27
- Assignees: Samsung Electronics Co., Ltd.
- Inventors: Jeong Mi CHO; Jeong Su Kim; Byung Kwan Kwak; Chi Youn Park
- Web page: https://patentgrep.com/patent/US20120075178A1

## CPC

- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- H04N 21/42203: {sound input device, e.g. microphone}
- H04N 21/4223: Cameras (H04N23/00 takes precedence)
- G09G 2354/00: Aspects of interface with display user
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)

## Abstract

A dynamic response generating apparatus and method that may analyze an intention of a user based on user input information received from an inputting device, may analyze at least one of first response information with respect to the analyzed intention of the user, context information associated with the user input information, user motion information, and environmental information, may dynamically determine a modality with respect to the first response information, may process the first response information, and may dynamically generate second response information in a form of via the determined modality.

## Claims

### Claim 1

A dynamic response generating apparatus, the apparatus comprising:
a controller to control an operation of the dynamic generating apparatus;
an information receiving unit to receive user input information from an inputting device;
an analyzing unit to analyze an intention of a user based on the user input information;
a first response generating unit to generate first response information associated with the analyzed intention of the user;
a modality determining unit to dynamically determine a modality with respect to the first response information by analyzing at least one of the first response information, context information associated with the user input information, user motion information, and environmental information;
a second response generating unit to dynamically generate second response information in a form of the determined modality by processing the first response information; and
an outputting unit to output the second response information and a content in the form of the determined modality.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the inputting device includes at least one of a voice recognition device, an image recognition device, a text recognizing device, a motion recognition sensor, a temperature sensor, an illuminance sensor, and a humidity sensor.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the user input information includes at least one of a voice of the user, a motion of the user, a text, and an image inputted through the inputting device.

### Claim 4 (depends on 1)

The apparatus of claim 1, further comprising:
an application execution unit to execute an application corresponding to the intention of the user.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein, when a modality with respect to the user input information is directly received, the second response generating unit generates the second response information in a form of the directly received modality.

### Claim 6 (depends on 1)

The apparatus of claim 1, further comprising:
a situation analyzing unit to analyze a situation of the user to determine the modality based on at least one of the first response information, the context information, the user motion information, the environmental information, or combinations thereof.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the situation analyzing unit analyzes the situation of the user based on one of a type of the content and a playtime of the content.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the modality determining unit dynamically determines the modality by analyzing the situation of the user.

### Claim 9 (depends on 1)

The apparatus of claim 1, wherein the context information includes at least one of dialog context information and domain context information.

### Claim 10 (depends on 1)

The apparatus of claim 1, wherein the modality determining unit determines the modality by separately analyzing one of the first response information, the context information associated with the user input information, the user motion information, and environmental information.

### Claim 11 (depends on 1)

The apparatus of claim 1, wherein the modality determining unit determines the modality by analyzing together at least two of the first response information, the context information associated with the user input information, the user motion information, and environmental information.

### Claim 12 (depends on 11)

The apparatus of claim 11, wherein, when multiple modalities exist, the modality determining unit determines priorities with respect to the multiple modalities.

### Claim 13

A dynamic response generating method, the method comprising:
receiving user input information from an inputting device;
analyzing an intention of a user based on the user input information;
generating first response information associated with the analyzed intention of the user;
dynamically determining a modality with respect to the first response information by analyzing at least one of the first response information, context information associated with the user input information, user motion information, environmental information, or combinations thereof;
dynamically generating second response information in a form of the determined modality by processing the first response information; and
outputting the second response information and a content in the form of the determined modality.

### Claim 14 (depends on 13)

The method of claim 13, wherein, when a modality with respect to the user input information is directly received, the dynamically generating of the second response information comprises generating the second response information in a form of the directly received modality.

### Claim 15 (depends on 13)

The method of claim 13, further comprising:
analyzing a situation of the user to determine the modality based on at least one of the first response information, the context information, the user motion information, and the environmental information.

### Claim 16 (depends on 15)

The method of claim 15, wherein the determining of the modality comprises dynamically determining of the modality by analyzing the situation of the user.

### Claim 17 (depends on 13)

A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 13.
