# US 2021/0279232 A1 · Chatbot Search System, Chatbot Search Method, and Program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279232 A1
- Document ID: US20210279232A1
- Status: Published application
- Kind: A1
- Application number: 16/592,896
- Filed: 2019-04-12
- Published: 2021-09-09
- Earliest claimed: 2018-04-16
- Assignees: JE International Corporation
- Applicants: JE International Corporation
- Inventors: Minsu Kim
- Web page: https://patentgrep.com/patent/US20210279232A1

## CPC

- G06F 16/245: Query processing
- G06F 11/34: Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation {; Recording or statistical evaluation of user activity, e.g. usability assessment}
- G06F 13/00: Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units (interface circuits for specific input/output devices G06F3/00 {; multiprogram control therefor G06F9/46}; multiprocessor systems G06F15/16 )
- G06N 20/00: Machine learning
- H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages
- H04L 51/216: Handling conversation history, e.g. grouping of messages in sessions or threads
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)

## Abstract

A search system has the following configuration. A chatbot information collection unit collects log information recorded by associating exchange of a text with a terminal device with date and time information from a chatbot server device that provides a chat service by automatically generating a response text and transmitting the response text to the terminal device. An evaluation and measurement unit generates evaluation information of the chatbot server device to write the evaluation information to an evaluation information storage unit on the basis of the evaluation information storage unit configured to store the evaluation information of the chatbot server device and the log information. A search unit reads the evaluation information of the chatbot server device matching a search condition from the evaluation information storage unit and outputs information of the chatbot server device in an order based on the evaluation information.

## Claims

### Claim 1

A chatbot search system comprising:
a chatbot information collection unit configured to collect log information recorded by associating exchange of a text with a terminal device in a chatbot server device with date and time information from the chatbot server device that provides a chat service by automatically generating a response text in accordance with a text transmitted from the terminal device of a user and transmitting the response text to the terminal device;
a log information storage unit configured to store the log information;
an evaluation information storage unit configured to store evaluation information of the chatbot server device;
an evaluation and measurement unit configured to generate the evaluation information of the chatbot server device on the basis of the log information and write the evaluation information to the evaluation information storage unit; and
a search unit configured to read the evaluation information of the chatbot server device matching a search condition from the evaluation information storage unit on the basis of the search condition that has been input and output information of the chatbot server device in an order based on the evaluation information.

### Claim 2 (depends on 1)

The chatbot search system according to claim 1, wherein the evaluation and measurement unit evaluates reliability of the chatbot server device by analyzing a chat text included in the log information and writes the reliability as the evaluation information of the chatbot server device to the evaluation information storage unit.

### Claim 3 (depends on 2)

The chatbot search system according to claim 2,
wherein the evaluation and measurement unit evaluates the reliability by incrementing the number of positive evaluation points and the number of negative evaluation points on the basis of the text and the response text, and
wherein the evaluation and measurement unit accumulates a learning shortage response example which is an example of a response sentence in advance when an amount of learning in the chatbot server device is insufficient and increments the number of negative evaluation points in relation to the chatbot server device when the text output by the chatbot server device corresponds to the learning shortage response example.

### Claim 4 (depends on 1)

The chatbot search system according to claim 1, wherein the evaluation and measurement unit calculates the number of users per unit time for the chatbot server device on the basis of the log information and writes the number of users per unit time as the evaluation information of the chatbot server device to the evaluation information storage unit.

### Claim 5 (depends on 1)

The chatbot search system according to claim 1, wherein the evaluation and measurement unit calculates average usage time of the user in the chatbot server device on the basis of the log information and writes the average usage time of the user as the evaluation information of the chatbot server device to the evaluation information storage unit.

### Claim 6 (depends on 1)

The chatbot search system according to claim 1,
wherein the chatbot server device performs a process of performing machine learning based on content data in advance and automatically generating the response text in correspondence with the text transmitted from the terminal device of the user on the basis of a result of the machine learning,
wherein the chatbot information collection unit collects the content data from the chatbot server device, and
wherein the search unit selects the chatbot server device on the basis of a degree of matching between the content data collected by the chatbot information collection unit and the search condition and outputs a selection result.

### Claim 7 (depends on 1)

The chatbot search system according to claim 1,
wherein the chatbot server device holds field information indicating a field of the chat service to be provided,
wherein the chatbot information collection unit collects the field information from the chatbot server device, and
wherein the search unit selects the chatbot server device on the basis of a degree of matching between the field information collected by the chatbot information collection unit and field information included in the search condition and outputs a selection result.

### Claim 8 (depends on 1)

The chatbot search system according to any one of claim 1, further comprising a search interface unit configured to receive a search condition extracted from the text by a first chatbot server device from the first chatbot server device when the first chatbot server device provides the chat service to the terminal device, transfer the received search condition to the search unit, receive information of a second chatbot server device corresponding to the search condition from the search unit, and return the information of the second chatbot server device to the first chatbot server device,
wherein the search unit outputs the information of the second chatbot server device based on the search condition to the search interface unit when the search condition has been transferred from the search interface unit.

### Claim 9 (depends on 8)

The chatbot search system according to claim 8, wherein the search unit outputs the information of the chatbot server device and the information of the second chatbot server device to the search interface unit for the terminal device to simultaneously access both the chatbot server device and the second chatbot server device.

### Claim 10 (depends on 1)

The chatbot search system according to claim 1,
wherein the chatbot information collection unit collects the log information including information about sales results in the exchange of the text with the terminal device in the chatbot server device as a sales record in association with the date and time information,
wherein the evaluation information storage unit stores information obtained by aggregating the sales results based on the sales record as the evaluation information,
wherein the evaluation and measurement unit writes the information obtained by aggregating the sales results as the evaluation information to the evaluation information storage unit by performing a process of aggregating the sales results on the basis of the sales record within the log information, and
wherein the search unit outputs the information of the chatbot server device in an order based on the information obtained by aggregating the sales results.

### Claim 11

A chatbot search method comprising the steps of:
collecting, by a chatbot information collection unit, log information recorded by associating exchange of a text with a terminal device in a chatbot server device with date and time information from the chatbot server device that provides a chat service by automatically generating a response text in accordance with a text transmitted from the terminal device of a user and transmitting the response text to the terminal device;
writing the log information to a log information storage unit;
generating, by an evaluation and measurement unit, evaluation information of the chatbot server device on the basis of the log information and writing the evaluation information to the evaluation information storage unit; and
reading, by a search unit, the evaluation information of the chatbot server device matching a search condition from an evaluation information storage unit on the basis of the search condition that has been input and outputting information of the chatbot server device in an order based on the evaluation information.

### Claim 12

A program for causing a computer to execute the steps of:
collecting, by a chatbot information collection unit, log information recorded by associating exchange of a text with a terminal device in a chatbot server device with date and time information from the chatbot server device that provides a chat service by automatically generating a response text in accordance with a text transmitted from the terminal device of a user and transmitting the response text to the terminal device;
writing the log information to a log information storage unit;
generating, by an evaluation and measurement unit, evaluation information of the chatbot server device on the basis of the log information and writing the evaluation information to an evaluation information storage unit; and
reading, by a search unit, the evaluation information of the chatbot server device matching a search condition from the evaluation information storage unit on the basis of the search condition that has been input and outputting information of the chatbot server device in an order based on the evaluation information.
