# US 10,121,124 B2 · Information processing device, information processing method and program > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,121,124 B2 - Document ID: US10121124B2 - Status: Granted - Kind: B2 - Application number: 14/294,281 - Filed: 2014-06-03 - Published: 2015-01-08 - Granted: 2018-11-06 - Earliest claimed: 2013-07-02 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Yoshiki Takeoka; Atsushi Ishihara; Yoshinori Kurata; Hajime Senuma; Masayuki Takada; Shouichi Doi; Masahiro Morita - Web page: https://patentgrep.com/patent/US10121124B2 ## CPC - G06Q 10/1093: Calendar-based scheduling for persons or groups - G06Q 10/10: Office automation; Time management - G06Q 10/109: Time management, e.g. calendars, reminders, meetings or time accounting - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR ## Abstract There is provided an information processing device including a request transmitting portion that transmits a request, a response receiving portion that receives a response corresponding to the request, a response analyzing portion that analyzes the response, a text output portion that outputs, to the user, text generated based on the response analysis result, a request generating portion that newly generates the request based on the response analysis result or text input by the user, and a timing control portion that controls a timing at which the request is newly generated based on a timing at which the generated text is output. ## Claims ### Claim 1 An information processing device comprising: a display configured to display visual data including a graphical user interface (GUI); a touch sensor configured to receive user inputs within the GUI; a transceiver configured to communicate with a server; a microphone configured to acquire speech data of a user's uttered speech at the information processing device, wherein the speech data is an electronic signal that is based on sounds generated in a vicinity of the microphone, wherein the sounds include the user's uttered speech; and a processor configured to: generate a first request based on the speech data; transmit, using the transceiver, the first request from the information processing device to a client device via the server; receive, using the transceiver, a response based on the first request at the information processing device from the client device via the server; analyze the response based on at least one of a language analysis protocol and natural language processing of semantic content associated with the response; generate a text based on a result of the response analysis; output the text on the display of the information processing device; initiate a timer upon output of the text on the information processing device; determine if an intervening speech data is received via the microphone at the information processing device; wherein, when it is determined that the intervening speech data is received from the user of the information processing device prior to expiration of the timer, the processor is configured to generate a second request based on the intervening speech data, and transmit, using the transceiver, the second request to the client device via the server; and wherein, when it is determined that the intervening speech data is not received from the user of the information processing device prior to expiration of the timer, the processor is configured to generate a third request based on the result of the response analysis, and transmit, using the transceiver, the third request to the client device via the server. ### Claim 2 (depends on 1) The information processing device according to claim 1, wherein the processor is further configured to determine if an intervening text input is received via a user interface at the touch sensor at the information processing device prior to expiration of the timer. ### Claim 3 (depends on 2) The information processing device according to claim 2, wherein the processor is further configured to, when it is determined that the intervening text input is received from the user of the information processing device prior to expiration of the timer, generate and transmit a fourth request based on the intervening text input to the client device via the server. ### Claim 4 (depends on 3) The information processing device according to claim 3, wherein the processor is further configured to, when it is determined that the intervening text input is not received from the user of the information processing device prior to expiration of the timer, generate and transmit a fifth request based on the intervening text input to the client device via the server. ### Claim 5 (depends on 2) The information processing device according to claim 2, wherein the processor is further configured to initiate the timer based on the response analysis. ### Claim 6 (depends on 5) The information processing device according to claim 5, wherein the processor is further configured to initiate the timer when the response analysis includes negative content associated with a rejection of the first request. ### Claim 7 (depends on 5) The information processing device according to claim 5, wherein the processor is further configured to initiate the timer when the response analysis triggers the third request to include negative content associated with a rejection of the response. ### Claim 8 (depends on 1) The information processing device according to claim 1, wherein the processor is further configured to output the third request on the information processing device in addition to outputting the text on the information processing device. ### Claim 9 (depends on 1) The information processing device according to claim 1, wherein the processor is further configured to output the text as speech. ### Claim 10 (depends on 1) The information processing device according to claim 1, further comprising: a user interface configured to receive manual text input at the information processing device; and generate the first request based on the manual text input. ### Claim 11 (depends on 1) The information processing device according to claim 1, wherein the processor is further configured to generate the first request based on the speech data and first schedule information of the user of the information processing device, and wherein the response is generated at the client device based on second schedule information of a user at the client device. ### Claim 12 (depends on 11) The information processing device according to claim 11, wherein the processor is further configured to initiate the timer in a case of a conflict occurring between the request and the response based on the first schedule information and the second schedule information.