# US 10,375,224 B2 · System, a computer readable medium, and a method for providing an integrated management of message information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,375,224 B2 - Document ID: US10375224B2 - Status: Granted - Kind: B2 - Application number: 15/938,696 - Filed: 2018-03-28 - Published: 2018-10-04 - Granted: 2019-08-06 - Earliest claimed: 2017-03-30 - Assignees: NHN Entertainment Corporation - Applicants: NHN Entertainment Corporation - Inventors: Dong Wook Kim - Web page: https://patentgrep.com/patent/US10375224B2 ## CPC - H04M 1/72436: for text messaging, e.g. short messaging services [SMS] or e-mails - G06F 40/30: Semantic analysis - G06Q 10/1093: Calendar-based scheduling for persons or groups - G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit - H04L 51/02: using automatic reactions or user delegation, e.g. automatic replies or chatbot-generated messages - H04L 51/046: Interoperability with other network applications or services - H04L 51/216: Handling conversation history, e.g. grouping of messages in sessions or threads - H04L 51/56: Unified messaging, e.g. interactions between e-mail, instant messaging or converged IP messaging [CPM] - H04W 4/023: {using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds} - H04W 4/12: Messaging; Mailboxes; Announcements - G10L 2015/025: {Phonemes, fenemes or fenones being the recognition units} - H04M 1/72484: wherein functions are triggered by incoming communication events - H04M 2250/74: with voice recognition means - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - H04W: WIRELESS COMMUNICATION NETWORKS (broadcast communication H04H; communication systems using wireless links for non-selective communication, e.g. wireless extensions H04M1/72) ## Abstract A mobile device providing integrated management of message information and service provision through artificial intelligence is disclosed. The mobile device includes an integrated message management unit comprising a message monitoring unit configured to monitor voice call information and text message information in association with the voice call management part and the text message management part, a message information managing unit configured to generate integrated message information, which is to be provided to a user, based on the voice call information and the text message information, an interface managing unit configured to generate an integrated message management user interface displaying the integrated message information, and an artificial intelligence agent analyzing the voice call information and the text message information and providing a service associated with at least one additional function in association with the additional function process part based on the analyzed result. ## Claims ### Claim 1 A mobile communication device comprising: a voice call management part configured to manage all voice calls on the mobile communication device; a text message management part configured to manage all text messages exchanged with the mobile communication device through a mobile telephone switching network; a display part; an integrated message management unit; and an additional function process part configured to process at least one additional function in association with the integrated message management unit; wherein the integrated message management unit comprises: a message monitoring unit configured to monitor all voice call information and all text message information in association with the voice call management part and the text message management part; a message information managing unit configured to generate integrated message information, which is to be provided to a user, based on the voice call information and the text message information; an interface managing unit configured to generate an integrated message management user interface displaying the integrated message information; and an artificial intelligence agent configured for analyzing the voice call information and the text message information to produce an analyzed result, identifying a service other than generating a voice message or a text message based on the analyzed result, and providing the service by execution of the additional function process part based on the analyzed result, the artificial intelligence agent comprising: a speech act analysis module configured for performing morpheme analysis and speech act analysis on each text message to determine a purpose of the text message; a service response generating module configured for searching and providing a service corresponding to the purpose of the text message analyzed by the speech act analysis module; and a dialog tracking module configured for tracking a neighboring message following the text message, and managing a result of the speech act analysis and process of tracking the neighboring message, wherein the service response generating module generates schedule information when the speech act analysis module determines that the text message is related to an arrangement, wherein the service response generating module executes a schedule management application to register the schedule information when the purpose of the text message is notifying that a specific task is done at a specific time, wherein, when the purpose of the text message is determined as presenting a first proposal of a specific task at a specific time, the service response generating module temporarily stores the schedule information of the first proposal, and the dialog tracking module traces morpheme/speech act analysis on messages following the text message in association with the schedule information, and wherein repeating of the tracing morpheme/speech act analysis is limited to N times, wherein N is a natural number. ### Claim 2 (depends on 1) The mobile communication device of claim 1, wherein the service response generating module executes a schedule management application to register the temporarily stored schedule information when a consecutive message is determined as a consent to the first proposal. ### Claim 3 (depends on 1) The mobile communication device of claim 1, wherein, if it is determined that the message following the text message presents an alternative of an entity of the schedule information, the dialog tracking module updates the schedule information based on the alternative, temporarily stores the updated schedule information in a memory, and traces morpheme/speech act analysis on messages following the messages including the alternative in association with the schedule information. ### Claim 4 (depends on 3) The mobile communication device of claim 3, wherein the service response generating module executes a schedule management application to register the temporarily stored schedule information when a message following message including an alternative is determined as a consent to the alternative. ### Claim 5 (depends on 1) The mobile communication device of claim 1, wherein when the purpose of the text message is determined as presenting a first proposal of a specific task without specifying time, the service response generating module temporarily stores the schedule information of the first proposal, and the dialog tracking module traces morpheme/speech act analysis on messages following the text message in association with the schedule information. ### Claim 6 (depends on 5) The mobile communication device of claim 5, wherein when it is determined that a messages following the text message specifies time for the task, the dialog tracking module updates the schedule information based on the specified time, temporarily stores the updated schedule information in a memory, and traces morpheme/speech act analysis on messages following the messages including an alternative in association with the schedule information. ### Claim 7 (depends on 6) The mobile communication device of claim 6, wherein the service response generating module executes a schedule management application to register the temporarily stored schedule information when a message following message specifying time is determined as a consent to the specified time. ### Claim 8 (depends on 6) The mobile communication device of claim 6, wherein, if it is determined that the message following the message specifying time presents an alternative of an entity of the updated schedule information, the dialog tracking module updates the schedule information based on the alternative, temporarily stores the updated schedule information in the memory, and traces morpheme/speech act analysis on messages following the message including the alternative in association with the schedule information. ### Claim 9 (depends on 8) The mobile communication device of claim 8, wherein the service response generating module executes a schedule management application to register the temporarily stored schedule information when a message following message including the alternative is determined as a consent to the alternative. ### Claim 10 (depends on 1) The mobile communication device of claim 1, wherein, if the schedule information does not include a place, the service response generating module searches for a relevant place referring to a task of the schedule information and provides a search result. ### Claim 11 (depends on 10) The mobile communication device of claim 10, wherein the service response generating module performs morpheme analysis and speech act analysis on messages to search for a relevant place. ### Claim 12 (depends on 10) The mobile communication device of claim 10, wherein the service response generating module uses location information of the user and counterpart information to search for a relevant place. ### Claim 13 (depends on 1) The mobile communication device of claim 1, wherein the artificial intelligence agent is further configured to: receive voice call information of a missed incoming voice call from the voice call management part; identify the calling party from the received voice call information; analyze a conversation history of text messages exchanged between the identified calling party and the user to determine a level of tone used for a response; generate a response message based on the determined level of tone; and transmit the generated response message to a mobile device of the calling party. ### Claim 14 A method, performed by an artificial agent of a mobile device of a user, for creating a schedule based on analysis of incoming and outgoing message, the method comprising: performing a morpheme analysis and a speech act analysis on a conversation comprising messages exchanged between the mobile device and a second mobile device; determining whether the conversation comprises a first message for arranging a schedule; extracting entities constituting the schedule from the first message to generate schedule information and temporarily storing the schedule information; determining whether the first message is a notification of a fixed schedule using a result of the morpheme analysis and speech act analysis; and registering the schedule information when the first message is determined as a notification of a fixed schedule, and when the first message is not determined as a notification of a fixed schedule, further comprising: determining whether the first message is a proposal of a specific task at a specific time; performing morpheme analysis and speech act analysis on a second message following the first message to determine whether a consent to the first message when the first message is determined as a proposal of a specific task at a specific time; registering the schedule information when it is determined that the second message include a consent to the first message; determining whether the second message is a presentation of an alternative for the temporarily stored schedule information; updating the temporarily stored schedule information based on the alternative when the second message is determined as a presentation of an alternative; and performing morpheme analysis and speech act analysis on messages following the second message to determine whether a consent to the second message, wherein repeating of the morpheme analysis and speech act analysis is limited to N times, wherein N is a natural number. ### Claim 15 (depends on 14) The method of claim 14, wherein the step of registering the schedule information comprises: executing a schedule management application; and registering the schedule information into the schedule management application. ### Claim 16 (depends on 14) The method of claim 14, wherein the step of registering the schedule information comprises: generating a graphical user interface for receiving a user input confirming the generated schedule information; receiving a user input confirming the generated schedule information through the graphical user interface; executing a schedule management application; and registering the schedule information into the schedule management application. ### Claim 17 (depends on 14) The method of claim 14 further comprising: searching a relevant place referring to task of the schedule information wherein when the schedule information does not include a place to obtain a search result; and providing the search result to the user. ### Claim 18 (depends on 17) The method of claim 17, wherein the searching a relevant place is performed using morpheme analysis and speech act analysis on messages. ### Claim 19 (depends on 17) The method of claim 17, wherein the searching a relevant place is performed using location information of the user and counterpart information.