# US 9,521,234 B2 · Information processing apparatus, display control method and recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,521,234 B2 - Document ID: US9521234B2 - Status: Granted - Kind: B2 - Application number: 14/790,100 - Filed: 2015-07-02 - Published: 2016-01-07 - Granted: 2016-12-13 - Earliest claimed: 2014-07-07 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Michio Aizawa; Hitoshi Aoki - Web page: https://patentgrep.com/patent/US9521234B2 ## CPC - H04M 1/72403: with means for local support of applications that increase the functionality - G10L 15/20: Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech (G10L21/02 takes precedence) - G10L 17/22: Interactive procedures; Man-machine interfaces - H04M 1/72451: according to schedules, e.g. using calendar applications - H04M 2250/12: including a sensor for measuring a physical value, e.g. temperature or motion - H04M 2250/74: with voice recognition means - H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08) - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract The information processing apparatus performs a voice communication with a counterpart device which comprises a voice communication function through a voice communication unit. The information processing apparatus performs voice recognition processing of first voice and second voice, the first voice is the voice which is transmitted to the counterpart device by a voice communication through the voice communication unit, the second voice is the voice which is input from the counterpart device, and searches one or more applications according to a recognition result of the voice recognition unit. The information processing apparatus displays an object for starting the application searched on a display section. Thereby, the information processing apparatus prevents starting the application which is not intended by the user. ## Claims ### Claim 1 An information processing apparatus, comprising: a voice communication unit configured to perform a voice communication with a counterpart device which comprises a voice communication function; a voice recognition unit configured to perform voice recognition processing of a first voice and a second voice, the first voice is the voice which is transmitted to the counterpart device by a voice communication through the voice communication unit, and the second voice is the voice which is input from the counterpart device; a search unit configured to search one or more applications according to a recognition result of the voice recognition unit; a display control unit configured to display one or more objects for starting the one or more applications found by the search on a predetermined display section; and a determination unit configured to determine which of the first voice and the second voice should be given priority according to a state of the voice communication by the voice communication unit, wherein the display control unit is further configured to display the one or more objects on the display section in an order which is based on the determination by the determination unit. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the display control unit is further configured to overlappingly display the one or more objects on an execution screen of an application for performing the voice communication. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, further comprising: a storing unit for storing, for each one or more applications, at least one keyword related to the application, wherein the search unit is further configured to extract the keyword included in the recognition result of the voice recognition unit to search an application related to the keyword. ### Claim 4 (depends on 3) The information processing apparatus according to claim 3, wherein the determination unit is further configured to determine which of the first voice and the second voice should be given priority based on a value representing weight of the first voice and a value representing weight of the second voice, the information processing apparatus further comprising: a calculation unit configured to calculate a score for determining an order of display when displaying the one or more objects according to degree of relation between the keyword used for the search and the application searched, and the value representing the weight of the first voice or the value representing the weight of the second voice, wherein the display control unit is further configured to display the one or more objects on the display section in the order according to the score. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the determination unit is further configured to determine which of the first voice and the second voice should be given priority based on a value representing weight of the first voice and a value representing weight of the second voice. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the determination unit is further configured to give priority to the first voice over the second voice in a state of the voice communication where the first voice is not transmitted to the counterpart device. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the determination unit is further configured to give priority to the first voice over the second voice in a state of the voice communication where the second voice cannot be heard by a user of the information processing apparatus. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, further comprising: a proximity sensor for detecting a physical object which is brought closer to the information processing apparatus, wherein the determination unit is further configured to determine to give priority to the first voice over the second voice in a case where the proximity sensor detects an ear of a user of the information processing apparatus. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, further comprising: a noise measuring unit configured to measure ambient noise, wherein the determination unit is further configured to determine which of the first voice and the second voice should be given priority according to loudness of the noise. ### Claim 10 A method which is executed by an information processing apparatus comprising a voice communication unit for performing a voice communication with a counterpart device comprising a voice communication function, comprising: performing voice recognition processing of first voice and second voice, the first voice is the voice which is transmitted to the counterpart device by a voice communication through the voice communication unit, the second voice is the voice which is input from the counterpart device; searching one or more applications according to a recognition result of the voice recognition processing; displaying one or more objects for starting the one or more applications searched on a predetermined display section; and determining which of the first voice and the second voice should be given priority according to a state of the voice communication by the voice communication unit, wherein the one or more objects is displayed on the display section in an order which is based on the determining. ### Claim 11 (depends on 10) The method according to claim 10, wherein the information processing apparatus comprises a predetermined storing unit for storing, for each of the one or more applications, at least one keyword related to the application, further comprising: extracting the keyword included in the recognition result of the voice recognition processing and searching an application related to the keyword from the predetermined storing unit. ### Claim 12 (depends on 11) The method according to claim 11, further comprising: determining which of the first voice and the second voice should be given priority based on a value representing weight of the first voice and a value representing weight of the second voice: calculating, by the information processing apparatus, a score for determining an order of display when displaying the one or more objects according to degree of relation between the keyword used for the search and the application searched, and the value representing the weight of the first voice or the value representing the weight of the second voice; and displaying, by the information processing apparatus, the one or more objects on the display section in the order according to the score. ### Claim 13 (depends on 10) The method according to claim 10, further comprising: determining, by the information processing apparatus, which of the first voice and the second voice should be given priority according to a value representing weight of the first voice and a value representing weight of the second voice. ### Claim 14 (depends on 10) The display control method according to claim 10, comprising: determining, by the information processing apparatus, to give priority to the first voice over the second voice in a state of the voice communication where the first voice is not transmitted to the counterpart device, and determining, by the information processing apparatus, to give priority to the first voice over the second voice in a state of the voice communication where the second voice cannot be heard by a user of the information processing apparatus. ### Claim 15 (depends on 10) The method according to claim 10, wherein the information processing apparatus comprises a proximity sensor for detecting a physical object which is brought closer to the information processing apparatus, comprising: determining to give priority to the first voice over the second voice in a case where the proximity sensor detects an ear of a user of the information processing apparatus. ### Claim 16 (depends on 10) The method according to claim 10, wherein the information processing apparatus comprises a noise measuring unit configured to measure ambient noise, comprising: determining which of the first voice and the second voice should be given priority according to loudness of the noise. ### Claim 17 A computer readable non-transient storage medium containing a computer program for causing a computer, which has a voice communication unit for performing a voice communication with a counterpart device which comprises a voice communication function, to function as: a voice recognition unit configured to perform voice recognition processing of first voice and second voice, the first voice is the voice which is transmitted to the counterpart device by a voice communication through the voice communication unit, the second voice is the voice which is input from the counterpart device; a search unit configured to search one or more applications according to a recognition result of the voice recognition unit; a display control unit configured to display one or more objects for starting the one or more applications searched by the search unit on a predetermined display section; and a determination unit configured to determine which of the first voice and the second voice should be given priority according to a state of the voice communication by the voice communication unit, wherein the display control unit is further configured to display the one or more objects on the display section in an order which is based on determination by the determination unit.