# US 2016/0253992 A1 · Ocr through voice recognition > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0253992 A1 - Document ID: US20160253992A1 - Status: Published application - Kind: A1 - Application number: 14/633,875 - Filed: 2015-02-27 - Published: 2016-09-01 - Earliest claimed: 2015-02-27 - Assignees: Lenovo (Singapore) Pte. Ltd. - Applicants: Lenovo (Singapore) Pte. Ltd. - Inventors: Antoine Roland Raux; Grigori Zaitsev; Russell Speight VanBlon; Jianbang Zhang - Web page: https://patentgrep.com/patent/US20160253992A1 ## CPC - G06V 30/32: Digital ink - G10L 15/32: Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems - G10L 25/48: specially adapted for particular use - G06V 30/2552: {Combination of methods, e.g. classifiers, working on different input data, e.g. sensor fusion} - G10L 2015/226: {using non-speech characteristics} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract One embodiment provides a method, including: receiving, at an input and display device, handwriting input; receiving, using a processor, voice input; generating, using a processor, at least one first word based on the handwriting input; generating, using a processor, at least one second word based on the voice input; and determining, using a processor, a highest probability word based on the at least one first word and the at least one second word. Other aspects are described and claimed. ## Claims ### Claim 1 A method, comprising: receiving, at an input and display device, handwriting input; receiving, using a processor, voice input; generating, using a processor, at least one first word based on the handwriting input; generating, using a processor, at least one second word based on the voice input; and determining, using a processor, a highest probability word based on the at least one first word and the at least one second word. ### Claim 2 (depends on 1) The method of claim 1, further comprising: displaying, on the input and display device, at least one high probability word prior to the handwriting input being complete. ### Claim 3 (depends on 2) The method of claim 2, further comprising: receiving user input selecting one of the at least one high probability words. ### Claim 4 (depends on 1) The method of claim 1, wherein the voice input comprises receiving a verbal representation of the handwriting input being substantially concurrently input. ### Claim 5 (depends on 1) The method of claim 1, wherein the voice input comprises receiving a general discussion relating to the handwriting input being substantially concurrently input. ### Claim 6 (depends on 1) The method of claim 1, wherein the voice input comprises receiving a lecture relating to the handwriting input being substantially concurrently input. ### Claim 7 (depends on 1) The method of claim 1, further comprising: storing, on a memory device, a recording of the voice input. ### Claim 8 (depends on 7) The method of claim 7, wherein the highest probability word is linked to a retrievable time in the recording of the voice input. ### Claim 9 (depends on 1) The method of claim 1, further comprising: weighting, using the processor, each of the words from the at least one first word based on a handwriting recognition score; and weighting, using the processor, each of the words from the at least one second word based on a voice recognition score. ### Claim 10 (depends on 9) The method of claim 9, wherein the highest probability word is determined using a combination of the weighting of the at least one first word and the at least one second word. ### Claim 11 An information handling device, comprising: an input device; a display device; an audio capture device; a processor; a memory device that stores instructions executable by the processor to: receive handwriting input; receive voice input; generate at least one first word based on the handwriting input; generate at least one second word based on the voice input; and determine a highest probability word based on the at least one first word and the at least one second word. ### Claim 12 (depends on 11) The information handling device of claim 11, further comprising: displaying, on the input and display device, at least one high probability words prior to the handwriting input being complete. ### Claim 13 (depends on 11) The information handling device of claim 11, wherein the voice input comprises receiving a verbal representation of the handwriting input being substantially concurrently input. ### Claim 14 (depends on 11) The information handling device of claim 11, wherein the voice input comprises receiving a general discussion relating to the handwriting input being substantially concurrently input. ### Claim 15 (depends on 11) The information handling device of claim 11, wherein the voice input comprises receiving a lecture relating to the handwriting input being concurrently input. ### Claim 16 (depends on 11) The information handling device of claim 11, further comprising: storing, on the memory device, a recording of the voice input. ### Claim 17 (depends on 16) The information handling device of claim 16, wherein the highest probability word is linked to a retrievable time in the recording of the voice input. ### Claim 18 (depends on 11) The information handling device of claim 11, further comprising: weighting, using the processor, each of the words from the at least one first word based on a handwriting recognition score; and weighting, using the processor, each of the words from the at least one second word based on a voice recognition score. ### Claim 19 (depends on 18) The information handling device of claim 18, wherein the highest probability word is determined using a combination of the weighting of the at least one first word and the at least one second word. ### Claim 20 A product, comprising: a storage device having code stored therewith, the code being executable by a processor and comprising: code that receives, at an input and display device, handwriting input; code that receives voice input; code that generates at least one first word based on the handwriting input; code that generates at least one second word based on the voice input; and code that determines a highest probability word based on the at least one first word and the at least one second word.