# US 9,519,345 B2 · Computing device with force-triggered non-visual responses > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,519,345 B2 - Document ID: US9519345B2 - Status: Granted - Kind: B2 - Application number: 14/863,912 - Filed: 2015-09-24 - Published: 2016-01-14 - Granted: 2016-12-13 - Earliest claimed: 2012-10-24 - Assignees: Google Inc. - Applicants: Google Inc. - Inventors: Ullas Gargi; Richard Carl Gossweiler, III - Web page: https://patentgrep.com/patent/US9519345B2 ## CPC - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 16/90332: {Natural language query formulation or dialogue systems} - G06F 16/951: Indexing; Web crawling techniques - G06F 16/9537: Spatial or temporal dependent retrieval, e.g. spatiotemporal queries - G06F 2200/1636: Sensing arrangement for detection of a tap gesture on the housing - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract In one example, a method includes receiving, by a computing device, an indication of a detected force applied to the computing device. The method further comprises determining, by the computing device, that the detected force matches a corresponding input that the computing device associates with a corresponding function that is executable by the computing device. The method further comprises generating, by the computing device and in response to determining that the detected force matches the corresponding input and, a non-visual output based on the corresponding function. ## Claims ### Claim 1 A method comprising: receiving, by a computing device, an indication of a detected force applied to the computing device; determining, by the computing device, that the detected force matches a corresponding input that the computing device associates with a corresponding function executable by the computing device; receiving, by the computing device, a speech input; responsive to determining that the detected force matches the corresponding input, performing, by the computing device, a speech-to-text function to generate text based at least in part on the speech input; providing, by the computing device, the text to an application that performs the corresponding function based at least in part on the text; and generating, by the computing device and based at least in part on performance of the corresponding function by the application, an audio output. ### Claim 2 (depends on 1) The method of claim 1, further comprising: determining, by the computing device, that the detected force is applied to the computing device while a presence-sensitive display operatively connected to the computing device is in a deactivated state; and generating, by the computing device and in response to determining that the detected force matches the corresponding input and that the detected force is applied to the computing device while the presence-sensitive display is in the deactivated state, the audio output. ### Claim 3 (depends on 1) The method of claim 1, further comprising receiving, by the computing device, the indication of the detected force from a sensor operatively connected to the computing device, the sensor comprising at least one of an accelerometer, a compression sensor, or an acoustic sensor. ### Claim 4 (depends on 1) The method of claim 1, wherein determining that the detected force matches the corresponding input that the computing device associates with the corresponding function executable by the computing device comprises determining a strength and a duration of the detected force. ### Claim 5 (depends on 1) The method of claim 1, further comprising: receiving, by the computing device, an indication of one or more additional inputs within a defined interval of time of receiving the indication of the detected force applied to the computing device, wherein generating the audio output by the computing device is also based at least in part on the one or more additional inputs. ### Claim 6 (depends on 5) The method of claim 5, wherein the one or more additional inputs comprise at least one of: an input from a position sensor indicating at least one of a position or a velocity of the computing device; an input from a network interface indicating at least one of the position or the velocity of the computing device; an input from a Global Positioning System interface indicating at least one of the position or the velocity of the computing device; an input from a light sensor indicating a level of light; or an input from a magnetic field sensor indicating at least one of the velocity or an orientation of the computing device. ### Claim 7 (depends on 1) The method of claim 1, wherein the text comprises a text query, wherein the corresponding function performed by the application comprises a search, and wherein generating the audio output comprises generating speech output of at least one result of the search performed by the application. ### Claim 8 (depends on 7) The method of claim 7, further comprising: determining, by the computing device, a current location based at least in part on one or more position sensors, wherein the search comprises a location-based search based at least in part on the text query and on the current location. ### Claim 9 A computing device, comprising: at least one processor; at least one sensor; and a non-transitory computer-readable storage medium communicatively coupled to the at least one processor, wherein the computer-readable storage medium stores instructions that, when executed, cause the at least one processor to: receive, from the at least one sensor, an indication of a detected force applied to the computing device; determine that the detected force matches a corresponding input that the at least one processor associates with a corresponding function executable by the at least one processor; receive a speech input; responsive to determining that the detected force matches the corresponding input, perform a speech-to-text function to generate text based at least in part on the speech input; provide the text to an application that performs the corresponding function based at least in part on the text; and generate, based at least in part on performance of the corresponding function by the application, an audio output. ### Claim 10 (depends on 9) The computing device of claim 9, wherein the instructions stored by the computer-readable storage medium further cause the at least one processor to: determine that the detected force is applied to the computing device while a presence-sensitive display operatively connected to the computing device is in a deactivated state; and generate, in response to determining that the detected force matches the corresponding input and that the detected force is applied to the computing device while the presence-sensitive display is in the deactivated state, the audio output. ### Claim 11 (depends on 9) The computing device of claim 9, wherein the at least one sensor comprises one or more of an accelerometer, a compression sensor, or an acoustic sensor. ### Claim 12 (depends on 9) The computing device of claim 9, wherein the instructions stored by the computer-readable storage medium cause the at least one processor to determine that the detected force matches the corresponding input that the computing device associates with the corresponding function executable by the computing device at least by determining a strength and a duration of the detected force. ### Claim 13 (depends on 9) The computing device of claim 9, wherein the instructions stored by the computer-readable storage medium further cause the at least one processor to: receive an indication of one or more additional inputs within a defined interval of time of receiving the indication of the detected force applied to the computing device, wherein generating the audio output by the computing device is also based at least in part on the one or more additional inputs. ### Claim 14 (depends on 9) The computing device of claim 9, wherein the text comprises a text query, wherein the corresponding function performed by the application comprises a search, and wherein the instructions stored by the computer-readable storage medium cause the at least one processor to generate the audio output at least by generating speech output of at least one result of the search performed by the application. ### Claim 15 A non-transitory computer-readable storage medium comprising instructions that are executable by at least one processor of a computing device to perform operations comprising: receiving an indication of a detected force applied to the computing device; determining that the detected force matches a corresponding input that the computing device associates with a corresponding function executable by the computing device; receiving a speech input; responsive to determining that the detected force matches the corresponding input, performing a speech-to-text function to generate text based at least in part on the speech input; providing the text to an application that performs the corresponding function based at least in part on the text; and generating, based at least in part on performance of the corresponding function by the application, an audio output. ### Claim 16 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the operations further comprise: determining that the detected force is applied to the computing device while a presence-sensitive display operatively connected to the computing device is in a deactivated state; and generating, in response to determining that the detected force matches the corresponding input and that the detected force is applied to the computing device while the presence-sensitive display is in the deactivated state, the audio output. ### Claim 17 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the operations further comprise receiving the indication of the detected force from a sensor operatively connected to the computing device, the sensor comprising at least one of an accelerometer, a compression sensor, or an acoustic sensor. ### Claim 18 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein determining that the detected force matches the corresponding input that the computing device associates with the corresponding function executable by the computing device comprises determining a strength and a duration of the detected force. ### Claim 19 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the operations further comprise: receiving an indication of one or more additional inputs within a defined interval of time of receiving the indication of the detected force applied to the computing device, wherein generating the audio output by the computing device is also based at least in part on the one or more additional inputs. ### Claim 20 (depends on 15) The non-transitory computer-readable storage medium of claim 15, wherein the text comprises a text query, wherein the corresponding function performed by the application comprises a search, and wherein generating the audio output comprises generating speech output of at least one result of the search performed by the application.