# US 10,503,255 B2 · Haptic feedback assisted text manipulation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,503,255 B2 - Document ID: US10503255B2 - Status: Granted - Kind: B2 - Application number: 12/958,705 - Filed: 2010-12-02 - Published: 2012-06-07 - Granted: 2019-12-10 - Earliest claimed: 2010-12-02 - Assignees: Immersion Corporation - Applicants: Christophe Ramstein; David Birnbaum - Inventors: Christophe Ramstein; David Birnbaum - Web page: https://patentgrep.com/patent/US10503255B2 ## CPC - G06F 3/016: {Input arrangements with force or tactile feedback as computer generated output to the user} - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 40/166: Editing, e.g. inserting or deleting - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A system with a touchscreen generates haptic effects in response to a manipulation of text displayed on the touchscreen. The system senses a touch within the text, and determines if the touch is a manipulation of the text, and determines the type of the manipulation. The system then generates a type of haptic event that is based at least in part on the type of the manipulation that was determined. ## Claims ### Claim 1 A non-transitory computer readable medium having instructions stored thereon that, when executed by a processor, cause the processor to provide haptic feedback on a device comprising a touchscreen, the haptic feedback comprising: displaying dynamically generated text comprising a plurality of characters comprising graphical objects; sensing a touch by a user's finger within the dynamically generated text; determining if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and while the finger is being slid across the dynamically generated text and is performing the task, generating a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding; wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation. ### Claim 2 (depends on 1) The non-transitory computer readable medium of claim 1, wherein the manipulation comprises a selection of the dynamically generated text. ### Claim 3 (depends on 1) The non-transitory computer readable medium of claim 1, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text. ### Claim 4 (depends on 1) The non-transitory computer readable medium of claim 1, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text. ### Claim 5 (depends on 2) The non-transitory computer readable medium of claim 2, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a first haptic event is generated for each of the characters, the word, the sentence, and the paragraph. ### Claim 6 (depends on 1) The non-transitory computer readable medium of claim 1, wherein types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration. ### Claim 7 (depends on 1) The non-transitory computer readable medium of claim 1, further comprising: determining a portion of the dynamically generated text that is blocked by the touch; and generating and displaying a magnification window that includes the portion of the dynamically generated text. ### Claim 8 (depends on 1) The non-transitory computer readable medium of claim 1, wherein the type of haptic event is based at least on a speed of the sliding. ### Claim 9 (depends on 8) The non-transitory computer readable medium of claim 8, wherein if the speed is a first amount, a first type of haptic event provides an individual character feeling, and if the speed is a second amount greater than the first amount, a second type of haptic event provides an individual word feeling. ### Claim 10 (depends on 1) The non-transitory computer readable medium of claim 1, wherein determining the type of the manipulation comprises determining if a point of interest of the dynamically generated text is touched, and wherein the point of interest comprises at least one of a name of a contact, a telephone number, and or an address. ### Claim 11 (depends on 2) The non-transitory computer readable medium of claim 2, wherein the type of haptic event is based at least on an availability of operations for the selected dynamically generated text. ### Claim 12 (depends on 11) The non-transitory computer readable medium of claim 11, wherein the availability of operations comprises at least one of cut, copy, paste or insert. ### Claim 13 (depends on 12) The non-transitory computer readable medium of claim 12, wherein the haptic event generated in response to the availability of the paste comprises a strength based on a volume of selected dynamically generated text. ### Claim 14 A computer implemented method for providing haptic feedback on a device comprising a touchscreen, the method implemented by a processor and comprising: displaying dynamically generated text comprising a plurality of characters comprising graphical objects; sensing by the processor a touch by a user's finger within the dynamically generated text; determining by the processor if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and while the finger is being slid across the dynamically generated text and is performing the task, generating by the processor a type of haptic event based at least in part on the type of the manipulation, wherein the haptic event generates the haptic feedback that is applied to the finger during the sliding; wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation. ### Claim 15 (depends on 14) The method of claim 14, wherein the manipulation comprises a selection of the dynamically generated text. ### Claim 16 (depends on 14) The method of claim 14, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text. ### Claim 17 (depends on 14) The method of claim 14, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text. ### Claim 18 (depends on 15) The method of claim 15, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a different type of haptic event is generated for each of the characters, the word, the sentence, and the paragraph. ### Claim 19 (depends on 14) The method of claim 14, wherein different types of haptic events are generated by varying one or more of an amplitude, a time duration, or a frequency of a vibration. ### Claim 20 (depends on 14) The method of claim 14, further comprising: determining a portion of the dynamically generated text that is blocked by the touch; and generating and displaying a magnification window that includes the portion of the dynamically generated text. ### Claim 21 (depends on 14) The method of claim 14, wherein the type of haptic event is based at least on a speed of the sliding. ### Claim 22 An apparatus comprising: a processor; a non-transitory memory coupled to the processor and storing instructions; a touchscreen coupled to the processor; an actuator coupled to the processor; wherein the instructions, when executed by the processor, cause the apparatus to: dynamically generate text from a word processing application executed by the processor; display the dynamically generated text comprising a plurality of characters comprising graphical objects; sense a touch by a user's finger within the dynamically generated text; determine if the touch is a manipulation of the dynamically generated text and determining a type of the manipulation, wherein determining the type of the manipulation comprises determining if a point of interest of the dynamically generated text is touched, and wherein the manipulation of the dynamically generated text comprises performing a task on the dynamically generated text using the touch, wherein the task comprises sliding the finger across the dynamically generated text and moving at least one of the characters within the dynamically generated text via the sliding; and while the finger is being slid across the dynamically generated text and is performing the task, generate a type of haptic event with the actuator based at least in part on the type of the manipulation, wherein the haptic event generates a haptic feedback that is applied to the finger during the sliding; wherein each type of manipulation includes the moving of at least one of the characters, and a first type of manipulation comprises moving a word within the dynamically generated text, and a second type of manipulation comprises moving a graphical object, and wherein the type of haptic event is one of a plurality of different types of haptic events each being associated with a corresponding one of the different types of manipulation. ### Claim 23 (depends on 22) The apparatus of claim 22, wherein the manipulation comprises a selection of the dynamically generated text. ### Claim 24 (depends on 22) The apparatus of claim 22, wherein a third type of manipulation comprises moving a cursor within the dynamically generated text. ### Claim 25 (depends on 22) The apparatus of claim 22, wherein the manipulation comprises copying, moving, and pasting the dynamically generated text. ### Claim 26 (depends on 23) The apparatus of claim 23, wherein the selection of the dynamically generated text comprises one of selecting one of the characters, a word, a sentence, or a paragraph, and a different type of haptic event is generated for each of the characters, the word, the sentence, and the paragraph. ### Claim 27 (depends on 1) The computer readable medium of claim 1, wherein determining the type of the manipulation comprises determining if the dynamically generated text comprises a semantic annotation. ### Claim 28 (depends on 1) The computer readable medium of claim 1, further comprising: sensing a second touch within an image having a background and a foreground, wherein the touch traverses the foreground to the background; generating a haptic event when the second touch moves to the background. ### Claim 29 (depends on 2) The computer readable medium of claim 2, wherein the selection of the dynamically generated text comprises selecting an item comprising a word, sentence or paragraph, and the haptic event is generated when the touch reaches an end of the item. ### Claim 30 (depends on 1) The computer readable medium of claim 1, wherein types of haptic events are generated by at least one of a vibration, a local deformation of a surface, or a change of friction.