# US 9,436,381 B2 · Device, method, and graphical user interface for navigating and annotating an electronic document > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,436,381 B2 - Document ID: US9436381B2 - Status: Granted - Kind: B2 - Application number: 13/076,414 - Filed: 2011-03-30 - Published: 2012-07-26 - Granted: 2016-09-06 - Earliest claimed: 2011-01-24 - Assignees: Apple Inc. - Applicants: Charles J. Migos; Jay Christopher Capela; Markus Hagele; Diego Bauducco; Akiva D. Leffert; Britt S. Miura; Donald Rozinak Beaver - Inventors: Charles J. Migos; Jay Christopher Capela; Markus Hagele; Diego Bauducco; Akiva D. Leffert; Britt S. Miura; Donald Rozinak Beaver - Web page: https://patentgrep.com/patent/US9436381B2 ## CPC - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A device, configured to operate in a first operational mode at some times and in a second operational mode at other times, detects a first gesture having a first gesture type; in response to detecting the first gesture: in accordance with a determination that the device is in the first operational mode, performs an operation having a first operation type; and, in accordance with a determination that the device is in the second operational mode, performs an operation having a second operation type; detects a second gesture having a second gesture type; and in response to detecting the second gesture: in accordance with a determination that the device is in the first operational mode, performs an operation having the second operation type; and in accordance with a determination that the device is in the second operational mode, performs an operation having the first operation type. ## Claims ### Claim 1 A method, comprising: at an electronic device having a display and a touch-sensitive surface: displaying a document having a user-specified area annotated by highlighting that includes highlighting of a first type; detecting a contact at an initial contact location on the touch-sensitive surface that corresponds to an initial location on the display; detecting movement of the contact on the touch-sensitive surface; and, in response to detecting the movement of the contact on the touch-sensitive surface, in accordance with a determination that the initial location on the display is within the user-specified area annotated by highlighting, adding annotation with highlighting of a second type distinct from the first type to the user-specified area annotated by highlighting in accordance with the movement of the contact. ### Claim 2 (depends on 1) The method of claim 1, wherein the highlighting of the second type is coextensive with at least a portion of the highlighting of the first type. ### Claim 3 (depends on 1) The method of claim 1, wherein the highlighting of the second type replaces at least a portion of the highlighting of the first type. ### Claim 4 (depends on 1) The method of claim 1, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is outside of the user-specified area annotated by highlighting, adding a new user-specified area annotated by highlighting to the document in accordance with the detected movement of the contact. ### Claim 5 (depends on 4) The method of claim 4, wherein the new user-specified area annotated by highlighting is annotated with highlighting of the first type. ### Claim 6 (depends on 1) The method of claim 1, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is proximate to an edge of the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting in accordance with the detected movement instead of adding annotation with highlighting of the second type. ### Claim 7 (depends on 6) The method of claim 6, wherein: in accordance with a determination that the detected movement corresponds to movement on the display towards the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes contracting the user-specified area annotated by highlighting; and in accordance with a determination that the detected movement corresponds to movement on the display away from the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes expanding the user-specified area annotated by highlighting. ### Claim 8 An electronic device, comprising: a display; a touch-sensitive surface; one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: displaying a document having a user-specified area annotated by highlighting that includes highlighting of a first type; detecting a contact at an initial contact location on the touch-sensitive surface that corresponds to an initial location on the display; detecting movement of the contact on the touch-sensitive surface; and, in response to detecting the movement of the contact on the touch-sensitive surface, in accordance with a determination that the initial location on the display is within the user-specified area annotated by highlighting, adding annotation with highlighting of a second type distinct from the first type to the user-specified area annotated by highlighting in accordance with the movement of the contact. ### Claim 9 (depends on 8) The device of claim 8, wherein the highlighting of the second type is coextensive with at least a portion of the highlighting of the first type. ### Claim 10 (depends on 8) The device of claim 8, wherein the highlighting of the second type replaces at least a portion of the highlighting of the first type. ### Claim 11 (depends on 8) The device of claim 8, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is outside of the user-specified area annotated by highlighting, adding a new user-specified area annotated by highlighting to the document in accordance with the detected movement of the contact. ### Claim 12 (depends on 11) The device of claim 11, wherein the new user-specified area annotated by highlighting is annotated with highlighting of the first type. ### Claim 13 (depends on 8) The device of claim 8, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is proximate to an edge of the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting in accordance with the detected movement instead of adding annotation with highlighting of the second type. ### Claim 14 (depends on 13) The device of claim 13, wherein: in accordance with a determination that the detected movement corresponds to movement on the display towards the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes contracting the user-specified area annotated by highlighting; and in accordance with a determination that the detected movement corresponds to movement on the display away from the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes expanding the user-specified area annotated by highlighting. ### Claim 15 A graphical user interface on an electronic device with a display, a touch-sensitive surface, a memory, and one or more processors to execute one or more programs stored in the memory, the graphical user interface comprising: a document having a user-specified area annotated by highlighting that includes highlighting of a first type; wherein: a contact is detected at an initial contact location on the touch-sensitive surface that corresponds to an initial location on the display; movement of the contact on the touch-sensitive surface is detected; and, in response to detecting the movement of the contact on the touch-sensitive surface, in accordance with a determination that the initial location on the display is within the user-specified area annotated by highlighting, annotation with highlighting of a second type distinct from the first type is added to the user-specified area annotated by highlighting in accordance with the movement of the contact. ### Claim 16 A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device with a display and a touch-sensitive surface, cause the device to: display a document having a user-specified area annotated by highlighting that includes highlighting of a first type; detect a contact at an initial contact location on the touch-sensitive surface that corresponds to an initial location on the display; detect movement of the contact on the touch-sensitive surface; and, in response to detecting the movement of the contact on the touch-sensitive surface, in accordance with a determination that the initial location on the display is within the user-specified area annotated by highlighting, add annotation with highlighting of a second type distinct from the first type to the user-specified area annotated by highlighting in accordance with the movement of the contact. ### Claim 17 (depends on 16) The computer readable storage medium of claim 16, wherein the highlighting of the second type is coextensive with at least a portion of the highlighting of the first type. ### Claim 18 (depends on 16) The computer readable storage medium of claim 16, wherein the highlighting of the second type replaces at least a portion of the highlighting of the first type. ### Claim 19 (depends on 16) The computer readable storage medium of claim 16, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is outside of the user-specified area annotated by highlighting, adding a new user-specified area annotated by highlighting to the document in accordance with the detected movement of the contact. ### Claim 20 (depends on 19) The computer readable storage medium of claim 19, wherein the new user-specified area annotated by highlighting is annotated with highlighting of the first type. ### Claim 21 (depends on 16) The computer readable storage medium of claim 16, including, in response to detecting the movement of the initial contact on the touch-sensitive surface: in accordance with a determination that the initial location on the display is proximate to an edge of the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting in accordance with the detected movement instead of adding annotation with highlighting of the second type. ### Claim 22 (depends on 21) The computer readable storage medium of claim 21, wherein: in accordance with a determination that the detected movement corresponds to movement on the display towards the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes contracting the user-specified area annotated by highlighting; and in accordance with a determination that the detected movement corresponds to movement on the display away from the user-specified area annotated by highlighting, adjusting the user-specified area annotated by highlighting includes expanding the user-specified area annotated by highlighting.