# US 10,768,785 B2 · Pressure sensitive manipulation of medical image data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,785 B2 - Document ID: US10768785B2 - Status: Granted - Kind: B2 - Application number: 15/264,404 - Filed: 2016-09-13 - Published: 2017-02-09 - Granted: 2020-09-08 - Earliest claimed: 2008-10-22 - Assignees: Merge Healthcare Solutions Inc. - Applicants: Merge Healthcare Solutions Inc. - Inventors: Evan K. Fram - Web page: https://patentgrep.com/patent/US10768785B2 ## CPC - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 1/1694: {the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer} - G06F 3/03543: {Mice or pucks (G06F3/03541 takes precedence)} - G06F 3/04817: using icons (graphical or visual programming using iconic symbols G06F8/34) - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/0487: using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser - G06F 3/0488: using a touch-screen or digitiser, e.g. input of commands through traced gestures - G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F 2203/04807: Pen manipulated menu - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract Navigating user-interfaces of medical image viewing software using pressure-sensitive displays can increase productivity of the viewer. In certain embodiments, a menu having a number of icons can be provided on a display device such that the icons are arranged around an initial area that is touched by a user's finger or stylus, for example. Due to the icons being arranged around the initial cursor position, any one of the icons from the menu can be chosen with relatively small finger movement and/or changes in pressure applied by the finger. ## Claims ### Claim 1 A method of detecting interactions with a pressure sensitive screen of a computing device, the method comprising: by one or more computer processors of the computing device: displaying a user interface on the pressure sensitive screen of the computing device, the user interface including a representation of one or more medical images; obtaining information indicating user input on the pressure sensitive screen of the computing device, the information indicating a location in the user interface of the user input and a pressure value indicating a measure of pressure applied to the pressure sensitive screen; in response to determining that the pressure value exceeds a first threshold, presenting a graphical menu comprising a plurality of icons on the pressure sensitive screen, each icon being associated with different functionality to perform on the one or more medical images; with the graphical menu displayed, detecting a temporary selection input of a particular icon of the plurality icons; subsequent to the temporary selection of the particular icon, detecting that the particular icon has been permanently selected in response to the pressure value being less than a second threshold; in response to said permanent selection, initiating execution of a particular functionality associated with the particular icon on the one or more medical images and setting a functionality of a new user input to the particular functionality associated with the particular icon; and subsequent to said permanent selection of the particular icon, receiving the new user input on the pressure sensitive screen, and applying the particular functionality associated with the particular icon in response to the new user input. ### Claim 2 (depends on 1) The method of claim 1, wherein the plurality of icons are presented along a perimeter of a rectangular area of the user interface, wherein the location of the user input is included in the rectangular area. ### Claim 3 (depends on 1) The method of claim 1, wherein the location in the user interface of the user input is within a first threshold distance of an extremity of the user interface, and wherein the plurality of icons are placed along a curve initiating a second threshold distance from the extremity, such that the icons are included within the user interface. ### Claim 4 (depends on 1) The method of claim 1, wherein for one or more icons presented at a vertical location below a vertical location of the user input, the one or more icons are presented a horizontal threshold distance away from a horizontal location of the user input such that the one or more icons are not obstructed by a portion of a hand associated with the user input. ### Claim 5 (depends on 1) The method of claim 1, wherein the temporary selection input indicates that (1) the user input was applied to the pressure sensitive screen at a greater pressure than the first threshold, and that (2) the user input extended from the location of the user input to a location associated with the particular icon. ### Claim 6 (depends on 1) The method of claim 1, further comprising: presenting a graphical representation of the particular icon within a threshold vertical distance of a top portion of the user interface. ### Claim 7 A computer program product storing instructions that when executed by a computing device of one or more processors causes the computing device to perform operations comprising: displaying a user interface on a pressure sensitive screen of the computing device, the user interface including a representation of one or more medical images; obtaining information indicating user input on the pressure sensitive screen of the computing device, the information indicating a location in the user interface of the user input and a pressure value indicating a measure of pressure applied to the pressure sensitive screen; in response to determining that the pressure value exceeds a first threshold, presenting a graphical menu comprising a plurality of icons on the pressure sensitive screen, each icon being associated with different functionality to perform on the one or more medical images; with the graphical menu displayed, detecting a temporary selection input of a particular icon of the plurality icons; subsequent to the temporary selection of the particular icon, detecting that the particular icon has been permanently selected in response to the pressure value being less than a second threshold; in response to said permanent selection, initiating execution of a particular functionality associated with the particular icon on the one or more medical images and setting a functionality of a new user input to the particular functionality associated with the particular icon; and subsequent to said permanent selection of the particular icon, receiving a new user input on the pressure sensitive screen, and applying the particular functionality associated with the particular icon in response to the user input. ### Claim 8 (depends on 7) The computer program product of claim 7, wherein the plurality of icons are presented along a perimeter of a rectangular area of the user interface, wherein the location of the user input is included in the rectangular area. ### Claim 9 (depends on 7) The computer program product of claim 7, wherein the location in the user interface of the user input is within a first threshold distance of an extremity of the user interface, and wherein the plurality of icons are placed along a curve initiating a second threshold distance from the extremity, such that the icons are included within the user interface. ### Claim 10 (depends on 7) The computer program product of claim 7, wherein for one or more icons presented at a vertical location below a vertical location of the user input, the one or more icons are presented a horizontal threshold distance away from a horizontal location of the user input such that the one or more icons are not obstructed by a portion of a hand associated with the user input. ### Claim 11 (depends on 7) The computer program product of claim 7, wherein the temporary selection input indicates that (1) the user input was applied to the pressure sensitive screen at a greater pressure than the first threshold, and that (2) the user input extended from the location of the user input to a location associated with the particular icon. ### Claim 12 (depends on 7) The computer program product of claim 7, wherein the operations further comprise: presenting a graphical representation of the particular icon within a threshold vertical distance of a top portion of the user interface. ### Claim 13 A system comprising one or more processors and a computer program product storing instructions, that when executed by the one or more processors, cause the one or more processors to perform operations comprising: displaying a user interface on a pressure sensitive screen, the user interface including a representation of one or more medical images; obtaining information indicating user input on the pressure sensitive screen, the information indicating a location in the user interface of the user input and a pressure value indicating a measure of pressure applied to the pressure sensitive screen; in response to determining that the pressure value exceeds a first threshold, presenting a graphical menu comprising a plurality of icons on the pressure sensitive screen, each icon being associated with different functionality to perform on the one or more medical images; with the graphical menu displayed, detecting a temporary selection input of a particular icon of the plurality icons; subsequent to the temporary selection of the particular icon, detecting that the particular icon has been permanently selected in response to the pressure value being less than a second threshold; in response to said permanent selection, initiating execution of a particular functionality associated with the particular icon on the one or more medical images and setting a functionality of a new user input to the particular functionality associated with the particular icon; and subsequent to said permanent selection of the particular icon, receiving a new user input on the pressure sensitive screen, and applying the particular functionality associated with the particular icon in response to the user input. ### Claim 14 (depends on 13) The system of claim 13, wherein the plurality of icons are presented along a perimeter of a rectangular area of the user interface, wherein the location of the user input is included in the rectangular area. ### Claim 15 (depends on 13) The system of claim 13, wherein the location in the user interface of the user input is within a first threshold distance of an extremity of the user interface, and wherein the plurality of icons are placed along a curve initiating a second threshold distance from the extremity, such that the icons are included within the user interface. ### Claim 16 (depends on 13) The system of claim 13, wherein for one or more icons presented at a vertical location below a vertical location of the user input, the one or more icons are presented a horizontal threshold distance away from a horizontal location of the user input such that the one or more icons are not obstructed by a portion of a hand associated with the user input. ### Claim 17 (depends on 13) The system of claim 13, wherein the temporary selection input indicates that (1) the user input was applied to the touch screen at a greater pressure than the first threshold, and that (2) the user input extended from the location of the user input to a location associated with the particular icon. ### Claim 18 (depends on 13) The system of claim 13, wherein the operations further comprise: presenting a graphical representation of the particular icon within a threshold vertical distance of a top portion of the user interface.