# US 10,768,799 B2 · Display control of an image on a display screen > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,799 B2 - Document ID: US10768799B2 - Status: Granted - Kind: B2 - Application number: 16/697,761 - Filed: 2019-11-27 - Published: 2020-03-26 - Granted: 2020-09-08 - Earliest claimed: 2015-10-15 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Chang Lei; Xiao Xia Mao; Wen Wen Yang; Jie Zhu - Web page: https://patentgrep.com/patent/US10768799B2 ## CPC - G06F 3/04845: for image manipulation, e.g. dragging, rotation, expansion or change of colour - G06F 1/163: {Wearable computers, e.g. on a belt} - G06F 3/04842: Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) - G06F 3/04883: for inputting data by handwriting, e.g. gesture or text - G06T 3/20: Linear translation of whole images or parts thereof, e.g. panning - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06F 2203/04808: Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract Methods, computer program products, and systems, for example, for controlling display of an image on a display screen includes, for example, receiving, by one or more processor, data regarding a user selected area relative to a first portion of an image displayed on a display screen to define a second portion of the image, at least a portion of the second portion of the image being outside the first portion of the image displayed on the display screen, and automatically controlling, by the one or more processor, display of the second portion of the image on the display screen based on the user selected area of the image to generally maximize display of the second portion of the image within the display screen. ## Claims ### Claim 1 A method comprising: receiving data regarding a user selected area relative to a first portion of an image displayed on a display screen to define a second portion of the image, at least a portion of the second portion of the image being outside the first portion of the image displayed on the display screen; and controlling display of data of the second portion of the image on the display screen based on the user selected area of the image, wherein the receiving data includes receiving data of the user tracing an area outside of the display screen. ### Claim 2 (depends on 1) The method of claim 1, wherein an entirety of the display screen displays the first portion of the image. ### Claim 3 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, the area traced including the area outside of the display screen, wherein the tracking is performed using a camera disposed in a device having the display screen. ### Claim 4 (depends on 1) The method of claim 1, wherein the receiving data includes receiving data of an area traced by the user to indicate the user selected area, and wherein the receiving data of the area traced by the user to indicate the user selected area is performed so that the second portion of the image includes an entirety of the first portion of the image. ### Claim 5 (depends on 1) The method of claim 1, wherein the receiving data includes receiving data of an area traced by the user to indicate the user selected area, and wherein the receiving data of the area traced by the user to indicate the user selected area is performed so that the second portion of the image is absent of any portion of the first portion of the image. ### Claim 6 (depends on 1) The method of claim 1, wherein the receiving data includes receiving data of an area traced by the user to indicate the user selected area, wherein the area traced includes an area outside of a volumetric area extending perpendicularly and infinitely from an area of the display screen that is bounded by a peripheral boundary of the display screen, and wherein the receiving data includes receiving data of the user tracing the area outside of a volumetric area extending perpendicularly and infinitely from an area of the display screen that is bounded by a peripheral boundary of the display screen. ### Claim 7 (depends on 1) The method of claim 1, wherein the receiving data includes receiving data regarding the user selected area of the image defining the second portion of the image without the user touching the display screen. ### Claim 8 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, the area traced including a traced area outside of the display screen, wherein the tracking is performed using a camera disposed in a device having the display screen. ### Claim 9 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, the area traced including a traced area outside of the display screen, wherein the tracking is performed using a sensor of a wearable device worn by the user, the wearable device external to a device having the display screen, wherein the receiving includes receiving from the wearable device data of the area traced by the user to indicate the user selected area. ### Claim 10 (depends on 1) The method of claim 1, wherein the receiving is performed using a sensor of a wearable device worn by the user, the wearable device external to a device having the display screen, wherein the receiving includes receiving from the wearable device data of the area traced by the user to indicate the user selected area. ### Claim 11 (depends on 1) The method of claim 1, wherein the first portion of the image displayed on the displayed screen comprises an entirety of an area of the image displayed on the display screen, and wherein the receiving is performed so that a first part of the second portion is outside of the entirety of the area of the image displayed on the display screen and further so that a second part of the second portion is inside of the entirety of the area of the image displayed on the display screen. ### Claim 12 (depends on 1) The method of claim 1, wherein the first portion of the image displayed on the displayed screen comprises an entirety of an area of the image displayed on the display screen, and wherein the receiving is performed so that an entirety of the second portion is outside of the entirety of the area of the image displayed on the display screen. ### Claim 13 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, the area traced including a traced area outside of the display screen. ### Claim 14 (depends on 1) The method of claim 1, wherein the receiving includes receiving data of an area traced by the user to indicate the user selected area, wherein the area traced includes an area outside of a volumetric area extending perpendicularly and infinitely from an area of the display screen that is bounded by a peripheral boundary of the display screen. ### Claim 15 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, wherein the tracking is performed using a camera disposed in a device having the display screen. ### Claim 16 (depends on 1) The method of claim 1, wherein the controlling display of data of the second portion of the image on the display screen based on the user selected area of the image includes automatically controlling display of the second portion of the image on the display screen to maximize display of the second portion of the image on the display screen. ### Claim 17 (depends on 1) The method of claim 1, wherein the controlling display of data of the second portion of the image on the display screen based on the user selected area of the image includes automatically controlling display of the second portion of the image on the display screen to maximize display of the second portion of the image on the display screen, wherein the automatically controlling display of the second portion of the image on the display screen to maximize display of the second portion of the image on the display screen includes (a) zooming in or zooming out the second portion of the image, and (b) changing an orientation of the second portion of the image. ### Claim 18 (depends on 1) The method of claim 1, wherein the receiving includes tracking an area traced by the user to indicate the user selected area, wherein the tracking is performed using a camera. ### Claim 19 A computer program product comprising: a computer readable storage medium readable by one or more processing circuit and storing instructions for execution by one or more processor for performing a method comprising: receiving data regarding a user selected area relative to a first portion of an image displayed on a display screen to define a second portion of the image, at least a portion of the second portion of the image being outside the first portion of the image displayed on the display screen; and controlling display of data of the second portion of the image on the display screen based on the user selected area of the image, wherein the receiving data includes receiving data of the user tracing an area outside of the display screen. ### Claim 20 A system comprising: a memory; one or more processor in communication with the memory; and program instructions executable by the one or more processor via the memory to perform a method comprising: receiving data regarding a user selected area relative to a first portion of an image displayed on a display screen to define a second portion of the image, at least a portion of the second portion of the image being outside the first portion of the image displayed on the display screen; and controlling display of data of the second portion of the image on the display screen based on the user selected area of the image, wherein the receiving data includes receiving data of the user tracing the area outside of the display screen.