# US 12,112,038 B2 · Display device, display controlling method, and computer program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 12,112,038 B2
- Document ID: US12112038B2
- Status: Granted
- Kind: B2
- Application number: 18/482,090
- Filed: 2023-10-06
- Published: 2024-01-25
- Granted: 2024-10-08
- Earliest claimed: 2013-06-26
- Assignees: Sony Group Corporation
- Applicants: Sony Group Corporation
- Inventors: Mitsuo Okumura; Hazime Matsuda; Shoji Imamura; Katsuji Miyazawa; Motoki Higashide; Kunihito Sawai
- Web page: https://patentgrep.com/patent/US12112038B2

## CPC

- G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
- G06F 3/041: Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F 3/0412: {Digitisers structurally integrated in a display}
- G06F 3/044: by capacitive means
- G06F 3/0482: Interaction with lists of selectable items, e.g. menus
- G06F 3/04847: Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
- H04N 1/00392: {Other manual input means, e.g. digitisers or writing tablets}
- H04N 7/147: {Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals (selecting H04Q)}
- H04N 7/15: Conference systems
- H04N 23/62: Control of parameters via user interfaces
- G06F 3/04855: Interaction with scrollbars
- G06F 2203/04108: Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
- G06F 2203/04803: Split screen, i.e. subdividing the display area or the window area into separate subareas
- H04N 2101/00: Still video cameras
- H04N 2201/0084: Digital still camera
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A display device, method, computer-readable storage medium and user interface, each of which detects contact to or proximity of an object with respect to a generated image, and responsive to detection of contact to or proximity of the object to the generated image, disables any operational functions associated with a first portion of the generated image. Additionally, operation associated with a second portion of the generated image is allowed responsive to the detection of contact to or proximity of the object to the generated image, where the second portion of the generated image is different from the first portion of the generated image. An indication corresponding to the second portion of the generated image for which operation is enabled may be displayed on the generated image.

## Claims

### Claim 1

A display method, comprising:
detecting, using circuitry, a first contact on a first operational portion of an image generated on a touch screen;
displaying on the touch screen, using the circuitry, a first indicator at a first original position together with a first operational area that indicates an operational area of the first indicator;
responsive to detection of a first operation on the first operational portion, the first operation being a first continuous movement from the first original position to a first position, the first position being different from the first original position, along the touch screen after the first contact without releasing from the touch screen, setting, using the circuitry, a first value of a first function of a remote apparatus, the first value corresponding to a first movement amount of the first continuous movement;
responsive to the detection of the first operation on the first operational portion, displaying on the touch screen, using the circuitry, the first indicator that moves in response to the first continuous movement along the touch screen from the first original position to the first position; and
displaying on the touch screen, using the circuitry, the first indicator that moves back to the first original position in response to detecting, using the circuitry, the first contact being removed from the touch screen at the first position.

### Claim 2 (depends on 1)

The display method according to claim 1, wherein
the remote apparatus has a camera.

### Claim 3 (depends on 2)

The display method according to claim 2, wherein
the first operational area is superimposed on an image captured by the camera of the remote apparatus.

### Claim 4 (depends on 1)

The display method according to claim 1, wherein
the first contact is a contact on the touch screen by a user's first finger.

### Claim 5 (depends on 1)

The display method according to claim 1, wherein
the first indicator of the first operational area includes a relative change in brightness between the first operational portion and the second operational portion.

### Claim 6 (depends on 1)

The display method according to claim 1, further comprising:
disabling, using the circuitry, detection of contact to the touch screen over the second operational portion of the generated image while the first operational portion of the generated image is contacted.

### Claim 7 (depends on 1)

The display method according to claim 1, further comprising:
allowing, using the circuitry, operation associated with the first operational portion while the first operational portion is contacted.

### Claim 8 (depends on 1)

The display method according to claim 1, wherein the first operational area has two axes to set at least two parameters of the first function of the remote apparatus.

### Claim 9 (depends on 1)

The display method according to claim 1, wherein
the display method is used for a display of a hand-held portable device, or an information appliance.

### Claim 10

A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a computer, cause the computer to perform a display method comprising:
detecting a first contact on a first operational portion of an image generated on a touch screen;
displaying on the touch screen a first indicator at a first original position together with a first operational area that indicates an operational area of the first indicator;
responsive to detection of a first operation on the first operational portion, the first operation being a first continuous movement from the first original position to a first position, the first position being different from the first original position, along the touch screen after the first contact without releasing from the touch screen, setting a first value of a first function of a remote apparatus, the first value corresponding to a first movement amount of the first continuous movement;
responsive to the detection of the first operation on the first operational portion, displaying on the touch screen the first indicator that moves in response to the first continuous movement along the touch screen from the first original position to the first position; and
displaying on the touch screen the first indicator that moves back to the first original position in response to detecting the first contact being removed from the touch screen at the first position.

### Claim 11 (depends on 10)

The non-transitory computer-readable storage medium according to claim 10, wherein
the remote apparatus has a camera.

### Claim 12 (depends on 11)

The non-transitory computer-readable storage medium according to claim 11, wherein
the first operational area is superimposed on an image captured by the camera of the remote apparatus.

### Claim 13 (depends on 10)

The non-transitory computer-readable storage medium according to claim 10, wherein
the first contact is a contact on the touch screen by a user's first finger.

### Claim 14

A display device, comprising:
circuitry configured to
detect a first contact on a first operational portion of an image generated on a touch screen;
display on the touch screen a first indicator at a first original position together with a first operational area that indicates an operational area of the first indicator;
responsive to detection of a first operation on the first operational portion, the first operation being a first continuous movement from the first original position to a first position, the first position being different from the first original position, along the touch screen after the first contact without releasing from the touch screen, set a first value of a first function of a remote apparatus, the first value corresponding to a first movement amount of the first continuous movement;
responsive to the detection of the first operation on the first operational portion, display on the touch screen the first indicator that moves in response to the first continuous movement along the touch screen from the first original position to the first position; and
display on the touch screen the first indicator that moves back to the first original position in response to detecting the first contact being removed from the touch screen at the first position.

### Claim 15 (depends on 14)

The display device according to claim 14, wherein
the remote apparatus has a camera.

### Claim 16 (depends on 15)

The display device according to claim 15, wherein
the first operational area is superimposed on an image captured by the camera of the remote apparatus.

### Claim 17 (depends on 14)

The display device according to claim 14, wherein
the first contact is a contact on the touch screen by a user's first finger.
