# US 2022/0035155 A1 · Video processing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2022/0035155 A1 - Document ID: US20220035155A1 - Status: Published application - Kind: A1 - Application number: 17/381,466 - Filed: 2021-07-21 - Published: 2022-02-03 - Earliest claimed: 2020-07-29 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment Inc. - Inventors: Nigel John Williams; Patrick John Connor - Web page: https://patentgrep.com/patent/US20220035155A1 ## CPC - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G02B 27/0101: {characterised by optical features (G02B27/0172 takes precedence)} - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G09G 5/10: Intensity circuits - G02B 2027/0112: {comprising device for genereting colour display} - G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility} - G02B 2027/0134: {of stereoscopic type} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G09G 2320/0257: Reduction of after-image effects - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G 2340/16: Determination of a pixel data signal depending on the signal applied in the previous frame - G09G 2360/16: Calculation or use of calculated indices related to luminance levels in display data - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Apparatus comprises an image processor configured to provide output video images to a head mountable display, HMD, having one or more display elements to display video images to a wearer of the HMD, for display by the one or more display elements in response to input video images, in which each output video image corresponds to a respective input video image; in which: the image processor comprises a detector configured to detect whether an input image brightness at image locations in the input video images exceeds a threshold image brightness; and the image processor is configured to vary a relationship between the display properties at a given image location in a given output video image and the input image display properties at the given image location in the corresponding input video image in response to a detection that image brightness at the given image location in one or more input video images preceding that corresponding input video image exceeded the threshold image brightness. ## Claims ### Claim 1 Apparatus comprising: an image processor configured to provide output video images to a head mountable display, HMD, having one or more display elements to display video images to a wearer of the HMD, for display by the one or more display elements in response to input video images, in which each output video image corresponds to a respective input video image; in which: the image processor comprises a detector configured to detect whether an input image brightness at image locations in the input video images exceeds a threshold image brightness; and the image processor is configured to vary a relationship between display properties at a given image location in a given output video image and the input display properties at the given image location in the corresponding input video image in response to a detection that image brightness at the given image location in one or more input video images preceding that corresponding input video image exceeded the threshold image brightness. ### Claim 2 (depends on 1) The apparatus of claim 1, in which the given image location represents the same image location in the given output video image and in the one or more preceding input video images. ### Claim 3 (depends on 1) The apparatus of claim 1, comprising: a gaze detector associated with the HMD and configured to detect a gaze direction for each eye of the wearer of the HMD. ### Claim 4 (depends on 3) The apparatus of claim 3, in which the given image location for an image represents an image location pointed to by the gaze direction detected for that image. ### Claim 5 (depends on 1) The apparatus of claim 1, in which the image processor is configured to decrease a ratio between the display brightness at the given image location in the given output video image and the input image brightness at the given image location in the corresponding input video image with respect to time so as to simulate a decline with respect to time in the sensitivity of the vision of the wearer of the HMD. ### Claim 6 (depends on 5) The apparatus of claim 5, in which the image processor is configured to decrease the ratio towards a predetermined minimum ratio. ### Claim 7 (depends on 1) The apparatus of claim 1, in which the image processor is configured to display a representation of image content from the given output video image at the given image location as an after image, in one or more output video images after the given output video image. ### Claim 8 (depends on 7) The apparatus of claim 7, in which the image processor is configured to vary a colour balance of the representation with respect to the colour balance of the image content from the given output video image. ### Claim 9 (depends on 1) The apparatus of claim 1, in which the image processor is configured to decrease a ratio between the display brightness at the given image location in the given output video image and the input image brightness at the given image location in the corresponding input video image in one or more output video images after the given output video image. ### Claim 10 (depends on 1) The apparatus of claim 1, in which the image processor is configured to determine the threshold image brightness in response to the image brightness of at least a region of one or more of the input video images. ### Claim 11 (depends on 10) The apparatus of claim 10, in which the region comprises a whole image. ### Claim 12 (depends on 10) The apparatus of claim 10, comprising: a gaze detector associated with the HMD and configured to detect a gaze direction for each eye of the wearer of the HMD, in which the region comprises a part of an image around the detected gaze direction. ### Claim 13 (depends on 1) The apparatus of claim 1, the apparatus comprising an HMD. ### Claim 14 (depends on 1) The apparatus of claim 1, comprising a video game apparatus. ### Claim 15 A method comprising: providing output video images to a head mountable display, HMD, having one or more display elements to display video images to a wearer of the HMD, for display by the one or more display elements in response to input video images, in which each output video image corresponds to a respective input video image; detecting whether an input image brightness at image locations in the input video images exceeds a threshold image brightness; and varying a relationship between display properties at a given image location in a given output video image and the input image display properties at the given image location in the corresponding input video image in response to a detection that image brightness at the given image location in one or more input video images preceding that corresponding input video image exceeded the threshold image brightness. ### Claim 16 A non-transitory, machine-readable storage medium which stores computer software which, when executed by a computer, causes the computer to perform a method comprising: providing output video images to a head mountable display, HMD, having one or more display elements to display video images to a wearer of the HMD, for display by the one or more display elements in response to input video images, in which each output video image corresponds to a respective input video image; detecting whether an input image brightness at image locations in the input video images exceeds a threshold image brightness; and varying a relationship between display properties at a given image location in a given output video image and the input image display properties at the given image location in the corresponding input video image in response to a detection that image brightness at the given image location in one or more input video images preceding that corresponding input video image exceeded the threshold image brightness.