# US 10,504,399 B2 · In and relating to displays > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,399 B2 - Document ID: US10504399B2 - Status: Granted - Kind: B2 - Application number: 15/767,561 - Filed: 2016-10-03 - Published: 2018-10-18 - Granted: 2019-12-10 - Earliest claimed: 2015-10-13 - Assignees: BAE SYSTEMS plc - Applicants: BAE SYSTEMS plc - Inventors: Simon Trythall - Web page: https://patentgrep.com/patent/US10504399B2 ## CPC - G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)} - G02B 27/017: {Head mounted} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/012: {Head tracking input arrangements} - G06F 3/0325: {using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image} - G09G 3/003: {to produce spatial visual effects} - G09G 3/3413: {Details of control of colour illumination sources} - G02B 2027/014: {comprising information/image processing systems} - G09G 2310/0235: Field-sequential colour display - G09G 2320/0242: Compensation of deficiencies in the appearance of colours - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A method and apparatus are provided for controlling a display device to generate a colour image for viewing by a user on a display, the colour image being formed by one or more colour components each of a colour selected from two or more different colours to be displayed with predetermined relative timings. Received image data define one or more colour components of a feature to be displayed as an element in the colour image. Rate data are received, e.g. from an associated tracker system, indicative of a rate of change in orientation of the display relative to a direction of gaze of an eye of the user. The received rate data are used to determine a position on the display for displaying each of the one or more colour components of the feature including determining any respective adjustment required to a determined position for the colour component according to its respective colour, the received rate data and the predetermined relative timings. The determined position of each of the one or more colour components is output to the display device for display of the colour component at the respective determined position. ## Claims ### Claim 1 A method for controlling a display device to generate a colour image for viewing by a user on a display, the colour image being formed by at least three colour components, each of the colour components including two or more different colours to be displayed with predetermined relative timings, the method comprising: receiving image data defining an intended position of first, second, and third colour components of a feature to be sequentially displayed as an element in the colour image; receiving rate data indicative of a rate of change in orientation of the display relative to a direction of gaze of an eye of the user; determining a displaced position on the display for displaying each of the first and third colour components of the feature by adjusting the intended position of the first and third colour components according to the respective colour, the received rate data and the predetermined relative timings relative to a timing of the second colour component, the displaced position of the first and third colour components being different from the intended position of the second colour component; and outputting the displaced position of each of the first and third colour components to the display device for display of the first and third colour components at the respective displaced position, and outputting the intended position of the second colour component to the display device for display of the second colour component at the intended position. ### Claim 2 (depends on 1) The method according to claim 1, wherein determining the displaced position for displaying each of the first and third colour components includes receiving data indicative of an orientation of the display in inertial space and determining a position on the display such that the feature appears aligned to a predetermined line of sight to a point in inertial space. ### Claim 3 (depends on 2) The method according to claim 2, wherein adjusting the intended position of the first and third colour components includes determining a respective adjustment to the received data indicative of an orientation of the display such that the displaced position for displaying each of the first and third colour components is determined after applying the respective adjustment to the received orientation data. ### Claim 4 (depends on 2) The method according to claim 2, wherein the received rate data measure a rate of change in orientation of the display in inertial space and the measured rate is indicative of the rate of relative movement of the display relative to the direction of gaze of the user assuming that the direction of gaze of the user is substantially fixed in inertial space. ### Claim 5 (depends on 2) The method according to claim 2, wherein the received rate data define a rate of change in orientation of the display in azimuth and in elevation resolved in a frame of reference of the display, assuming no change in orientation of the display about a roll axis in the frame of reference of the display and assuming that the direction of gaze of the user is substantially fixed in inertial space. ### Claim 6 (depends on 1) The method according to claim 1, wherein the display is a head or helmet-mounted display (HMD) arranged to display collimated colour images. ### Claim 7 (depends on 1) An image processor programmed to implement the method according to claim 1. ### Claim 8 An apparatus for controlling a display device to generate a colour image for viewing by a user on a display, the colour image being formed by at least three colour components, each of the colour components including two or more different colours to be displayed with predetermined relative timings, the apparatus comprising: an image processor configured to receive image data defining an intended position of first, second, and third colour components of a feature to be sequentially displayed as an element in the colour image; receive rate data indicative of a rate of change in orientation of the display relative to a direction of gaze of an eye of the user; determine a displaced position on the display for displaying each of the first and third colour components of the feature by adjusting the intended position of the first and third colour components according to the respective colour, the received rate data, and the predetermined relative timings relative to a timing of the second colour component, the displaced position of the first and third colour components being different from the intended position of the second colour component, and output the displaced position of each of the first and third colour components to the display device for display of the first and third colour components at the respective displaced position, and outputting the intended position of the second colour component to the display device for display of the second colour component at the intended position. ### Claim 9 (depends on 8) The apparatus according to claim 8, wherein the image processor is configured to determine the displaced position on the display for displaying the first and third colour components by receiving data indicative of an orientation of the display in inertial space and determining a position on the display such that the feature appears aligned to a predetermined line of sight to a point in inertial space. ### Claim 10 (depends on 9) The apparatus according to claim 9, wherein the image processor is configured to adjust the intended position of the first and third colour components by determining a respective adjustment to the received data indicative of an orientation of the display such that the displaced position on the display for displaying each of the first and third colour components is determined after applying the respective adjustment to the received orientation data. ### Claim 11 (depends on 9) The apparatus according to claim 9, wherein the received rate data measure a rate of change in orientation of the display in inertial space and the measured rate is indicative of the rate of relative movement of the display relative to the direction of gaze of the user assuming that the direction of gaze of the user is substantially fixed in inertial space. ### Claim 12 (depends on 9) The apparatus according to claim 9, wherein the received rate data define a rate of change in orientation of the display in azimuth and in elevation resolved in a frame of reference of the display, assuming no change in orientation of the display about a roll axis in the frame of reference of the display and assuming that the direction of gaze of the user is substantially fixed in inertial space. ### Claim 13 (depends on 8) The apparatus according to claim 8, wherein the image processor is configured to determine a position on the display for each of the first and third colour components of the feature taking account of whether the image projection is a flat surface projection or a spherical projection. ### Claim 14 (depends on 8) The apparatus according to claim 8, wherein the received rate data are received from, or determined from output by, an eye tracker system associated with the display. ### Claim 15 (depends on 8) The apparatus according to claim 8, wherein the display is a head or helmet-mounted display (HMD) arranged to display collimated colour images. ### Claim 16 (depends on 8) The apparatus according to claim 8, wherein the display is a head or helmet-mounted display (HMD) arranged to display collimated colour images and wherein the rate data are received from, or derived from output by, a head or helmet tracker system. ### Claim 17 A computer program product comprising one or more non-transitory computer-readable mediums having stored thereon computer program code which when executed by one or more processor causes a process to be carried out for controlling a display device to generate a colour image for viewing by a user on a display, the colour image being formed by at least three colour components, each of the colour components selected from two or more different colours to be displayed with predetermined relative timings, the process comprising: receiving image data defining an intended position of first, second, and third colour components of a feature to be sequentially displayed as an element in the colour image; receiving rate data indicative of a rate of change in orientation of the display relative to a direction of gaze of an eye of the user; determining a displaced position on the display for displaying each of the first and third colour components of the feature by adjusting the intended position of the first and third colour components according to the respective colour, the received rate data and the predetermined relative timings relative to a timing of the second colour component, the displaced position of the first and third colour components being different from the intended position of the second colour component; and outputting the displaced position of each of the first and third colour components to the display device for display of the first and third colour components at the respective displaced position, and outputting the intended position of the second colour component to the display device for display of the second colour component at the intended position. ### Claim 18 (depends on 17) The computer program product according to claim 17, wherein determining the displaced position for displaying each of the first and third colour components includes receiving data indicative of an orientation of the display in inertial space and determining a position on the display such that the feature appears aligned to a predetermined line of sight to a point in inertial space.