# US 10,872,581 B2 · Electronic devices with orientation compensation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,872,581 B2 - Document ID: US10872581B2 - Status: Granted - Kind: B2 - Application number: 15/979,324 - Filed: 2018-05-14 - Published: 2019-01-31 - Granted: 2020-12-22 - Earliest claimed: 2017-07-27 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Jiaying Wu; Cheng Chen; Hung A. Pham; Lu Zhang; Paul V. Johnson; See-Ho Tsang; Steven P. Hotelling; Wesley S. Smith - Web page: https://patentgrep.com/patent/US10872581B2 ## CPC - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G09G 2320/0242: Compensation of deficiencies in the appearance of colours - G09G 2320/0261: in the context of movement of objects on the screen or movement of the observer relative to the screen - G09G 2320/028: by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction - G09G 2320/0666: for control of colour parameters, e.g. colour temperature - G09G 2354/00: Aspects of interface with display user - G09G 2360/144: the light being ambient light - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device may have components that experience performance variations as the device changes orientation relative to a user. Changes in the orientation of the device relative to the user can be monitored using a motion sensor. A camera may be used to periodically capture images of a user's eyes. By processing the images to produce accurate orientation information reflecting the position of the user's eyes relative to the device, the orientation of the device tracked by the motion sensor can be periodically updated. The components may include audio components such as microphones and speakers and may include a display with an array of pixels for displaying images. Control circuitry in the electronic device may modify pixel values for the pixels in the array to compensate for angle-of-view-dependent pixel appearance variations based on based on the orientation information from the motion sensor and the camera. ## Claims ### Claim 1 An electronic device, comprising: a housing having an orientation; sensor circuitry configured to track changes to the orientation of the housing, wherein the sensor circuitry comprises a motion sensor configured to track the changes to the orientation of the housing and a camera; a display; and control circuitry configured to make color corrections to pixels in the display based at least partly on the tracked changes to reduce angle-of-view dependent variations in pixel color cast, wherein the control circuitry is configured to make the color corrections based at least partly on images captured by the camera, wherein the images comprise images of a user's eyes, and wherein the control circuitry is configured to make the color corrections based on changes to the orientation of the housing measured with the motion sensor in intervals between successive images captured by the camera. ### Claim 2 (depends on 1) The electronic device defined in claim 1 wherein the sensor circuitry comprises a gyroscope configured to measure the changes to the orientation of the housing. ### Claim 3 (depends on 1) The electronic device defined in claim 1 wherein the motion sensor is selected from the group consisting of: an accelerometer and a compass. ### Claim 4 (depends on 1) The electronic device defined in claim 1 wherein the control circuitry is further configured to make the color corrections based at least partly on locations of the pixels within the display. ### Claim 5 (depends on 1) The electronic device defined in claim 1 further comprising a color-sensing ambient light sensor, wherein the control circuitry is further configured to make the color corrections based on ambient light measurements made with the color-sensing ambient light sensor. ### Claim 6 (depends on 1) The electronic device defined in claim 1 further comprising at least first and second speakers that produce sound in respective first and second audio channels, wherein the control circuitry is further configured to adjust the sound of the first and second audio channels based at least partly on the tracked changes. ### Claim 7 (depends on 1) The electronic device defined in claim 1 further comprising at least first and second microphones that measure respective first and second audio channels of microphone data, wherein the control circuitry is further configured to adjust the first and second channels of microphone data based at least partly on the tracked changes. ### Claim 8 (depends on 1) The electronic device defined in claim 1 wherein the color corrections are made by adjusting a color of a backlight. ### Claim 9 An electronic device, comprising: a housing; a camera configured to capture images; a motion sensor configured to measure changes to an orientation of the housing in intervals between successive images captured by the camera; a display in the housing that has an array of pixels configured to display images; and control circuitry configured to modify pixel values for the pixels in different areas of the array differently to reduce angle-of-view-dependent variations in pixel color cast appearance, wherein the control circuitry is configured to process the images captured by the camera to update the changes to the orientation measured with the motion sensor and wherein the control circuitry is configured to modify the pixel values at least partly in response to the measured changes to the orientation of the housing. ### Claim 10 (depends on 9) The electronic device defined in claim 9 wherein the motion sensor is selected from the group consisting of: an accelerometer and a compass. ### Claim 11 (depends on 9) The electronic device defined in claim 9 wherein the motion sensor comprises a gyroscope. ### Claim 12 (depends on 9) The electronic device defined in claim 9 further comprising: first and second speakers and respective first and second audio amplifiers coupled respectively to the first and second speakers, wherein the control circuitry is further configured to adjust relative gain between the first and second audio amplifiers based at least partly on the measured changes to the orientation. ### Claim 13 (depends on 9) The electronic device defined in claim 9 wherein the display comprises an organic light-emitting diode display. ### Claim 14 (depends on 9) The electronic device defined in claim 9 further comprising a color ambient light sensor, wherein the control circuitry is configured to modify the pixel values based at least partly on information from the color ambient light sensor. ### Claim 15 (depends on 14) The electronic device defined in claim 14 wherein the camera captures eye position information and wherein the control circuitry is configured to update the changes to the orientation based at least partly on the captured eye position information. ### Claim 16 (depends on 9) The electronic device defined in claim 9 wherein the modified pixel values include modified RGB values. ### Claim 17 An electronic device, comprising: a housing having an orientation; an array of pixels configured to display images; a motion sensor; a camera; and control circuitry configured to modify pixel values for the pixels in the array to reduce angle-of-view-dependent pixel color cast variations, wherein the control circuitry is configured to modify the pixel values based on information from the motion sensor and the camera and wherein the control circuitry is configured to modify the pixel values based on changes to the orientation of the housing measured with the motion sensor in intervals between successive images captured by the camera. ### Claim 18 (depends on 17) The electronic device defined in claim 17 wherein the motion sensor comprises a sensor selected form the group consisting of: an accelerometer, a gyroscope, and a compass.