# US 2019/0378338 A1 · Opacity filter for display device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0378338 A1 - Document ID: US20190378338A1 - Status: Published application - Kind: A1 - Application number: 16/548,211 - Filed: 2019-08-22 - Published: 2019-12-12 - Earliest claimed: 2010-09-21 - Assignees: Telefonaktiebolaget LM Ericsson (publ) - Applicants: Telefonaktiebolaget LM Ericsson (publ) - Inventors: Avi BAR-ZEEV; Bob CROCCO; Alex Aben-Athar KIPMAN; John LEWIS - Web page: https://patentgrep.com/patent/US20190378338A1 ## CPC - G06T 19/006: {Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00)} - G02B 26/026: {based on the rotation of particles under the influence of an external field, e.g. gyricons, twisting ball displays (based on orientable dipolar particles G02F1/172; based on electrophoresis G02F1/167)} - G02B 27/017: {Head mounted} - G02B 27/0172: {characterised by optical features} - G09G 3/001: {using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background (slide projectors per se G03B23/00 = 42 HP)} - G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)} - G02B 2027/0118: {comprising devices for improving the contrast of the display / brillance control visibility} - G02B 2027/0178: {Eyeglass type (eyeglass details G02C)} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - G09G 2300/023: Display panel composed of stacked panels - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract An optical see-through head-mounted display device includes a see-through lens which combines an augmented reality image with light from a real-world scene, while an opacity filter is used to selectively block portions of the real-world scene so that the augmented reality image appears more distinctly. The opacity filter can be a see-through LCD panel, for instance, where each pixel of the LCD panel can be selectively controlled to be transmissive or opaque, based on a size, shape and position of the augmented reality image. Eye tracking can be used to adjust the position of the augmented reality image and the opaque pixels. Peripheral regions of the opacity filter, which are not behind the augmented reality image, can be activated to provide a peripheral cue or a representation of the augmented reality image. In another aspect, opaque pixels are provided at a time when an augmented reality image is not present. ## Claims ### Claim 1 (canceled) ### Claim 2 An optical see-through display device comprising: an opacity filter positioned between a user's eye and a real-world scene when the display device is viewed by the user, the opacity filter comprising a plurality of pixels arranged in a grid, at least some pixels are controllable to adjust their opacity to light transmissivity; a display component configured to display an augmented reality image, the opacity filter is positioned to be aligned with at least a portion of the display component when viewed by the user's eye; and an opacity filter control circuit configured to control the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on a shape of the augmented reality image. ### Claim 3 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on being aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 4 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to set an increased opacity for pixels that are selected among the grid based on corresponding to a portion of the augmented reality image being in front of at least a portion of a real-world object viewed by the user through the display component. ### Claim 5 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on being aligned with an area adjacent to at least a major portion of a perimeter of the shape of the augmented reality image viewed by the user on the display component. ### Claim 6 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid to form a shape that is based on a perimeter of the shape of the augmented reality image viewed by the user on the display component. ### Claim 7 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to provide a region of pixels selected among the grid with a relatively high opacity based on being aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component, and to provide another region of pixels selected among the grid with a gradual transition in opacity based on being peripherally outside the shape of the augmented reality image viewed by the user on the display component. ### Claim 8 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit is configured to control the opacity filter to provide a region of pixels selected among the grid with a relatively high opacity that is aligned with at least a portion of and peripherally outside the shape of the augmented reality image viewed by the user on the display component, and to provide another region of pixels selected among the grid with a gradual transition in opacity extending away from the region peripherally outside the shape of the augmented reality image viewed by the user on the display component. ### Claim 9 (depends on 2) The optical see-through display device of claim 2, wherein: the display component extends in a field of view of the user between a first boundary and second boundary; the opacity filter control circuit is configured to control the opacity filter to adjust opacity for at least some pixels that are selected based on the shape of the augmented reality image viewed by the user on the display component and based on distance of the shape from at least one of the first and second boundaries. ### Claim 10 (depends on 9) The optical see-through display device of claim 9, wherein: the opacity filter control circuit is configured to control the opacity filter to adjust opacity for a sequence of selected pixels extending toward one of the first and second boundaries to provide a transition in opacity of the sequence of selected pixels based on distances of the respective ones of the sequence of selected pixels from the one of the first and second boundaries. ### Claim 11 (depends on 9) The optical see-through display device of claim 9, wherein: the opacity filter control circuit is configured to control the opacity filter to provide a relatively high opacity when the shape is at least a specified distance from the first and second boundaries and to provide a relatively low opacity when the shape is closer than the specified distance from a nearest one of the first and second boundaries. ### Claim 12 (depends on 2) The optical see-through display device of claim 2, wherein: the display component extends in a field of view between a first boundary and a second boundary; the opacity filter has a longer major axis than the display component, the opacity filter is aligned from a perspective of the user to extend across the display component and peripherally past the first and second boundaries. ### Claim 13 (depends on 12) The optical see-through display device of claim 12, wherein: responsive to while a boundary of the shape of the augmented reality image viewed by the user on the display component is at the first boundary, the opacity filter control circuit controls the opacity filter to adjust opacity to provide a gradual transition in opacity for pixels of the opacity filter which are in a portion of the opacity filter that extends peripherally beyond the first boundary of the display component. ### Claim 14 (depends on 2) The optical see-through display device of claim 2, wherein: the display component extends in a field of view between a first boundary and a second boundary; a first portion of the augmented reality image is farther from the first boundary than a second portion of the augmented reality image; and the opacity filter control circuit controls the opacity filter to provide a lower opacity for pixels which are aligned with at least a portion of the shape of the augmented reality image and closer to the first boundary than for pixels which are aligned with at least the portion of the shape of the augmented reality image and farther from the first boundary. ### Claim 15 (depends on 2) The optical see-through display device of claim 2, further comprising: a tracking component which tracks a location of the user's eye relative to the display component when the display component is being viewed by the user, wherein the opacity filter control circuit further controls the opacity filter to provide an increased opacity for at least some pixels that are selected responsive to a presently tracked location of the user's eye relative to the display component. ### Claim 16 (depends on 15) The optical see-through display device of claim 15, wherein: the opacity filter control circuit controls the opacity filter to provide an increased opacity for a group of pixels that are selected among the grid based on being determined, using a presently tracked location of the user's eye relative to the display component, to be aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 17 (depends on 15) The optical see-through display device of claim 15, wherein: the opacity filter control circuit further controls the opacity filter to adjust a horizontal position of which group of pixels are selected to have increased opacity to track side-to-side rotation of the user's eye. ### Claim 18 (depends on 15) The optical see-through display device of claim 15, further comprising: left and right ones of the opacity filters spaced apart and respectively positioned between the user's left and right eyes and a real-world scene when the display device is viewed by the user; and left and right ones of the display components configured to display augmented reality images, the left one of the opacity filters is positioned to be aligned with at least a portion of the left one of the display components when viewed by the user's left eye, the right one of the opacity filters is positioned to be aligned with at least a portion of the right one of the display components when viewed by the user's right eye, wherein the opacity filter control circuit responds to a first determination that the user is looking to the left by adjusting a horizontal position of which group of pixels of the left opacity filter are selected to have increased opacity to track movement of the user's left eye while looking left and further responds to the first determination by not adjusting a horizontal position of which group of pixels of the right opacity filter are selected to have increased opacity to not track movement of the user's right eye, and wherein the opacity filter control circuit responds to a second determination that the user is looking to the right by adjusting a horizontal position of which group of pixels of the right opacity filter are selected to have increased opacity to track movement of the user's right eye while looking right and further responds to the second determination by not adjusting a horizontal position of which group of pixels of the left opacity filter are selected to have increased opacity to not track movement of the user's left eye. ### Claim 19 (depends on 15) The optical see-through display device of claim 15, wherein: the opacity filter control circuit controls the opacity filter to adjust color of at least some of the group of pixels that are selected among the grid based on being determined, using a presently tracked location of the user's eye relative to the display component, to be aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 20 (depends on 2) The optical see-through display device of claim 2, wherein: the opacity filter control circuit further controls the opacity filter to adjust color of the pixels which are selected among the grid based on distance of the portion of the shape of the augmented reality image from the user's central field of view. ### Claim 21 A computer program product for an optical see-through display device having an opacity filter, a display component, and an opacity filter control circuit, the opacity filter being positioned between a user's eye and a real-world scene when the display device is viewed by the user, the opacity filter comprising a plurality of pixels arranged in a grid with at least some pixels being controllable to adjust their opacity to light transmissivity, the display component is configured to display an augmented reality image, the opacity filter is positioned to be aligned with at least a portion of the display component when viewed by the user's eye, and the opacity filter control circuit being configured to control the opacity filter, the computer program product comprising: a non-transitory computer readable medium storing program code that is executable by the opacity filter control circuit to perform operations comprising: controlling the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on a shape of the augmented reality image. ### Claim 22 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on being aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 23 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid based on being aligned with an area adjacent to at least a major portion of a perimeter of the shape of the augmented reality image viewed by the user on the display component. ### Claim 24 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to provide an increased opacity for at least some pixels that are selected among the grid to form a shape that is based on a perimeter of the shape of the augmented reality image viewed by the user on the display component. ### Claim 25 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to provide a region of pixels selected among the grid with a relatively high opacity based on being aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component, and to provide another region of pixels selected among the grid with a gradual transition in opacity based on being peripherally outside the shape of the augmented reality image viewed by the user on the display component. ### Claim 26 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to provide a region of pixels selected among the grid with a relatively high opacity that is aligned with at least a portion of and peripherally outside the shape of the augmented reality image viewed by the user on the display component, and to provide another region of pixels selected among the grid with a gradual transition in opacity extending away from the region peripherally outside the shape of the augmented reality image viewed by the user on the display component. ### Claim 27 (depends on 21) The computer program product of claim 21, wherein the display component extends in a field of view of the user between a first boundary and second boundary, and the operations further comprise: controlling the opacity filter to adjust opacity for at least some pixels that are selected based on the shape of the augmented reality image viewed by the user on the display component and based on distance of the shape from at least one of the first and second boundaries. ### Claim 28 (depends on 27) The computer program product of claim 27, wherein the operations further comprise: controlling the opacity filter to adjust opacity for a sequence of selected pixels extending toward one of the first and second boundaries to provide a transition in opacity of the sequence of selected pixels based on distances of the respective ones of the sequence of selected pixels from the one of the first and second boundaries. ### Claim 29 (depends on 27) The computer program product of claim 27, wherein the operations further comprise: controlling the opacity filter to provide a relatively high opacity when the shape is at least a specified distance from the first and second boundaries and to provide a relatively low opacity when the shape is closer than the specified distance from a nearest one of the first and second boundaries. ### Claim 30 (depends on 21) The computer program product of claim 21, wherein the display component extends in a field of view between a first boundary and a second boundary, the opacity filter has a longer major axis than the display component, the opacity filter is aligned from a perspective of the user to extend across the display component and peripherally past the first and second boundaries, and the operations further comprise: responsive to while a boundary of the shape of the augmented reality image viewed by the user on the display component is at the first boundary, the opacity filter control circuit controls the opacity filter to adjust opacity to provide a gradual transition in opacity for pixels of the opacity filter which are in a portion of the opacity filter that extends peripherally beyond the first boundary of the display component. ### Claim 31 (depends on 21) The computer program product of claim 21, wherein, the display component extends in a field of view between a first boundary and a second boundary, a first portion of the augmented reality image is farther from the first boundary than a second portion of the augmented reality image, and the operations further comprise: controlling the opacity filter to provide a lower opacity for pixels which are aligned with at least a portion of the shape of the augmented reality image and closer to the first boundary than for pixels which are aligned with at least a portion of the shape of the augmented reality image and farther from the first boundary. ### Claim 32 (depends on 21) The computer program product of claim 21, wherein the optical see-through head-mounted display device further includes a tracking component which tracks a location of the user's eye relative to the display component when the display component is being viewed by the user, and the operations further comprise: controlling the opacity filter to provide an increased opacity for at least some pixels that are selected responsive to a presently tracked location of the user's eye relative to the display component. ### Claim 33 (depends on 32) The computer program product of claim 32, wherein the operations further comprise: controlling the opacity filter to provide an increased opacity for a group of pixels that are selected among the grid based on being determined, using a presently tracked location of the user's eye relative to the display component, to be aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 34 (depends on 32) The computer program product of claim 32, wherein the operations further comprise controlling the opacity filter to adjust a horizontal position of which group of pixels are selected to have increased opacity to track side-to-side rotation of the user's eye. ### Claim 35 (depends on 32) The computer program product of claim 32, wherein the optical see-through display device has left and right ones of the opacity filters spaced apart and respectively positioned between the user's left and right eyes and a real-world scene when the display device is viewed by the user, and left and right ones of the display components configured to display augmented reality images, the left one of the opacity filters is positioned to be aligned with at least a portion of the left one of the display components when viewed by the user's left eye, the right one of the opacity filters is positioned to be aligned with at least a portion of the right one of the display components when viewed by the user's right eye, the operations further comprise: responding to a first determination that the user is looking to the left by adjusting a horizontal position of which group of pixels of the left opacity filter are selected to have increased opacity to track movement of the user's left eye while looking left and further responding to the first determination by not adjusting a horizontal position of which group of pixels of the right opacity filter are selected to have increased opacity to not track movement of the user's right eye, and responding to a second determination that the user is looking to the right by adjusting a horizontal position of which group of pixels of the right opacity filter are selected to have increased opacity to track movement of the user's right eye while looking right and further responding to the second determination by not adjusting a horizontal position of which group of pixels of the left opacity filter are selected to have increased opacity to not track movement of the user's left eye. ### Claim 36 (depends on 32) The computer program product of claim 32, wherein the operations further comprise: controlling the opacity filter to adjust color of at least some of the group of pixels that are selected among the grid based on being determined, using a presently tracked location of the user's eye relative to the display component, to be aligned with at least a portion of the shape of the augmented reality image viewed by the user on the display component. ### Claim 37 (depends on 21) The computer program product of claim 21, wherein the operations further comprise: controlling the opacity filter to adjust color of the pixels which are selected among the grid based on distance of the portion of the shape of the augmented reality image from the user's central field of view.