Back to results
US 12,417,752 B2Granted
Coordinated multi-view display experiences
AssigneeMisapplied Sciences, Inc.
InventorsAlbert H. Ng, Paul H. Dietz, David S. Thompson
Life of this patent
Estimating the term…
Abstract
A multi-view (MV) system with multiple MV displays utilizes state information to assign personalized versions of content to display to viewers, thereby providing a coordinated MV display experience. These systems may include a sensing system for detecting viewers and other environmental conditions, and a controller to manage the content assignments for the MV displays. The controller can manage the viewer states, viewer state transitions, and content assignment changes based on changes of those viewers and conditions. The systems can be utilized to simultaneously present coordinated and personalized content to multiple viewers of multiple MV displays.
Claims28
A method of operating a plurality of multi-view (MV) displays, wherein each MV display is associated with a corresponding viewing area and is configured to display differentiated visual content to a plurality of viewing zones in the corresponding viewing area, each MV display including a matrix of MV pixels, each MV pixel including a pixel pattern formed of a plurality of pixels and a lens arranged relative to the pixel pattern, each pixel of the pixel pattern emitting light which is collimated by the lens to form a beamlet extending in a defined direction, such that each MV pixel emits a plurality of beamlets originating from the plurality of pixels of the pixel pattern and extending in a plurality of different directions to the plurality of viewing zones in the viewing area, the method comprising:
- calibrating each MV display to mathematically associate beamlets of the MV display with locations in the viewing area using a first sensing system at the MV display and a second sensing system movable within the viewing area, wherein
- i) the first sensing system determines a location of the second sensing system in a viewing zone coordinate system of the viewing area within a sight of the first sensing system;
- ii) patterns are flashed on the MV display to uniquely encode every beamlet of every MV pixel of the MV display;
- iii) the second sensing system images the patterns and determines the beamlet of every MV pixel in a beamlet coordinate system comprising a grid indexed by at least X and Y coordinates of the beamlet;
- iv) the location of the second sensing system in the viewing zone coordinate system and the beamlet of every MV pixel in the beamlet coordinate system are associated;
- v) i)-iv) are repeated for each location of the locations in the viewing area to which the second sensing system is moved;
- and
- vi) an approximate mathematical relationship is computed to determine a mapping that translates between the viewing zone coordinate system and the beamlet coordinate system of the MV display;
- identifying a first viewer and a second viewer in a first viewing area associated with a first MV display of the plurality of MV displays, for which a first mapping is determined that translates between a first viewing zone coordinate system, in which the plurality of viewing zones are defined, and a first beamlet coordinate system, in which each MV pixel of the first MV display emits the plurality of beamlets in the plurality of different directions;
- determining a first state associated with the first viewer and a third state associated with the second viewer;
- assigning a first visual content for display based on the determined first state associated with the first viewer and assigning a third visual content for display based on the determined third state associated with the second viewer;
- using the first mapping, identifying a bundle of beamlets from the MV pixels of the first MV display hitting a first viewing zone associated with the first viewer to display the first visual content to the first viewer;
- using the first mapping, identifying another bundle of beamlets from the MV pixels of the first MV display hitting a third viewing zone associated with the second viewer to display the third visual content to the second viewer, wherein the first viewing zone and the third viewing zone are among the plurality of viewing zones in the first viewing area;
- controlling color and brightness of each beamlet of the bundle of beamlets to form a first image of the first visual content for the first viewer and controlling color and brightness of each beamlet of the another bundle of beamlets to form a third image of the third visual content for the second viewer, wherein different bundles of beamlets from the MV pixels of the first MV display are respectively directed to the plurality of viewing zones in the first viewing area;
- determining the first viewer's presence in a second viewing area associated with a second MV display of the plurality of MV displays, for which a second mapping is determined that translates between a second viewing zone coordinate system, in which the plurality of viewing zones are defined, and a second beamlet coordinate system, in which each MV pixel of the second MV display emits the plurality of beamlets in the plurality of different directions;
- determining a transition to a second state associated with the first viewer;
- assigning a second visual content for display based on the determined transition to the second state associated with the first viewer;
- using the second mapping, identifying a bundle of beamlets from the MV pixels of the second MV display hitting a second viewing zone associated with the first viewer to display the second visual content to the first viewer, wherein the second viewing zone is one of the plurality of viewing zones in the second viewing area;
- and
- controlling color and brightness of each beamlet of the bundle of beamlets to form a second image of the second visual content for the first viewer, wherein different bundles of beamlets from the MV pixels of the second MV display are respectively directed to the plurality of viewing zones in the second viewing area.
17 more elements
A display system, comprising:
- a first multi-view (MV) display configured to simultaneously display a first visual content visible from a first viewing zone and a second visual content visible from a second viewing zone, wherein the first visual content is not visible from the second viewing zone and the second visual content is not visible from the first viewing zone, the first MV display including a matrix of MV pixels, each MV pixel including a pixel pattern formed of a plurality of pixels and a lens arranged relative to the pixel pattern, each pixel of the pixel pattern emitting light which is collimated by the lens to form a beamlet extending in a defined direction, such that each MV pixel emits a plurality of beamlets originating from the plurality of pixels of the pixel pattern and extending in a plurality of different directions to the first viewing zone and the second viewing zone;
- a second MV display configured to simultaneously display a third visual content visible from a third viewing zone and a fourth visual content visible from a fourth viewing zone, wherein the third visual content is not visible from the fourth viewing zone and the fourth visual content is not visible from the third viewing zone, the second MV display including a matrix of MV pixels, each MV pixel including a pixel pattern formed of a plurality of pixels and a lens arranged relative to the pixel pattern, each pixel of the pixel pattern emitting light which is collimated by the lens to form a beamlet extending in a defined direction, such that each MV pixel emits a plurality of beamlets originating from the plurality of pixels of the pixel pattern and extending in a plurality of different directions to the third viewing zone and the fourth viewing zone;
- wherein
- the first MV display is calibrated to display the first visual content visible from the first viewing zone relative to the first viewing zone coordinate system, and to display the second visual content visible from the second viewing zone of the first MV display relative to the first viewing zone coordinate system;
- the second MV display is calibrated to display the third visual content visible from the third viewing zone relative to the second viewing zone coordinate system, and to display the fourth visual content visible from the fourth viewing zone of the second MV display relative to the second viewing zone coordinate system;
- and
- each of the first MV display and the second MV display is calibrated to mathematically associate beamlets of the MV display with locations in a corresponding viewing area associated with the MV display using a first sensing system at the MV display and a second sensing system movable within the corresponding viewing area, wherein
- i) the first sensing system determines a location of the second sensing system in a viewing zone coordinate system of the viewing area within a sight of the first sensing system;
- ii) patterns are flashed on the MV display to uniquely encode every beamlet of every MV pixel of the MV display;
- iii) the second sensing system images the patterns and determines the beamlet of every MV pixel in a beamlet coordinate system comprising a grid indexed by at least X and Y coordinates of the beamlet;
- iv) the location of the second sensing system in the viewing zone coordinate system and the beamlet of every MV pixel in the beamlet coordinate system are associated;
- v) i)-iv) are repeated for each location of the locations in the viewing area to which the second sensing system is moved;
- and
- vi) an approximate mathematical relationship is computed to determine a mapping that translates between the viewing zone coordinate system and the beamlet coordinate system of the MV display;
- and
- a sensing system configured to detect one or more features of a first viewer in the first viewing zone and one or more features of a second viewer in the second viewing zone;
- and
- a system controller configured (a) to determine a first mapping that translates between a first viewing zone coordinate system, in which the first and second viewing zones of the first MV display are defined, and a first beamlet coordinate system, in which each MV pixel of the first MV display emits the plurality of beamlets in the plurality of different directions, and to determine a second mapping that translates between a second viewing zone coordinate system, in which the third and fourth viewing zones of the second MV display are defined, and a second beamlet coordinate system, in which each MV pixel of the second MV display emits the plurality of beamlets in the plurality of different directions, (b) to maintain state information relating to the first viewer and the second viewer, (c) to assign the first visual content for display to the first viewing zone of the first MV display based on the state information relating to the first viewer and to assign the second visual content for display to the second viewing zone of the first MV display based on the state information relating to the second viewer, and (d) to determine a change in the state information relating to the first viewer and assign the third visual content for display to the first viewer in the third viewing zone of the second MV display based on the changed state information, wherein
- the assigning in (c) includes using the first mapping to identify a bundle of beamlets from the MV pixels of the first MV display hitting the first viewing zone to display the first visual content to the first viewer and using the first mapping to identify another bundle of beamlets from the MV pixels of the first MV display hitting the second viewing zone to display the second visual content to the second viewer, and
- the displaying in (d) includes using the second mapping to identify a bundle of beamlets from the MV pixels of the second MV display hitting the third viewing zone to display the third visual content to the first viewer.
17 more elements
Dependencies are inferred from the claim text.