# US 10,321,104 B2 · Multi-modal projection display > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,321,104 B2 - Document ID: US10321104B2 - Status: Granted - Kind: B2 - Application number: 15/353,578 - Filed: 2016-11-16 - Published: 2017-08-24 - Granted: 2019-06-11 - Earliest claimed: 2016-02-18 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Tao Ma - Web page: https://patentgrep.com/patent/US10321104B2 ## CPC - H04N 9/3152: {for shaping the light beam (beam shaping per se G02B27/09)} - B25J 11/0015: {Face robots, animated artificial faces for imitating human expressions} - G03B 21/00: Projectors or projection-type viewers; Accessories therefor (devices for changing pictures G03B23/00) - G03B 21/10: Projectors with built-in or built-on screen - G03B 21/145: {Housing details, e.g. position adjustments thereof} - G03B 21/28: Reflectors in projection beam {(in illumination beam G03B21/2066)} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 7/183: {for receiving images from a single remote source} - H04N 9/3141: {Constructional details thereof (details not peculiar to the presence of an electronic spatial light modulator G03B21/14)} - H04N 9/3147: {Multi-projection systems (video walls G06F3/1446)} - H04N 9/3185: {Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14)} - H04N 9/3194: {including sensor feedback} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B25J: MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES ({manipulators specially adapted for use in surgery A61B34/70; manipulators used in cleaning hollow articles B08B9/04}; manipulators associated with rolling mills B21B39/20; manipulators associated with forging machines B21J13/10; {manipulators associated with picking-up and placing mechanisms B23P19/007}; means for holding wheels or parts thereof B60B30/00; {vehicles with ground-engaging propulsion means, e.g. walking members B62D57/02, B62D57/032; devices for picking-up and depositing articles or materials between conveyors B65G47/90, B65G47/91; manipulators with gripping or holding means for transferring packages B65H67/065}; cranes B66C; {manipulators used in the protection or supervision of pipe-line installations F17D5/00; walking equipment adapted for nuclear steam-generators F22B37/006}; manipulators specially adapted for, or associated with, nuclear reactors G21C; {apparatus used for handling wafers during manufacture or treatment of semiconductor H10P72/50}) - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A multi-modal display device is presented. The display device has a shell having an internal projection screen and an opening, a projector emitting a projection beam from inside the shell. There is an optical guide adjusting a position of the projector to aim the projection beam at either the internal projection screen or the opening. A processor coupled to the optical guide may select a display position, wherein different display positions are associated with different display area sizes. The method includes determining a distance between a projector and a user, and automatically selecting a display mode based on the distance. ## Claims ### Claim 1 A device comprising: a shell having an internal projection screen and an opening; a projector emitting a projection beam from inside the shell; an optical guide inside the shell, the optical guide adjustably aiming the projection beam in one of a first direction and a second direction, the first direction being toward the internal projection screen and away from the opening, and the second direction being toward the opening; a sensor determining a distance between a user and the internal projection screen and continuously monitoring an amount of ambient light around the device, wherein monitoring an amount of ambient light involves comparing the amount of ambient light with a threshold scope; a processor coupled to the sensor and in communication with the optical guide, the processor selecting a direction in which the projection beam is aimed based on the distance; and a moving mechanism coupled to the optical guide, wherein the moving mechanism adjusts the position of the projector according to the direction that is selected by the processor, and wherein the processor selects the direction based on a type of visual content and the amount of ambient light around the device. ### Claim 2 (depends on 1) The device of claim 1, wherein the sensor comprises a camera. ### Claim 3 (depends on 1) The device of claim 1, wherein the processor dynamically adjusts the position of the projector based on the distance. ### Claim 4 (depends on 3) The device of claim 3, wherein the projector aims the projection beam at the internal projection screen if the distance satisfies a threshold range, and wherein the projector aims the projection beam through the opening if the distance does not satisfy the threshold range. ### Claim 5 (depends on 1) The device of claim 1, wherein the selected direction is at the internal projection screen if the amount of ambient light satisfies the threshold scope, and wherein the selected direction is at the opening if the amount of ambient light does not satisfy the threshold scope. ### Claim 6 (depends on 1) The device of claim 1, further comprising a distance measurement unit configured to measure a length between the projector and a projection surface if the projection beam is aimed at the opening, such that the processor automatically sets a focal length according to the length. ### Claim 7 (depends on 1) The device of claim 1, wherein the optical guide comprises a rotatable mirror. ### Claim 8 (depends on 1) The device of claim 1, wherein the opening comprises a transparent window. ### Claim 9 A method, comprising: emitting, by a projector, a projection beam from inside a shell of an electronic device; determining, by using a sensor, a distance between a user and an internal projection screen that is part of the shell, and an amount of ambient light around the electronic device; selecting, by the processor, a direction in which the projection beam is aimed based on a type of visual content and whether the amount of ambient light around the electronic device satisfies a threshold scope; and adjusting, by an optical guide inside the shell and based on the distance, the direction of the projection beam such that the projection beam is aimed either at the internal projection screen from inside the shell or at an opening in the shell. ### Claim 10 (depends on 9) The method of claim 9, further comprising dynamically adjusting, by the processor, the position of the projector based on the distance. ### Claim 11 (depends on 10) The method of claim 10, further comprising aiming, by the projector, the projection beam at the internal projection screen if the distance is outside a threshold range, and through the opening if the distance is within the threshold range. ### Claim 12 (depends on 9) The method of claim 9, further comprising aiming, by the projector, the projection beam at the internal projection screen if the amount of ambient light satisfies the threshold scope; and aiming, by the projector, the projection beam at the internal projection screen if the amount of ambient light does not satisfy the threshold scope. ### Claim 13 (depends on 9) The method of claim 9, further comprising: measuring a range between the projector and a projection surface if the projection beam is aimed through the opening; setting, by the processor, automatically a focal length according to the range. ### Claim 14 A device comprising: a shell having an internal projection screen and an opening; a projector emitting a projection beam from inside the shell; an optical guide inside the shell, the optical guide adjustably aiming the projection beam in one of a first direction and a second direction, the first direction being toward the internal projection screen and away from the opening, and the second direction being toward the opening; a sensor determining a distance between a user and the internal projection screen; a processor coupled to the sensor and in communication with the optical guide, the processor selecting a direction in which the projection beam is aimed based on the distance; and a moving mechanism coupled to the optical guide, wherein the moving mechanism adjusts the position of the projector according to the direction that is selected by the processor, and wherein the processor selects the first direction if the distance satisfies a threshold range and a type of visual content is not a movie or a video, the processor selects the second direction if the distance does not satisfy the threshold range and the type of visual content is a movie or a video.