# US 11,908,158 B2 · Transparent display system, control method and control device thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,908,158 B2 - Document ID: US11908158B2 - Status: Granted - Kind: B2 - Application number: 17/530,686 - Filed: 2021-11-19 - Published: 2022-05-26 - Granted: 2024-02-20 - Earliest claimed: 2020-11-20 - Assignees: Industrial Technology Research Institute - Applicants: Industrial Technology Research Institute - Inventors: Tzu-Yi Yu; Hong-Ming Dai; Chun-Yen Huang; Yu-Hsuan Su; Hung-Pin Shih; Ya-Rou Hsu; Yu-Hsiang Tsai - Web page: https://patentgrep.com/patent/US11908158B2 ## CPC - G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80) - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)} - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A transparent display system, a control method and a control device thereof are provided. The transparent display system includes an information capturing assembly, a transparent display and a control device. The information capturing assembly is used to obtain at least one detection content. The control device includes a detection unit, a resource allocation unit and a recognition unit. The detection unit is used for detecting at least one user in front of a transparent display and at least one target object behind the transparent display according to the detection content. The resource allocation unit is used to obtain a resource allocation according to a detection result of the detection content. The information capturing assembly obtains at least one recognition content. The recognition unit obtains at least one front side position of the user and at least one back side position of the target object according to the resource allocation. ## Claims ### Claim 1 A transparent display system, comprising: an information capturing assembly, configured to obtain at least one detection content; a transparent display; and a control device, comprising: a detection unit, configured to detect at least one user in front of the transparent display and at least one target object behind the transparent display according to the at least one detection content; a resource allocation unit, configured to obtain a resource allocation according to a detection result of the at least one detection content that is a presence of the user or the target object, wherein the resource allocation comprises setting different frame rates, different frequencies or different areas for image recognition or information recognition, or setting different switching conditions of the information capturing assembly; and a recognition unit, wherein the information capturing assembly obtains at least one recognition content according to the resource allocation, and the recognition unit obtains at least one front side position of the at least one user and at least one back side position of the at least one target object according to the resource allocation. ### Claim 2 (depends on 1) The transparent display system according to claim 1, wherein the control device further comprising: a joining unit, configured to join the at least one front side position and join the at least one back side position to respectively obtain at least one front side relative position and at least one back side relative position; an integrating unit, configured to integrate the at least one front side relative position and the at least one back side relative position to obtain at least one sight position; and an outputting unit, configured to output at least one display content to the transparent display according to the at least one sight position. ### Claim 3 (depends on 1) The transparent display system according to claim 1, wherein the at least one detection content includes a plurality of front side detection contents and a plurality of back side detection contents, the at least one recognition content includes a plurality of front side recognition contents and a plurality of back side recognition contents, and the information capturing assembly includes: a plurality of front side image capturing units, configured to capture the front side detection contents and the front side recognition contents; and a plurality of back side image capturing units, configured to capture the back side detection contents and the back side recognition contents. ### Claim 4 (depends on 3) The transparent display system according to claim 3, wherein the resource allocation includes controlling the front side image capturing units to obtain the front side recognition contents at different frame rates, and controlling the back side image capturing units to obtain the back side recognition contents at different frame rates. ### Claim 5 (depends on 3) The transparent display system according to claim 3, wherein the resource allocation includes controlling the recognition unit to recognize part of the front side recognition contents, and controlling the recognition unit to recognize part of the back side recognition contents. ### Claim 6 (depends on 1) The transparent display system according to claim 1, wherein the at least one detection content includes a plurality of wide-angle detection contents, the at least one recognition content includes a plurality of wide-angle recognition contents, each of the wide-angle detection contents covers front side of the transparent display and front side of the transparent display, each of the wide-angle recognition contents covers front side of the transparent display and front side of the transparent display, and the information capturing assembly includes: a plurality of wide-angle image capturing units, configured to capture the wide-angle detection contents and the wide-angle recognition contents. ### Claim 7 (depends on 6) The transparent display system according to claim 6, wherein the resource allocation includes controlling the wide-angle image capturing units to obtain the wide-angle recognition contents at different frame rates. ### Claim 8 (depends on 1) The transparent display system according to claim 1, wherein the at least one detection content includes a front side detection content and a back side detection content, the at least one recognition content includes a front side recognition content and a back side recognition content, and the information capturing assembly includes: a front side detection information capturing unit, configured to capture the front side detection content; a back side detection information capturing unit, configured to capture the back side detection content; a front side recognition information capturing unit, configure to capture the front side recognition content, wherein a resolution of the front side detection information capturing unit is lower than a resolution of the front side recognition information capturing unit; and a back side recognition information capturing unit, configured to capture the back side recognition content, wherein a resolution of the back side detection information capturing unit is lower than a resolution of the back side recognition information capturing unit, and the resource allocation includes controlling the recognition unit to recognize part of the front side recognition content and controlling the recognition unit to recognize part of the front side recognition content. ### Claim 9 (depends on 1) The transparent display system according to claim 1, wherein the at least one detection content includes a front side detection content and a back side detection content, the at least one recognition content includes a front side recognition content and a back side recognition content, and the information capturing assembly includes: a front side detection information capturing unit, configured to capture the front side detection content; a back side detection information capturing unit, configured to capture the back side detection content; a front side recognition information capturing unit, configured to capture the front side recognition content, wherein a resolution of the front side detection information capturing unit is lower than a resolution of the front side recognition information capturing unit, and a detection range of the front side detection information capturing unit is different from an image capturing range of the front side recognition information capturing unit; and a back side recognition information capturing unit, configured to capture the back side recognition content, wherein a resolution of the back side detection information capturing unit is lower than a resolution of the back side recognition information capturing unit, and a detection range of the back side detection information capturing unit is different from an image capturing range of the back side recognition information capturing unit. ### Claim 10 A control method of a transparent display system, comprising: detecting at least one user in front of a transparent display and at least one target object behind the transparent display according to at least one detection content; obtaining a resource allocation according to a detection result of the at least one detection content that is a presence of the user or the target object, wherein the resource allocation comprises setting different frame rates, different frequencies or different areas for image recognition or information recognition, or setting different switching conditions of the information capturing assembly; and obtaining at least one recognition content and recognizing at least one front side position of the at least one user and at least one back side position of the at least one target object according to the resource allocation. ### Claim 11 (depends on 10) The control method of the transparent display system according to claim 10, further comprising: joining the at least one front side position and joining the at least one back side position to respectively obtain at least one front side relative position and at least one back side relative position; integrating the at least one front side relative position and the at least one back side relative position to obtain at least one sight position; and outputting at least one display content to the transparent display according to the at least one sight position. ### Claim 12 (depends on 10) The control method of the transparent display system according to claim 10, wherein the at least one detection content includes a plurality of front side detection contents and a plurality of back side detection contents, the at least one recognition content includes a plurality of front side recognition contents and a plurality of back side recognition contents. ### Claim 13 (depends on 12) The control method of the transparent display system according to claim 12, wherein the resource allocation includes obtaining the front side recognition contents at different frame rates, and obtaining the back side recognition contents at different frame rates. ### Claim 14 (depends on 12) The control method of the transparent display system according to claim 12, wherein the resource allocation includes recognizing part of the front side recognition contents, and recognizing part of the back side recognition contents. ### Claim 15 (depends on 10) The control method of the transparent display system according to claim 10, wherein the at least one detection content includes a plurality of wide-angle detection contents, the at least one recognition content includes a plurality of wide-angle recognition contents, each of the wide-angle detection contents covers front side of the transparent display and front side of the transparent display, and each of the wide-angle recognition contents covers front side of the transparent display and front side of the transparent display. ### Claim 16 (depends on 15) The control method of the transparent display system according to claim 15, wherein the resource allocation includes obtaining the wide-angle recognition contents at different frame rates. ### Claim 17 (depends on 10) The control method of the transparent display according to claim 10, wherein the at least one detection content includes a front side detection content and a back side detection content, the at least one recognition content includes a front side recognition content and a back side recognition content, and a resolution of the front side detection content is lower than a resolution of the front side recognition content, a resolution of the back side detection content is lower than a resolution of the back side recognition content, and the resource allocation includes recognizing part of the front side recognition content and recognizing part of the back side recognition content. ### Claim 18 (depends on 10) The control method of the transparent display system according to claim 10, wherein the at least one detection content includes a front side detection content and a back side detection content, the at least one recognition content includes a front side recognition content and a back side recognition content, a resolution of the front side detection content is lower than a resolution of the front side recognition content, a resolution of the back side detection content is lower than a resolution of the back side recognition content, a detection range of the front side detection content is different from an image capturing range of the front side recognition content, and a detection range of the back side detection content is different from an image capturing range of the back side recognition content. ### Claim 19 A control device, comprising: a detection unit, configured to detect at least one user in front of the transparent display and at least one target object behind the transparent display according to the at least one detection content; a resource allocation unit, configured to obtain a resource allocation according to a detection result of the at least one detection content that is a presence of the user or the target object, wherein the resource allocation comprises setting different frame rates, different frequencies or different areas for image recognition or information recognition, or setting different switching conditions of the information capturing assembly; and a recognition unit, wherein the information capturing assembly obtains at least one recognition content according to the resource allocation, and the recognition unit obtains at least one front side position of the at least one user and at least one back side position of the at least one target object according to the resource allocation.