# US 12,223,114 B2 · Interactive control apparatus and interactive system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,223,114 B2 - Document ID: US12223114B2 - Status: Granted - Kind: B2 - Application number: 17/786,234 - Filed: 2021-06-24 - Published: 2024-06-06 - Granted: 2025-02-11 - Earliest claimed: 2021-06-24 - Assignees: Beijing BOE Technology Development Co., Ltd.; Boe Technology Group Co., Ltd. - Applicants: Beijing BOE Technology Development Co., Ltd.; Boe Technology Group Co., Ltd. - Inventors: Zongmin Liu; Li Ma; Feng Qu; Dongdong Zhang; Wei Li; Xichao Fan; Junwei Guo; Biqi Li - Web page: https://patentgrep.com/patent/US12223114B2 ## CPC - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G01S 7/03: Details of HF subsystems specially adapted therefor, e.g. common to transmitter and receiver - G01S 7/415: {Identification of targets based on measurements of movement associated with the target} - G01S 7/417: {involving the use of neural networks} - G01S 13/88: Radar or analogous systems specially adapted for specific applications (electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00) - G05B 19/418: Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - H01Q 21/065: {Patch antenna array} - G01S 7/356: {involving particularities of FFT processing} - G01S 13/343: {using sawtooth modulation} - G01S 13/584: {adapted for simultaneous range and velocity measurements} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G05B: CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS (systems for controlling or regulating non-electric variables G05D; systems for regulating electric or magnetic variables G05F; control devices or systems insofar as characterised by mechanical features only G05G) - H01Q: ANTENNAS, i.e. RADIO AERIALS (radiators or antennas for microwave heating H05B6/72) ## Abstract The present disclosure provides an interactive control apparatus and an interactive system. The interactive control apparatus includes: an antenna array configured to transmit a radar signal and receive a reflected echo signal; a data processing assembly configured to determine, according to the radar signal and the echo signal, a body action and a corresponding control instruction, and output the control instruction to a terminal device; and a display assembly configured to display the determined body action and/or control instruction. ## Claims ### Claim 1 An interactive control apparatus, comprising: an antenna array configured to transmit a radar signal and receive a reflected echo signal; a data processing assembly configured to determine, according to the radar signal and the echo signal, a body action and a corresponding control instruction, and output the control instruction to a terminal device; and a display assembly configured to display the determined body action and/or control instruction; wherein the display assembly comprises a display in which the antenna array is integrated, and the antenna array comprises a reference electrode layer, a dielectric layer, and a radiation electrode layer sequentially stacked together. ### Claim 2 (depends on 1) The interactive control apparatus according to claim 1, wherein the data processing assembly is further configured to mix and analyze the radar signal and the echo signal to obtain reflection object information, and recognize the body action according to the reflection object information to determine the corresponding control instruction; wherein the reflection object information comprises at least one of distance information, speed information, or angle of arrival information. ### Claim 3 (depends on 2) The interactive control apparatus according to claim 2, wherein the radar signal is a frequency modulated continuous wave signal. ### Claim 4 (depends on 2) The interactive control apparatus according to claim 2, wherein the data processing assembly comprises: a first processing core and a second processing core; the first processing core is configured to perform analysis and computation according to a signal obtained by mixing the radar signal and the echo signal to generate the reflection object information, wherein the analysis and computation comprises: at least one of one-dimensional fast Fourier transformation, two-dimensional fast Fourier transformation, or computation of an angle of arrival; and the second processing core is configured to perform chirp control on the radar signal to pre-train and generate a body action recognition network, and recognize the body action through the body action recognition network according to the reflection object information, and determine the corresponding control instruction. ### Claim 5 (depends on 1) The interactive control apparatus according to claim 1, wherein the display has a display region, and a peripheral region surrounding the display region; and the antenna array is integrated in the peripheral region, and the reference electrode layer and the radiation electrode layer each comprise a planar electrode. ### Claim 6 (depends on 1) The interactive control apparatus according to claim 1, wherein the display has a display region, and a peripheral region surrounding the display region; and the antenna array is integrated in the display region, and the reference electrode layer and the radiation electrode layer each comprise a metal mesh. ### Claim 7 (depends on 6) The interactive control apparatus according to claim 6, wherein the display is a liquid crystal display comprising a first display panel, a first polarizer on a display surface of the first display panel, and a second polarizer on a side of the first display panel distal to the first polarizer. ### Claim 8 (depends on 7) The interactive control apparatus according to claim 7, wherein the antenna array is attached to a side of the first polarizer distal to the display surface of the first display panel. ### Claim 9 (depends on 7) The interactive control apparatus according to claim 7, wherein the first display panel comprises a color filter layer, a liquid crystal layer and a backplane sequentially stacked together; and the antenna array is integrated between the first polarizer and the color filter layer. ### Claim 10 (depends on 9) The interactive control apparatus according to claim 9, wherein the display further comprises a touch layer; and the touch layer is disposed between the color filter layer and the antenna array or between the color filter layer and the liquid crystal layer. ### Claim 11 (depends on 6) The interactive control apparatus according to claim 6, wherein the display is an OLED display comprising a second display panel, and a third polarizer on a display surface of the second display panel. ### Claim 12 (depends on 11) The interactive control apparatus according to claim 11, wherein the antenna array is attached to a side of the third polarizer distal to the display surface of the second display panel. ### Claim 13 (depends on 11) The interactive control apparatus according to claim 11, wherein the second display panel comprises a thin film package layer and an OLED layer stacked together; and the antenna array is integrated between the third polarizer and the thin film package layer. ### Claim 14 (depends on 13) The interactive control apparatus according to claim 13, wherein the display further comprises a touch layer; and the touch layer is disposed between the thin film package layer and the antenna array, or between the third polarizer and the thin film package layer such that the antenna array is integrated in the touch layer. ### Claim 15 (depends on 1) The interactive control apparatus according to claim 1, further comprising a printed circuit board, wherein the data processing assembly is disposed on the printed circuit board, and the antenna array performs signal transmission with the data processing assembly through a flexible cable. ### Claim 16 (depends on 1) The interactive control apparatus according to claim 1, further comprising a printed circuit board, wherein the data processing assembly is disposed on the printed circuit board, and the antenna array is packaged in the data processing assembly. ### Claim 17 (depends on 1) The interactive control apparatus according to claim 1, wherein the display assembly comprises a routing gateway unit; the routing gateway unit is configured to receive media data; and the display assembly is further configured to display according to the media data. ### Claim 18 (depends on 1) An interactive system, comprising: a terminal device and an interactive control apparatus; wherein the interactive control apparatus is the interactive control apparatus according to claim 1; and the terminal device is configured to operate according to the control instruction output from the interactive control apparatus. ### Claim 19 An interactive control apparatus, comprising: an antenna array configured to transmit a radar signal and receive a reflected echo signal; a data processing assembly configured to determine, according to the radar signal and the echo signal, a body action and a corresponding control instruction, and output the control instruction to a terminal device; and a display assembly configured to display the determined body action and/or control instruction; wherein the data processing assembly comprises: a low noise amplifier, a mixer, an intermediate frequency amplifier, an analog-to-digital converter, a digital front-end component, a cache, a power amplifier, a power divider, and a waveform generator; wherein the low noise amplifier, the mixer, the intermediate frequency amplifier, the analog-to-digital converter, the digital front-end component, and the cache are connected to each other in sequence; the waveform generator, the power divider, and the power amplifier are connected to each other in sequence; and an input terminal of the mixer is further connected to the power divider, an input terminal of the low noise amplifier is connected to the antenna array, and an output terminal of the power amplifier is connected to the antenna array. ### Claim 20 (depends on 19) An interactive system, comprising: a terminal device and an interactive control apparatus; wherein the interactive control apparatus is the interactive control apparatus according to claim 19; and the terminal device is configured to operate according to the control instruction output from the interactive control apparatus.