# US 11,910,178 B2 · Orientated display method and apparatus for audio device, and audio device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 11,910,178 B2
- Document ID: US11910178B2
- Status: Granted
- Kind: B2
- Application number: 17/309,136
- Filed: 2018-12-29
- Published: 2022-01-13
- Granted: 2024-02-20
- Earliest claimed: 2018-10-29
- Assignees: Goertek Inc.
- Applicants: Goertek Inc.
- Inventors: Jifu Zhao
- Web page: https://patentgrep.com/patent/US11910178B2

## CPC

- H04S 7/303: {Tracking of listener position or orientation}
- G05D 3/12: using feedback
- G06F 1/1605: {Multimedia displays, e.g. with integrated or attached speakers, cameras, microphones}
- G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback}
- G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51)
- G10L 15/22: Procedures used during a speech recognition process, e.g. man-machine dialogue
- H04N 13/117: the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
- H04N 13/366: using viewer tracking
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- H04R 1/028: {associated with devices performing functions other than acoustics, e.g. electric candles}
- G10L 2015/223: {Execution procedure of a spoken command}
- H04N 2013/0088: {Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image}
- H04R 2499/15: Transducers incorporated in visual displaying devices, e.g. televisions, computer displays, laptops
- H04S 2400/15: Aspects of sound capture and related signal processing for recording or reproduction
- H04S: STEREOPHONIC SYSTEMS
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A directional display method and device of audio equipment, and audio equipment are disclosed. The audio equipment comprises a camera module and a display screen that is circumferentially located on sides of the audio equipment. The display screen is rotatable relative to the audio equipment. The method comprises activating the camera module for panoramic shooting to detect a user position in response to an activation signal acquired; determining whether the display screen is in half screen display mode according to a relationship between the user position and a center position of the audio equipment; and when it is determined that the display screen is in half screen display mode, determining a compensation angle of a display direction of a half screen display area relative to the user position, and adjusting the display direction of the half screen display area so that the compensation angle is zero.

## Claims

### Claim 1

A directional display method of audio equipment, wherein the audio equipment comprises a camera module and a display screen that is circumferentially located on sides of the audio equipment, the display screen is rotatable relative to the audio equipment, and the method comprises:
activating the camera module for panoramic shooting to detect a user position in response to an activation signal acquired;
determining whether the display screen is in half screen display mode according to a relationship between the user position and a center position of the audio equipment; and
when it is determined that the display screen is in half screen display mode, determining a compensation angle of a display direction of a half screen display area relative to the user position, and adjusting the display direction of the half screen display area so that the compensation angle is zero,
wherein the display direction includes a direction of display position indicated by a first connection line between the center position of the audio equipment and an arc center position of the half screen display area, wherein the center position of the audio equipment is located on a space central vertical line of the audio equipment,
wherein activating the camera module for panoramic shooting to detect the user position comprises:
continuously taking pictures using the camera module to acquire panoramic images centered on the center position of the audio equipment;
determining a target in the panoramic image as a detected user according to position changes of the target relative to a background in the panoramic images at different moments; and
determining the user position relative to a circumference of the display screen according to the user position in the panoramic image and a preset relationship between a length of the panoramic image and a perimeter of the circumference of the display screen.

### Claim 2 (depends on 1)

The method according to claim 1, wherein the camera module includes at least one panoramic camera, or at least one set of binocular cameras, or a spherical camera array having multiple cameras.

### Claim 3 (depends on 2)

An audio equipment, comprising a camera module and a display screen that is circumferentially located on sides of the audio equipment, wherein the display screen is rotatable relative to the audio equipment, the audio equipment further comprises a processor and a non-transitory machine-readable storage medium having machine-executable instructions stored thereon, and the processor can execute the directional display method of audio equipment according to claim 2, by reading and executing the machine-executable instructions in the machine-readable storage medium.

### Claim 4 (depends on 1)

An audio equipment, comprising a camera module and a display screen that is circumferentially located on sides of the audio equipment, wherein the display screen is rotatable relative to the audio equipment, the audio equipment further comprises a processor and a non-transitory machine-readable storage medium having machine-executable instructions stored thereon, and the processor can execute the directional display method of audio equipment according to claim 1, by reading and executing the machine-executable instructions in the machine-readable storage medium.

### Claim 5 (depends on 4)

The audio equipment according to claim 4, wherein the display screen rotatable relative to the audio equipment is provided in an upper casing of the audio equipment, a gear is provided inside the upper casing of the audio equipment, a gear ring meshing with the gear is provided on the inner wall of the lower casing of the audio equipment, and the gear is driven by a motor.

### Claim 6 (depends on 1)

A non-transitory machine-readable storage medium having machine-executable instructions stored thereon, wherein when executed by a processor, the machine-executable instructions can realize the directional display method of audio equipment according to claim 1.

### Claim 7 (depends on 1)

The method according to claim 1, wherein determining whether the display screen is in half screen display mode according to a relationship between the user position and a center position of the audio equipment comprises:
acquiring a second connection line between a position corresponding to a user at one end of the panoramic image and a center position of the audio equipment on the circumference of the display screen, and acquiring a third connection line between a position corresponding to a user at the other end of the panoramic image and a center position of the audio equipment on the circumference of the display screen;
acquiring a first included angle between the second connection line and the third connection line, and determining a first projection angle of the first included angle on the horizontal plane, according to a horizontal distance and a vertical distance between the center position of the audio equipment and the circumference of the display screen; and
determining whether the display screen is in half screen display mode according to the first projection angle.

### Claim 8 (depends on 7)

The method according to claim 7, wherein determining whether the display screen is in half screen display mode according to the first projection angle comprises:
when the first projection angle is greater than a preset angle, determining that the display screen is in full screen display mode;
when the first projection angle is not greater than the preset angle, determining that the display screen is in half screen display mode.

### Claim 9 (depends on 7)

The method according to claim 7, wherein when it is determined that the display screen is in half screen display mode, determining a compensation angle of the display direction of the half screen display area relative to the user position comprises:
acquiring a second included angle between an angle bisector of the first included angle and the first connection line, and determining a second projection angle of the second included angle on the horizontal plane as a compensation angle of the display direction of the half screen display area relative to the user position, according to a horizontal distance and a vertical distance between the center position of the audio equipment and the circumference of the display screen.

### Claim 10

A directional display device of audio equipment, wherein the audio equipment comprises a camera module and a display screen that is circumferentially located on sides of the audio equipment, the display screen is rotatable relative to the audio equipment, and the device comprises:
a detecting unit for activating the camera module for panoramic shooting to detect a user position in response to an activation signal acquired;
a judging unit for determining whether the display screen is in half screen display mode according to a relationship between the user position and a center position of the audio equipment; and
a calculating and adjusting unit for, when it is determined that the display screen is in half screen display mode, determining a compensation angle of a display direction of a half screen display area relative to the user position, and adjusting the display direction of the half screen display area so that the compensation angle is zero,
wherein the display direction includes a direction of display position indicated by a first connection line between the center position of the audio equipment and an arc center position of the half screen display area, wherein the center position of the audio equipment is located on a space central vertical line of the audio equipment,
wherein activating the camera module for panoramic shooting to detect the user position comprises:
continuously taking pictures using the camera module to acquire panoramic images centered on the center position of the audio equipment;
determining a target in the panoramic image as a detected user according to position changes of the target relative to a background in the panoramic images at different moments; and
determining the user position relative to a circumference of the display screen according to the user position in the panoramic image and a preset relationship between a length of the panoramic image and a perimeter of the circumference of the display screen.