# US 10,372,287 B2 · Headset device and visual feedback method and apparatus thereof

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,372,287 B2
- Document ID: US10372287B2
- Status: Granted
- Kind: B2
- Application number: 15/504,078
- Filed: 2015-09-22
- Published: 2018-03-08
- Granted: 2019-08-06
- Earliest claimed: 2015-05-06
- Assignees: Baidu Online Network Technology (Beijing) Co., Ltd.
- Applicants: Baidu Online Network Technology (Beijing) Co., Ltd.
- Inventors: Sicong Zhao; Jiawei Gu; Yunlong Zhang; Lei Li; Guang Li
- Web page: https://patentgrep.com/patent/US10372287B2

## CPC

- G06F 3/04812: Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
- G02B 27/017: {Head mounted}
- G06F 1/163: {Wearable computers, e.g. on a belt}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 1/182: {with special features, e.g. for use in industrial environments; grounding or shielding against radio frequency interference [RFI] or electromagnetical interference [EMI]}
- G06F 3/005: {Input arrangements through a video camera}
- G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- G09G 3/3406: {Control of illumination source (illumination devices structurally associated with liquid crystal cells G02F1/1336)}
- G09G 5/003: {Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto (specific for a CRT G09G1/165; for a flat panel G09G3/2092)}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- H04R 5/0335: {Earpiece support, e.g. headbands or neckrests (for monophonic headphones H04R1/105)}
- H04R 2460/17: Hearing device specific tools used for storing or handling hearing devices or parts thereof, e.g. placement in the ear, replacement of cerumen barriers, repair, cleaning hearing devices
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)

## Abstract

A head worn equipment and visual feedback method and device thereof. The head worn equipment includes: a support frame, an image acquiring component, a display component, and a processor. The image acquiring component and the display component are disposed on the support frame. When the head worn equipment is in use, the display component is within a visual perception range of a user. The image acquiring component is configured to acquire a captured image. The processor acquires the captured image acquired by the image acquiring component, determines an indication color for display on the basis of the captured image, and controls the display component to display the indication color, so as to indicate a viewing direction of the image acquiring component for the user.

## Claims

### Claim 1

A headset device, comprising a frame, an image acquisition component, a display component and a processor;
the image acquisition component and the display component arranged on the frame, the display component positioned within visual perception reach of a user when the headset device is in use;
the image acquisition component configured to acquire a viewfinder image; and
the processor obtaining the viewfinder image acquired by the image acquisition component, determining an indication color to be displayed by analyzing and processing the viewfinder image, and controlling the display component to display the indication color to indicate a viewfinder orientation of the image acquisition component to the user.

### Claim 2 (depends on 1)

The headset device according to claim 1, wherein the processor is configured to:
obtain a color value of each pixel within a preset area in the viewfinder image; and
determine the indication color based on the color value of the each pixel within the preset area.

### Claim 3 (depends on 2)

The headset device according to claim 2, wherein
the processor determines the color value shown by most pixels in the preset area as the color value of the indication color; or
the processor determines a mean color value of pixels in the preset area as the color value of the indication color.

### Claim 4 (depends on 2)

The headset device according to claim 2, wherein the preset area is an area in a center of the viewfinder image.

### Claim 5 (depends on 1)

The headset device according to claim 1, wherein the display component comprises a full-color LED or a full-color display screen.

### Claim 6 (depends on 5)

The headset device according to claim 5, wherein the full-color display screen comprises at least one of: a full-color LED display screen and a full-color OLED display screen.

### Claim 7

A headset device, comprising a frame, an image acquisition component, a display component and a communication unit;
the image acquisition component and the display component arranged on the frame, and when the headset device is in use, the display component positioned within visual perception reach of a user;
the image acquisition component configured to acquire a viewfinder image;
the communication unit configured to transmit the viewfinder image acquired by the image acquisition component to a cloud processor, the cloud processor determining the indication color to be displayed based on the viewfinder image, and to receive information for determining the indication color sent by the cloud processor; and
the display component configured to display the indicator color based on the information, in order to indicate the viewfinder orientation of the image acquisition component to the user.

### Claim 8

A visual feedback method used in a headset device, comprising:
obtaining an acquired viewfinder image;
determining an indication color to be displayed by analyzing and processing on the viewfinder image; and
displaying the indication color in order to indicate the viewfinder orientation to the user.

### Claim 9 (depends on 8)

The method according to claim 8, the determining an indication color to be displayed based on the viewfinder image comprising:
obtaining a color value of each pixel within a preset area in the viewfinder image; and
determining the indication color based on the color value of the each pixel within the preset area.

### Claim 10 (depends on 9)

The method according to claim 9, the determining the indication color based on the color value of each pixel within the preset area comprising:
determining the color value shown by most pixels in the preset area as the color value of the indication color; or
determining a mean color value of pixels in the preset area as the color value of the indication color.

### Claim 11 (depends on 8)

The method according to claim 8, wherein a full-color LED or a full-color display screen is adopted to display the indication color.

### Claim 12

A visual feedback apparatus used for a headset device, comprising:
an obtaining unit, configured to obtain an acquired viewfinder image;
a determining unit, configured to determine the indication color to be displayed based on the viewfinder image; and
a displaying unit, configured to display the indicator color in order to indicate the viewfinder orientation to the user.

### Claim 13 (depends on 12)

The apparatus according to claim 12, wherein the determining unit comprises:
a color value obtaining subunit, configured to obtain a color value of each pixel within a preset area in the viewfinder image; and
an indication color determining subunit, configured to determine the indication color based on the color value of each pixel within the preset area.

### Claim 14 (depends on 13)

The apparatus according to claim 13, wherein the indication color determining subunit is configured to:
determine the color value shown by most pixels in the preset area as the color value of the indication color; or
determine a mean color value of pixels in the preset area as the color value of the indication color.

### Claim 15

A non-transitory computer storage medium, storing one or more programs, when the one or more programs are executed by a device, the nonvolatile computer storage medium enables the device to:
obtain an acquired viewfinder image;
determine an indication color to be displayed by analyzing and processing the viewfinder image; and
display the indication color in order to indicate the viewfinder orientation to the user.