# US 2024/0267452 A1 · Mobile communication system with whisper functions

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0267452 A1
- Document ID: US20240267452A1
- Status: Published application
- Kind: A1
- Application number: 18/294,832
- Filed: 2022-08-23
- Published: 2024-08-08
- Earliest claimed: 2021-08-24
- Inventors: Marthinus Johannes VAN DER WESTHUIZEN
- Web page: https://patentgrep.com/patent/US20240267452A1

## CPC

- H04M 1/72403: with means for local support of applications that increase the functionality
- H04R 1/1083: {Reduction of ambient noise (active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06)}
- G10L 15/02: Feature extraction for speech recognition; Selection of recognition unit
- G10L 15/25: using position of the lips, movement of the lips or face analysis
- G10L 21/0208: Noise filtering
- H04M 1/18: Telephone sets specially adapted for use in ships, mines, or other places exposed to adverse environment (H04M1/19 takes precedence)
- H04M 1/724: User interfaces specially adapted for cordless or mobile telephones
- H04R 1/1016: {Earpieces of the intra-aural type}
- G10L 2015/025: {Phonemes, fenemes or fenones being the recognition units}
- H04M 1/6058: {involving the use of a headset accessory device connected to the portable telephone}
- H04M 2250/52: including functional features of a camera
- H04M 2250/74: with voice recognition means
- H04R 1/1033: {Cables or cables storage, e.g. cable reels (cord reels per se H02G11/02; arrangements for storing and repeatedly paying-out and re-storing lengths of conductors or cables B65H75/34; extensible conductors or cables, e.g. self-coiling cords H01B7/06)}
- H04R 2460/13: Hearing devices using bone conduction transducers
- H04R 2499/11: Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
- H04M: TELEPHONIC COMMUNICATION (circuits for controlling other apparatus via a telephone cable and not involving telephone switching apparatus G08)
- H04R: LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS (producing sounds with frequency not determined by supply frequency G10K)
- G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING

## Abstract

Methods, devices and computer-readable medium are provided in the field of whisper communications features of mobile phones such as for communicating in noisy environments or wherein the users of the communication system require privacy. The invention provides for capturing elements of whisper communication including sound and lips information expressed by a first user and converting the elements of whisper communication into signals suitable for transmission over a communications network, transmitting the signals over the communication network, receiving the signals and reconverting the signals into elements of whisper communication and replaying the whisper communication such that it can be perceived by a second user. Embodiments include microphones in combination with dedicated lips cameras attached to mobile phones, sound equalization processing and extendable earphones and lip display means

## Claims

### Claim at position 1

1-33. (canceled)

### Claim 34

A method comprising: capturing elements of whisper communication expressed by a first user and converting the elements of whisper communication into signals suitable for transmission over a communications network; transmitting the signals over the communication network; receiving the signals and reconverting the signals into elements of whisper communication and replaying the whisper communication such that it can be perceived by a second user; wherein the elements of whisper communication comprise sound information associated with phonemes of speech and image information of facial organs associated with phonemes of speech.

### Claim 35 (depends on 34)

The method as defined in claim 34, wherein the capturing and converting is performed by means comprising at least one whisper sound microphone and at least one lips video camera;
wherein the reconverting is performed by means comprising at least a whisper sound reproduction device and a lips display device; wherein the whisper sound microphone, the lips video camera, the whisper sound replay device and the lips display device are whisper features of a mobile telephone.

### Claim 36 (depends on 35)

The method as defined in claim 35, wherein the lips video camera is located substantially near the at least one whisper sound microphone; wherein the lips video camera substantially captures only a mouth area of the first user when the mobile telephone is held in a normal position with a top portion of the phone close to the first user's ear and a bottom portion of the phone close to the first user's mouth.

### Claim 37 (depends on 35)

The method as defined in claim 35, wherein the whisper sound replay device is an extendable earphone fixedly attached to the mobile telephone.

### Claim 38 (depends on 35)

The method as defined in claim 35, wherein the whisper sound replay device is a bone conduction device.

### Claim 39 (depends on 35)

The method as defined in claim 35, wherein images from the lips video camera are processed to identify phonemes from the shape of the mouth of the first user.

### Claim 40 (depends on 35)

The method as defined in claim 35, wherein the signals are equalized by digital filtering and sound mixing for disambiguation of the transmitted whisper communication.

### Claim 41

An electronic device for whisper communication, comprising: a means for capturing elements of whisper communication expressed by a first user and converting the elements of whisper communication into signals suitable for transmission over a communication network; a means for transmitting the signals over the communication network; a means for receiving the signals and reconverting the signals into elements of whisper communication and replaying the whisper communication such that it can be perceived by a second user; wherein the elements of whisper communication comprise sound information associated with phonemes of speech and image information of facial organs associated with phonemes of speech.

### Claim 42 (depends on 41)

The device as defined in claim 41, wherein the capturing and converting is performed by means comprising at least one whisper sound microphone and at least one lips video camera; wherein the reconverting is performed by means comprising at least a whisper sound reproduction device and a lips display device; wherein the whisper sound microphone, the lips video camera, the whisper sound replay device and the lips display device are whisper features of a mobile telephone.

### Claim 43 (depends on 42)

The device as defined in claim 42, wherein the lips video camera is located substantially near the at least one whisper sound microphone; wherein the lips video camera substantially captures only a mouth area of the first user when the mobile telephone is held in a normal position with a top portion of the phone close to the first user's ear and a bottom portion of the phone close to the first user's mouth.

### Claim 44 (depends on 42)

The device as defined in claim 42, wherein the whisper sound replay device is an extendable earphone fixedly attached to the mobile telephone.

### Claim 45 (depends on 42)

The device as defined in claim 42, wherein the whisper sound replay device is a bone conduction device.

### Claim 46 (depends on 42)

The device as defined in claim 42, wherein images from the lips video camera are processed to identify phonemes from the shape of the mouth of the first user.

### Claim 47 (depends on 42)

The device as defined in claim 42, wherein the signals are equalized by digital filtering and sound mixing for disambiguation of the transmitted whisper communication.

### Claim 48

A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by one or more processors, configure the one or more processors to perform operations comprising: capturing elements of whisper communication expressed by a first user and converting the elements of whisper communication into signals suitable for transmission over a communication network; transmitting the signals over the communication network; receiving the signals and reconverting the signals into elements of whisper communication and replaying the whisper communication such that it can be perceived by a second user; wherein the elements of whisper communication comprise sound information associated with phonemes of speech and image information of facial organs associated with phonemes of speech.

### Claim 49 (depends on 48)

The storage medium as defined in claim 48, wherein the capturing and converting is performed by means comprising at least one whisper sound microphone and at least one lips video camera; wherein the reconverting is performed by means comprising at least a whisper sound reproduction device and a lips display device; wherein the whisper sound microphone, the lips video camera, the whisper sound replay device and the lips display device are whisper features of a mobile telephone.

### Claim 50 (depends on 49)

The storage medium as defined in claim 49, wherein the lips video camera is located substantially near the at least one whisper sound microphone; wherein the lips video camera substantially captures only a mouth area of the first user when the mobile telephone is held in a normal position with a top portion of the phone close to the first user's ear and a bottom portion of the phone close to the first user's mouth.

### Claim 51 (depends on 49)

The storage medium as defined in claim 49, wherein the whisper sound replay device is an extendable earphone fixedly attached to the mobile telephone.

### Claim 52 (depends on 49)

The storage medium as defined in claim 49, wherein the whisper sound replay device is a bone conduction device.

### Claim 53 (depends on 49)

The storage medium as defined in claim 49, wherein images from the lips video camera are processed to identify phonemes from the shape of the mouth of the first user.

### Claim 54 (depends on 49)

The storage medium as defined in claim 49, wherein the signals are equalized by digital filtering and sound mixing for disambiguation of the transmitted whisper communication.
