Back to results
US 12,646,421 B2Granted
Methods to assist verbal communication for both listeners and speakers
OwnerHiroki Satoinventor
Life of this patent
Estimating the term…
Abstract
Methods implemented in a system utilizing computing programs for a speaker and a listener in conversation are provided. Aspects include (i) a reminder provisioner for a speaker which is triggered according to speed, pitch or volume of the speaker's speech, (ii) a speech training provisioner for a speaker, and (iii) an application which records and plays back difficult conversation to understand.
Claims6
A system for communication for hard-of-hearing people including listeners and speakers, the system comprising:
- a computing device having one or more microphones which is held by the speaker and listener, wherein the microphone is configured to receive audio data from the speaker;
- one or more computing program in connection with the computing device;
- the computer program is configured to evaluate the audio data received from the speaker, the received audio data is evaluated based on one or more parameters of the received audio data, including;
- a) the speech speed calculated by character or word per second or other metrics,
- b) the pitch/frequency (Hz) and its transition, and
- c) the volume (dB);
- the computing program is configured to evaluate the received audio data with a threshold value and the threshold value is updated, based on the data provided by the listener to the system,
- wherein the threshold values (minimum and maximum values) in evaluation of speakers' speech, which are utilized to determine when to give users feedback, are configured manually by users or by the system, which sets preset threshold values for usually difficult sound and the system provides personalized values according to each user's hearing capability by utilizing the previously recorded audio data labeled as difficult and training the system;
- wherein the system learns each user's hearing preference and hearing capability from the audio data labeled as difficult and automatically adjusts the threshold value;
- and
- one or more electronic device is configured to give personalized feedback to the speaker based on the evaluation of the received audio data where the feedback to the speaker includes visual representation and haptic feedback and aural feedbacks on one or more of the parameters including pitch, speed and volume of the speaker's speech, and the feedback is used for the purpose of training of the speech of the speaker,
- wherein the one or more computer program configured to record conversation and dividing the audio data into small blocks and storing it on a server, and
- wherein the server is configured to allow the listener to play back or save the audio data, that captures the conversation part that is difficult to understand for the listener, which is labeled as difficult by the system.
10 more elements
Dependencies are inferred from the claim text.