Back to results
US 12,758,132 B2Granted
Hearing attentional state estimation apparatus, learning apparatus, method, and program thereof
AssigneeNTT, Inc.
InventorsYuta Suzuki, Hsin-I Liao, Shigeto Furukawa, Yung-Hao Yang
Life of this patent
Estimating the term…
Abstract
A feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns corresponding to a plurality of different sound sources and a pupil diameter change amount of a user is obtained, and a destination to which the user pays auditory attention for a sound from the sound source is estimated using the feature quantity.
Claims11
An auditory attention state estimation apparatus comprising:
- a feature quantity extraction processing circuitry configured to obtain a feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns emitted from respective light sources installed at respective positions of a plurality of different sound sources and a pupil diameter change amount of a user, wherein a light source of the respective light sources is installed in a corresponding sound source of the plurality of different sound sources;
- and
- an estimation processing circuitry configured to estimate a destination to which the user pays auditory attention for a sound from the sound source using the feature quantity.
A learning apparatus comprising:
- a learning processing circuitry configured to obtain an estimation model through learning processing using training data,
- wherein the estimation model after being trained performs receiving a feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns emitted from respective light sources installed at respective positions of a plurality of different sound sources and a pupil diameter change amount of a user, and estimating a destination to which the user pays auditory attention for a sound from the sound source,
- a light source of the respective light sources is installed in a corresponding sound source of the plurality of different sound sources,
- the training data comprises a training feature quantity based on the strength of a correlation between each of a plurality of different training visual stimulus patterns emitted from respective light sources installed at respective positions of a plurality of different training sound sources and a training pupil diameter change amount is associated with correct answer information, and
- the correct answer information comprises a destination to which auditory attention is paid for a training sound from the training sound source.
2 more elements
An auditory attention state estimation method comprising:
- a feature quantity extraction step of obtaining a feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns emitted from respective light sources installed at respective positions of a plurality of different sound sources and a pupil diameter change amount of a user, wherein a light source of the respective light sources is installed to a corresponding sound source of the plurality of different sound sources;
- and
- an estimation step of estimating a destination to which the user pays auditory attention for a sound from the sound source using the feature quantity.
A learning method comprising:
- a learning step of obtaining an estimation model through learning processing using training data,
- wherein the estimation model after being trained performed receiving a feature quantity based on the strength of a correlation between each of a plurality of different visual stimulus patterns emitted from respective light sources installed at respective positions of a plurality of different sound sources and a pupil diameter change amount of a user, and estimating a destination to which the user pays auditory attention for a sound from the sound source,
- a light source of the respective light sources is installed in a corresponding sound source of the plurality of different sound sources,
- the training data comprises a training feature quantity based on the strength of a correlation between each of a plurality of different training visual stimulus patterns emitted from respective light sources that are installed at respective positions of a plurality of different training sound sources and a training pupil diameter change amount is associated with correct answer information, and
- the correct answer information comprises a destination to which auditory attention is paid for a training sound from the training sound source.
2 more elements
Dependencies are inferred from the claim text.