Speech recognition device, speech recognition system, and speech recognition method

A speech recognition device comprising:

• processing circuitry to
• individually separate uttered speech of a plurality of passengers each seated in one of a plurality of speech recognition target seats in a vehicle;
• perform speech recognition on the separated uttered speech of each of the passengers calculate a speech recognition score;
• comprehend intention of utterance of each of the passengers and calculate an intention comprehension score using a speech recognition result of each of the passengers;
• and
• determine an intention comprehension result of which of the passengers is to be used from among intention comprehension results for the respective passengers, using at least one of the speech recognition score or the intention comprehension score of each of the passengers;
• calculate a face feature amount for each of the passengers using an image capturing the plurality of passengers;
• and
• determine whether or not there is utterance for each of the passengers using the face feature amount from a start time to an end time of the uttered speech of each of the passengers,
• wherein, in a case where there are identical intention comprehension results that correspond to two or more passengers determined to be speaking, the processing circuitry determines an intention comprehension result of which of the passengers is adopted from among the intention comprehension results that correspond to the two or more passengers, using at least one of the speech recognition score or the intention comprehension score of each of the two or more passengers.

A speech recognition system comprising:

• processing circuitry to
• individually separate uttered speech of a plurality of passengers each seated in one of a plurality of speech recognition target seats in a vehicle;
• perform speech recognition on the separated uttered speech of each of the passengers and calculate a speech recognition score;
• comprehend intention of utterance of each of the passengers and calculating an intention comprehension score using a speech recognition result of each of the passengers;
• and
• determine an intention comprehension result of which of the passengers is to be used from among intention comprehension results for the respective passengers, using at least one of the speech recognition score or the intention comprehension score of each of the passengers;
• calculate a face feature amount for each of the passengers using an image capturing the plurality of passengers;
• and
• determine whether or not there is utterance for each of the passengers using the face feature amount from a start time to an end time of the uttered speech of each of the passengers,
• wherein, in a case where there are identical intention comprehension results that correspond to two or more passengers determined to be speaking, the processing circuitry determines an intention comprehension result of which of the passengers is adopted from among the intention comprehension results that correspond to the two or more passengers, using at least one of the speech recognition score or the intention comprehension score of each of the two or more passengers.

A speech recognition method comprising:

• individually separating uttered speech of a plurality of passengers each seated in one of a plurality of speech recognition target seats in a vehicle;
• performing speech recognition on the separated uttered speech of each of the passengers and calculating a speech recognition score;
• comprehending intention of utterance of each of the passengers and calculating an intention comprehension score using a speech recognition result of each of the passengers;
• determining an intention comprehension result of which of the passengers is to be used from among intention comprehension results for the respective passengers, using at least one of the speech recognition score or the intention comprehension score of each of the passengers;
• calculating a face feature amount for each of the passengers using an image capturing the plurality of passengers;
• determining whether or not there is utterance for each of the passengers using the face feature amount from a start time to an end time of the uttered speech of each of the passengers;
• and
• determining an intention comprehension result of which of the passengers is adopted from among the intention comprehension results that correspond to the two or more passengers, using at least one of the speech recognition score or the intention comprehension score of each of the two or more passengers in a case where there are identical intention comprehension results that correspond to two or more passengers determined to be speaking.