Vehicle component voice control based on image captures

A vehicle system comprising:

• a communication device configured to receive data indicating an utterance of a user in a vehicle;
• a camera configured to capture a vehicle image of the vehicle, wherein the vehicle image includes an image of a plurality of vehicle components of the vehicle, wherein the vehicle image comprises an image corresponding to a portion of a vehicle interior of the vehicle, and wherein the plurality of vehicle components of the vehicle comprise a plurality of vehicle components equipped in the vehicle interior of the vehicle;
• at least one processor;
• and
• memory storing instructions that, when executed by the at least one processor, cause the vehicle system to:
• control, based on a condition being satisfied, the camera to capture the vehicle image;
• determine, based on the data indicating the utterance of the user, an action and a control target intended by the user, wherein the control target is a controllable vehicle component of the plurality of vehicle components;
• and
• generate, based on a determination of the action and the control target, a result processing signal for displaying a guide image on a display provided inside the vehicle,
• wherein the guide image comprises the vehicle image, a graphic object, and a plurality of indicators,
• wherein the graphic object comprises a contour indicating a boundary of each of a plurality of objects comprised in the vehicle image,
• wherein the graphic object and the plurality of indicators are superimposed on the vehicle image,
• wherein the graphic object indicates a plurality of portions, of the vehicle image defined by the contour,
• wherein the plurality of vehicle components of the vehicle correspond to different indicators of the plurality of indicators,
• wherein each of the plurality of indicators is respectively superimposed on one of the plurality of portions, and
• wherein the instructions, when executed by the at least one processor, cause the vehicle system to:
• control, based on a user utterance associated with at least one indicator of the plurality of indicators, a control target that corresponds to the at least one indicator and is a controllable vehicle component of the plurality of vehicle components.

An apparatus comprising:

• a camera configured to capture an object image, wherein the object image includes an image of a plurality of vehicle components of a vehicle, wherein the object image comprises an image corresponding to a portion of a vehicle interior of the vehicle, and wherein the plurality of vehicle components of the vehicle comprise a plurality of vehicle components equipped in the vehicle interior of the vehicle;
• a communication device configured to receive data indicating an utterance of a user of the vehicle;
• and
• a controller configured to:
• determine, based on the data indicating the utterance of the user, a plurality of indicators;
• based on a condition being satisfied, control the camera to capture the object image, and control a display of the vehicle to display a guide image, wherein the guide image comprises the object image, a graphic object, and the plurality of indicators, wherein the graphic object comprises a two-dimensional (2D) grid superimposed on the object image, wherein the graphic object indicates a plurality of portions, of the object image, defined by the 2D grid, wherein each of the plurality of indicators is respectively superimposed on one of the plurality of portions, wherein the plurality of vehicle components of the vehicle correspond to different indicators of the plurality of indicators;
• and
• generate, based on a subsequent user utterance input associated with at least one indicator of the plurality of indicators, a control signal to control a control target corresponding to the at least one indicator, wherein the control target is a controllable vehicle component of the plurality of vehicle components, and wherein the control target is associated with a controllable portion of a single object controllable by the user.