System

A system comprising:

• circuitry configured to:
• receive, via a communication interface coupled to a packet-switched network, audio information and device information comprising model information, screen information, and application information from a terminal device;
• apply speech recognition processing using a neural network-based automatic speech recognition model to produce character information, construct a prompt sentence concatenating the character information with structured device context fields, and input the prompt sentence to a generative neural network model to obtain intent data and operation procedure information;
• transmit the operation procedure information to the terminal device as a plurality of operation step information items mapped to operation target elements resolved from the screen information, wherein the terminal device superimposes visual guidance information on operation target regions and generates step-specific audio output information via speech synthesis;
• receive operation event data, determine correspondence between each operation event and a current step, record completed steps, and transmit step transition signals to the terminal device;
• and
• store operation event data and step information items as history information, apply a sequence prediction model to the history information to predict future intent, and individualize the prompt sentence by inserting personalization sections encoding candidate intent labels with probability scores.

A method comprising:

• receiving, via a communication interface coupled to a packet-switched network, audio information and device information from a terminal device and applying speech recognition processing to the audio information to produce character information;
• generating a prompt sentence based on the character information and the device information and inputting the prompt sentence to a generative neural network model to obtain response information comprising intent data and operation procedure information;
• transmitting the response information to the terminal device;
• receiving operation event data from the terminal device, determining whether each operation event corresponds to a current step among operation step information items, recording completed steps, and transmitting step transition signals;
• and
• storing the operation event data and the operation step information items as history information, predicting at least one of a future intent or a next operation of a user based on the history information, and individualizing at least one of the prompt sentence and the operation procedure information based on the prediction.