System

A system comprising:

• circuitry configured to:
• receive, via a communication interface coupled to a packet-switched network, a prompt sentence from a terminal device, and operate a generative neural network model using the prompt sentence to generate experience scenario data as structured data comprising environment configuration parameters, object attribute parameters, character behavior parameters, goal condition parameters, and interaction rule parameters conforming to a predefined scenario schema;
• configure an execution unit by constructing a scene graph from environment configuration parameters, setting physical simulation parameters and path-finding graph structures, and executing a virtual space simulation at a fixed time-step interval, encoding the simulation output as a time-continuous data stream using delta state compression and adaptive bitrate streaming;
• transmit the time-continuous data stream to a plurality of terminal devices via the communication interface, and coordinate shared virtual space state updates using a conflict resolution procedure that applies a logical clock mechanism to concurrent state update messages;
• acquire sensor data from a terminal device, apply a multimodal fusion model combining facial action unit features and prosodic features to compute an emotion state classification and intensity value, and update character behavior parameters and event control conditions of the execution unit based on the emotion state classification;
• and
• generate character utterance responses by operating the generative neural network model with a character utterance prompt comprising virtual space state, emotion state classification, and character personality specification, convert generated response text to synthesized audio using a text-to-speech synthesis model, and include synchronized animation and audio data in the time-continuous data stream.

A method comprising:

• receiving, via a communication interface coupled to a packet-switched network, a prompt sentence from a terminal device specifying scenario generation parameters, and operating a generative neural network model using the prompt sentence to generate experience scenario data as structured data comprising environment configuration parameters, object attribute parameters, character behavior parameters, goal condition parameters, and interaction rule parameters;
• configuring an execution unit based on the experience scenario data by setting three-dimensional space geometry, physical simulation parameters, path-finding graph structures, and event control conditions, executing a virtual space simulation using the configured execution unit, and encoding a simulation output as a time-continuous data stream;
• transmitting the encoded time-continuous data stream to the terminal device via the communication interface using a streaming protocol, and coordinating transmission of position information, operation information, and state information among a plurality of terminal devices sharing the virtual space;
• acquiring sensor data relating to expressions, voice, and behavior of a user from the terminal device via the communication interface, applying an emotion estimation function to the sensor data to compute an emotion state classification and intensity value, and transmitting the emotion state classification and intensity value to the execution unit to dynamically update character behavior parameters and event control conditions;
• and
• receiving operation data from the terminal device via the communication interface, updating virtual space state information in a storage device based on the operation data, and generating updated character behavior parameters by applying a neural network model to the operation data and the emotion state classification.