Structured dialogue segmentation and state tracking

A method for open-domain dialogue segmentation and state tracking, the method comprising:

• obtaining and analyzing a dialogue, the dialogue being an open-domain dialogue;
• determining a segmentation prediction using a state prediction model by segmenting the dialogue into one or more segments that are topically related and determining a user intent and a dialogue domain for each segment, each segment including contiguous subsequences of one or more dialogue turns that are topically related;
• and
• generating a structured output based on the segmentation prediction using the state prediction model, the structured output including a turn summary and state labels for each dialogue turn.