Processing streaming data

A method for processing streaming data, the method comprising:

• obtaining input data representative of a frame of streaming data:
• identifying a query transformation, a key transformation, and a value transformation based on the input data for the frame of streaming data:
• updating a query buffer, a key buffer, and a value buffer based on the identified query, key, and value transformations, such that the query buffer, the key buffer, and the value buffer are each configured to store corresponding query, key and value transformations associated with previous frames of streaming data and the frame of streaming data:
• retrieving one or more query frames from the updated query buffer to be used to process the input data:
• determining a dot product of the retrieved one or more query frames and frames in the key buffer to determine a set of weights:
• determining a weighted sum between the set of weights and frames in the value buffer:
• utilizing the weighted sum to generate a streaming attention vector, wherein the streaming attention vector is usable by a network to generate a prediction associated with the streaming data.