Data processing device and method, and related product

A data processing apparatus, comprising:

• a processing unit, configured to run a neural network model, wherein the neural network model comprises a decoder based on an attention mechanism, and the decoder uses a beam search method to decode;
• and
• a first storage unit, configured with N storage blocks, wherein N>1, and each storage block is separately associated with several successive time steps to cache intermediate variables generated by the decoder during the associated time steps, wherein
• the processing unit is further configured to:
• according to B candidate output sequences of the decoder selected by a current time step, wherein B>1, rearrange B groups of intermediate variables corresponding to the B candidate output sequences in the associated storage block of the current time step;
• and
• based on the B candidate output sequences, read B groups of intermediate variables of a predetermined time step range from a corresponding storage block of the storage unit to perform decoding of a next time step.