Detecting and selectively buffering markup instruction candidates in a streamed language model output

A computing system comprising:

• processing circuitry;
• and
• memory comprising instructions executed by the processing circuitry whereby the computing system is operable to:
• receive a stream of symbols from a language model;
• and
• stream the received stream of symbols as output, the output is caused to be rendered on a display, the streaming of the symbols as output comprises being operable to:
• detect a markup sequence in the received stream of symbols;
• responsive to detecting the markup sequence, pause the streaming of the symbols as output and instead stream the received stream of symbols to a buffer;
• detect a further markup sequence in the received stream of symbols;
• and
• responsive to detecting the further markup sequence in the received stream of symbols:
• cause the symbols in the buffer to be rendered;
• and
• resume streaming the received stream of symbols as output.

A non-transitory computer readable medium comprising instructions executable by processing circuitry of a computing system whereby the computing system is operable to:

• receive a stream of symbols from a language model;
• and
• stream the received stream of symbols as output, the output is caused to be rendered on a display, the streaming of the symbols as output comprises being operable to:
• detect a markup sequence in the received stream of symbols;
• responsive to detecting the markup sequence, pause the streaming of the symbols as output and instead stream the received stream of symbols to a buffer;
• detect a further markup sequence in the received stream of symbols;
• and
• responsive to detecting the further markup sequence in the received stream of symbols:
• cause the symbols in the buffer to be rendered;
• and
• resume streaming the received stream of symbols as output.