US 12,425,046 B2 · Efficient character counting for variable length encoding formats

Abstract

Technologies and solutions are also provided for determining a number of characters in encoded data, particularly for encoding formats that have variable byte lengths. Bytes in the encoding format can have different types, including at least one type that represents a continuation byte. That is, rather than having all data for a character being in a single byte, the data is encoded using two or more bytes. The number of continuation bytes can be counted and subtracted from a total number of bytes in a data set to determine the number of characters in the data set. Optionally, the validity of the data set with respect to an encoding format can be determined prior to, or concurrently with, determining a number of characters in the data set. SIMD techniques can be used with the character counting/validation processes to improve their performance.

Claims20

Dependent claims

A computing system comprising:

at least one memory;
one or more hardware processor units coupled to the at least one memory;
and
one or more computer readable storage media storing computer-executable instructions that, when executed, cause the computing system to perform operations comprising:
receiving a data set encoded in a variable byte length format, the variable byte length format comprising one or more sequence types comprising a plurality of bytes, wherein at least a first sequence type of the one or more sequence types comprises a leading byte and one or more continuation bytes;
identifying a number of continuation bytes in the data set;
and
subtracting the number of continuation bytes in the data set from a number of bytes in the data set to provide a number of characters present in the data set.

5 more elements

One or more non-transitory computer-readable storage media comprising:

computer-executable instructions that, when executed by a computing system comprising at least one hardware processor and at least one memory coupled to the at least one hardware processor, cause the computing system to receive a data set encoded in a variable byte length format, the variable byte length format comprising one or more sequence types comprising a plurality of bytes, wherein at least a first sequence type of the one or more sequence types comprises a leading byte and one or more continuation bytes;
computer-executable instructions that, when executed by the computing system, cause the computing system to identify a number of continuation bytes in the data set;
and
computer-executable instructions that, when executed by the computing system, cause the computing system to subtract the number of continuation bytes in the data set from a number of bytes in the data set to provide a number of characters present in the data set.

1 more element

Dependencies are inferred from the claim text.

Efficient character counting for variable length encoding formats

Life of this patent

Efficient character counting for variable length encoding formats

Life of this patent

Abstract

Claims20