US 12,223,271 B2 · Text processing method, device and storage medium

Abstract

Provided are a text processing method, a device and a storage medium, relating to a field of computer technology, and especially to a field of artificial intelligence, such as natural language processing and deep learning. The specific implementation scheme includes: performing text processing on first text, by using a text processing acceleration operator; and processing, in parallel and faster, content after the text processing, by using the text processing acceleration operator. Text processing and parallel acceleration are carried out by the text processing acceleration operator, which can improve the speed of text processing.

Claims26

Dependent claims

A text processing method, comprising:

performing text processing on first text, by using a text processing acceleration operator, comprising:
obtaining a first tensor corresponding to the first text;
segmenting the first tensor, to obtain a plurality of segmentation results;
performing identifier mapping on each of the plurality of segmentation results;
and
generating a second tensor, by using a mapping result;
and
performing parallel acceleration processing on, content after the text processing, by using the text processing acceleration operator, comprising:
processing, in parallel, the second tensor, by using multiple threads.

6 more elements

Dependencies are inferred from the claim text.

Facts

Application

17/874,394Filed 27 Jul 2022

Priority

CN 202111505371.110 Dec 2021

Published

US 2023/0186024 A115 Jun 2023

Granted

11 Feb 2025

Term ends

Not estimatedThe source records don’t support an estimate.

Classification8 codes

G06F 40/279
Natural language analysis: recognition of textual entities
G06F 40/284
Recognition of textual entities: lexical analysis, e.g. tokenisation or collocates
G06F 40/47
Data-driven translation: machine-assisted translation, e.g. using translation memory
G06F 40/53
Processing or translation of natural language: processing of non-Latin text

Text processing method, device and storage medium

Life of this patent

Text processing method, device and storage medium

Life of this patent

Abstract

Claims26