Text segmentation method, computer device and storage medium
AssigneeMashang Consumer Finance Co., Ltd.
InventorsChanglin Li, Bing Xiao, Lei Cao, Qishuai Luo
Life of this patent
Estimating the term…
Abstract
An embodiment of the present application provides a text segmentation method, a computer device and a storage medium, among them, the method includes: obtaining a text to be segmented, preprocessing the text and determining a processed text; calculating a confidence of a segment point between two adjacent characters in the processed text, determining a position of the segment point in the processed text based on the confidence; and segmenting the text according to the position. Through this embodiment, the problem of low efficiency of word segmentation in existing word segmentation method can be solved.
Claims20
A text segmentation method, comprising:
- obtaining a text to be segmented, preprocessing the text and determining a processed text;
- calculating a confidence of a segment point between two adjacent characters in the processed text, and determining a position of the segment point in the processed text based on the confidence;
- and
- segmenting the text according to the position.
A computer device, comprising:
- a processor;
- and
- a storage device storing computer-executable instructions, which when executed by the processor, cause the processor to:
- obtain a text to be segmented, preprocess the text and determine a processed text;
- calculate a confidence of a segment point between two adjacent characters in the processed text, and determine a position of the segment point in the processed text based on the confidence;
- and
- segment the text according to the position.
A non-transitory storage medium being stored computer-executable instructions thereon, when the computer-executable instructions are executed by a processor of a computer device, the processor is caused to perform a text segmentation method, wherein the method comprises:
- obtaining a text to be segmented, preprocessing the text and determining a processed text;
- calculating a confidence of a segment point between two adjacent characters in the processed text, and determining a position of the segment point in the processed text based on the confidence;
- and
- segmenting the text according to the position.
Dependencies are inferred from the claim text.