Integrated management server for dental chart and method using the same

An integrated management system for a dental chart, comprising:

• an encoding unit configured to receive and encode waveforms that contain sounds containing noises and speeches, wherein the encoding unit is trained using multiple sounds containing speeches and noises through a pre-training process included in the speech-to-text (STT) model;
• a decoding unit configured to decode a generated encoding vector and generate the scripts for the speeches;
• a memory that stores one or more instructions;
• and
• a processor,
• wherein the memory includes the STT model that, when said sounds containing noises and speeches are obtained and a noise cancelling process is performed on the obtained sounds, executes a process of extracting and processing features from the sounds with the noise cancelling process and the sounds without the noise cancelling process and a process of obtaining scripts for the speeches,
• wherein the one or more instructions, when executed by the processor, cause the processor to perform operations including:
• providing, by the processor, first said sounds containing noises and speeches, which are generated during measurement of a periodontal status of a patient, to the STT model, obtaining, by the processor, a first script for the speeches, and generating, by the processor, a periodontal chart based on the first script,
• providing, by the processor, features extracted from the periodontal chart to a pre-trained failure rate inference model for each implant type to infer a failure rate for each of a plurality of different implant types,
• providing, by the processor, second said sounds containing noises and speeches generated during discussions regarding an implant type of the patient, which is determined based on the inferred failure rate, to the STT model,—obtaining, by the processor, a second script for the speeches and generating, by the processor, an implant chart based on at least a portion of the first script and the second script,
• providing, by the processor, third said sounds containing noises and speeches, which are generated during discussions regarding an implant product including a prosthesis to be used for the determined implant type of the patient, to the STT model, obtaining, by the processor, a third script for the speeches and generating, by the processor, a laboratory chart based on at least a portion of the first script, the second script, and the third script,
• displaying, through a display device, at least one of the periodontal chart, the implant chart, and the laboratory chart,
• wherein, in the process of extracting the features from the sound with the noise cancelling process and the features from the sound without the noise cancelling process, each of the sound with the noise cancelling process and the sound without the noise cancelling process is converted into a spectrogram, and the features are extracted from the corresponding spectrogram by using a convolutional neural network,
• wherein clean waveforms generated based on said extracted features from the sounds with the noise cancelling process and the sound without the noise cancelling process are utilized by the STT model to distinguish noises from speeches and obtain said first, second, and third scripts, and
• wherein in a fine-tuning process included in training of the STT model, multiple sounds containing noises and speeches that are generated during a dental treatment, and a script for each of the multiple sounds are used as training data.