# US 2017/0255665 A1 · Identifying corrupted text segments > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2017/0255665 A1 - Document ID: US20170255665A1 - Status: Published application - Kind: A1 - Application number: 15/059,522 - Filed: 2016-03-03 - Published: 2017-09-07 - Earliest claimed: 2016-03-03 - Assignees: International Business Machines Corporation - Applicants: International Business Machines Corporation - Inventors: Chao Yuan Huang; Yi-Lin Tsai; Der-Joung Wang; Yen-Min Wu - Web page: https://patentgrep.com/patent/US20170255665A1 ## CPC - G06F 16/2365: {Ensuring data consistency and integrity} - G06F 16/31: Indexing; Data structures therefor; Storage structures - G06F 40/166: Editing, e.g. inserting or deleting - G06F 40/263: Language identification - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A computer-implemented method includes identifying a text segment including one or more text artefacts and determining a language-specific occurrence database associated with the text segment. The computer-implemented method further includes, for each of said one or more text artefacts, determining a language-specific occurrence value based on the language-specific occurrence database and determining a language-specific compliance value based on each language-specific occurrence value. A corresponding computer program product and computer system are also disclosed. ## Claims ### Claim 1 A computer-implemented method comprising: identifying a text segment, said text segment comprising one or more text artefacts; determining a language-specific occurrence database, said language-specific occurrence database being associated with said text segment; for each of said one or more text artefacts, determining a language-specific occurrence value based on said language-specific occurrence database; and determining a language-specific compliance value based on each said language-specific occurrence value. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, wherein determining said language-specific compliance value further comprises: identifying a segment length value, said segment length value being associated with said text segment; identifying a compliance sum value; for each of said one or more text artefacts, adjusting said compliance sum value by said language-specific occurrence value; and adjusting said language-specific compliance value by said segment length value. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: determining an indexing repository based on at least one webpage; and wherein determining said language-specific occurrence database is performed based on said indexing repository. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising: identifying a compliance threshold, said compliance threshold being associated with said language-specific occurrence database; and determining a compliance indicator based on said compliance value and said compliance threshold. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, further comprising: responsive to said compliance indicator indicating that said compliance value is less than said compliance threshold, determining at least one corrective action selected from the group consisting of: notifying at least one viewer of said text segment; downloading said text segment; and preventing said text segment from being accessed again. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein determining said language-specific occurrence database further comprises: identifying at least one language grouping, said at least one language grouping being associated with said language-specific occurrence database; and for each said at least one language grouping, determining a language affinity indicator, said language affinity indicator being associated with said text segment. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, further comprising: identifying a text file, said text file comprising said text segment; identifying an overall compliance value, said overall compliance value being associated with said text file; and adjusting said overall compliance value based on said language-specific compliance value. ### Claim 8 A computer program product, comprising one or more computer readable storage media and program instructions stored on said one or more computer readable storage media, said program instructions comprising instructions to: identify a text segment, said text segment comprising one or more text artefacts; determine a language-specific occurrence database, said language-specific occurrence database being associated with said text segment; for each of said one or more text artefacts, determine a language-specific occurrence value based on said language-specific occurrence database; and determine a language-specific compliance value based on each said language-specific occurrence value. ### Claim 9 (depends on 8) The computer program product of claim 8, wherein said instructions to determine said language-specific compliance value further comprise instructions to: identify a segment length value, said segment length value being associated with said text segment; identify a compliance sum value; for each of said one or more text artefacts, adjust said compliance sum value by said language-specific occurrence value; and adjust said language-specific compliance value by said segment length value. ### Claim 10 (depends on 8) The computer program product of claim 8, wherein: said program instructions further comprise instructions to determine an indexing repository based on at least one webpage; and determining said language-specific occurrence database is performed based on said indexing repository. ### Claim 11 (depends on 8) The computer program product of claim 8, wherein said program instructions further comprise instructions to: identify a compliance threshold, said compliance threshold being associated with said language-specific occurrence database; and determine a compliance indicator based on said compliance value and said compliance threshold. ### Claim 12 (depends on 11) The computer program product of claim 11, wherein said program instructions further comprise instructions to: responsive to said compliance indicator indicating that said compliance value is less than said compliance threshold, determine at least one corrective action selected from the group consisting of: notifying at least one viewer of said text segment; downloading said text segment again; and preventing said text segment from being accessed again. ### Claim 13 (depends on 8) The computer program product of claim 8, wherein said instructions to determine said language-specific occurrence database further comprise instructions to: identify at least one language grouping, said at least one language grouping being associated with said language-specific occurrence database; and for each said at least one language grouping, determine a language affinity indicator, said language affinity indicator being associated with said text segment. ### Claim 14 (depends on 13) The computer program product of claim 13, where said program instructions further comprise instructions to: identify a text file, said text file comprising said text segment; identify an overall compliance value, said overall compliance value being associated with said text file; and adjust said overall compliance value based on said language-specific compliance value. ### Claim 15 A computer system comprising: a processor; one or more computer readable storage media; computer program instructions; said computer program instructions being stored on said one or more computer readable storage media; and said computer program instructions comprising instructions to: identify a text segment, said text segment comprising one or more text artefacts; determine a language-specific occurrence database, said language-specific occurrence database being associated with said text segment; for each of said one or more text artefacts, determine a language-specific occurrence value based on said language-specific occurrence database; and determine a language-specific compliance value based on each said language-specific occurrence value. ### Claim 16 (depends on 15) The computer system of claim 15, wherein said instructions to determine said language-specific compliance value further comprise instructions to: identify a segment length value, said segment length value being associated with said text segment; identify a compliance sum value; for each of said one or more text artefacts, adjust said compliance sum value by said language-specific occurrence value; and adjust said language-specific compliance value by said segment length value. ### Claim 17 (depends on 15) The computer system of claim 15, wherein: said computer program instructions further comprise instructions to determine an indexing repository based on at least one webpage; and determining said language-specific occurrence database is performed based on said indexing repository. ### Claim 18 (depends on 15) The computer system of claim 15, wherein said computer program instructions further comprise instructions to: identify a compliance threshold, said compliance threshold being associated with said language-specific occurrence database; and determine a compliance indicator based on said compliance value and said compliance threshold. ### Claim 19 (depends on 15) The computer system of claim 15, wherein said instructions to determine said language-specific occurrence database further comprise instructions to: identify at least one language grouping, said at least one language grouping being associated with said language-specific occurrence database; and for each said at least one language grouping, determine a language affinity indicator, said language affinity indicator being associated with said text segment. ### Claim 20 (depends on 19) The computer system of claim 19, where said program instructions further comprise instructions to: identify a text file, said text file comprising said text segment; identify an overall compliance value, said overall compliance value being associated with said text file; and adjust said overall compliance value based on said language-specific compliance value.