# US 2012/0254202 A1 · Method and apparatus for cleaning data sets for a search process

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2012/0254202 A1
- Document ID: US20120254202A1
- Status: Published application
- Kind: A1
- Application number: 13/099,685
- Filed: 2011-05-03
- Published: 2012-10-04
- Earliest claimed: 2011-03-31
- Assignees: Nokia Corporation
- Inventors: Jarkko Heinonen; Ashish Kumar Agrawal; Ross Turner
- Web page: https://patentgrep.com/patent/US20120254202A1

## CPC

- G06F 16/29: Geographical information databases
- G06F 16/215: Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

An approach is provided for cleaning data sets for a search process. The cleanup platform determines one or more reference documents associated with at least one region. Next, the cleanup platform processes and/or facilitates a processing of the one or more reference documents to determine a frequency distribution of one or more candidate stop words with respect to the at least one region. Then, the cleanup platform causes, at least in part, selection of one or more stop words applicable to the at least one region from the one or more candidate stop words based, at least in part, on one or more frequency distribution criteria. Additionally, the cleanup platform processes and/or facilitates a processing of at least one data set associated with a search process to generate at least one enhanced data set by filtering the one or more stop words from the at least one data set.

## Claims

### Claim 1

A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:
one or more reference documents associated with at least one region;
a processing of the one or more reference documents to determine a frequency distribution of one or more candidate stop words with respect to the at least one region;
a selection of one or more stop words applicable to the at least one region from the one or more candidate stop words based, at least in part, on one or more frequency distribution criteria; and
a processing of at least one data set associated with a search process to generate at least one enhanced data set by filtering the one or more stop words from the at least one data set.

### Claim 2 (depends on 1)

A method of claim 1, wherein the at least one data set include, at least in part, (a) at least one content data set over which the search process operates, (b) at least one search log data set for recording activity associated with one or more users of the search process, (c) at least one access log data set for recording access by the one or more users to the at least one content data set, or (d) a combination thereof.

### Claim 3 (depends on 1)

A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
metadata associated with one or more users of the search process, wherein the metadata includes at least in part one or more search histories, context information, or a combination thereof; and
a processing of the metadata to determine one or more alternative tokens to associate with one or more tokens of the at least one data set,
wherein the at least one enhanced data set is further based, at least in part, on the association of the one or more alternative tokens with the one or more tokens.

### Claim 4 (depends on 1)

A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
a processing of the at least one data set to determine one or more prefix tokens, one or more suffix tokens, or a combination thereof,
wherein the at least one enhanced data set is further based, at least in part, on filtering the one or more prefix tokens, the one or more suffix tokens, or a combination thereof from the at least one data set.

### Claim 5 (depends on 1)

A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
a processing of at least one data set to determine one or more synonymous tokens; and
a normalization of the one or more synonymous tokens,
wherein the at least one enhanced data set is further based, at least in part, on the normalization.

### Claim 6 (depends on 5)

A method of claim 5, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
respective context information associated with the one or more synonymous tokens;
a processing of the respective context information to determine one or more duplicates among the one or more synonymous tokens,
wherein the normalization comprises, at least in part, removal of the one or more duplicates.

### Claim 7 (depends on 5)

A method of claim 5, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
a processing of the at least one data set to determine one or more translations, one or more permutations, or a combination thereof of the one or more synonymous tokens,
wherein the normalization is based, at least in part, on the one or more translation, the one or more permutations, or a combination thereof.

### Claim 8 (depends on 1)

A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
a processing of the at least one data set to determine context information, one or more users, or a combination thereof associated with one or more tokens of the at least one data set; and
at least one determination of a frequency distribution based, at least in part, on the context information, the one or more users, or a combination thereof,
wherein the at least one enhanced data set is further based, at least in part, on filtering of the one or more tokens according to the frequency distribution.

### Claim 9 (depends on 1)

A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:
a processing of the at least one data set to determine one or more string tokens associated with at least one test model,
wherein the at least one enhanced data set is further based, at least in part, on filtering of the one or more string tokens.

### Claim 10 (depends on 1)

A method of claim 1, wherein the search process includes, at least in part, a location-based search process, a content search process, a service search process, or a combination thereof.

### Claim 11

An apparatus comprising:
at least one processor; and
at least one memory including computer program code for one or more programs,
the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,
determine one or more reference documents associated with at least one region;
process and/or facilitate a processing of the one or more reference documents to determine a frequency distribution of one or more candidate stop words with respect to the at least one region;
cause, at least in part, selection of one or more stop words applicable to the at least one region from the one or more candidate stop words based, at least in part, on one or more frequency distribution criteria; and
process and/or facilitate a processing of at least one data set associated with a search process to generate at least one enhanced data set by filtering the one or more stop words from the at least one data set.

### Claim 12 (depends on 11)

An apparatus of claim 11, wherein the at least one data set include, at least in part, (a) at least one content data set over which the search process operates, (b) at least one search log data set for recording activity associated with one or more users of the search process, (c) at least one access log data set for recording access by the one or more users to the at least one content data set, or (d) a combination thereof.

### Claim 13 (depends on 11)

An apparatus of claim 11, wherein the apparatus is further caused to:
determine metadata associated with one or more users of the search process, wherein the metadata includes at least in part one or more search histories, context information, or a combination thereof; and
process and/or facilitate a processing of the metadata to determine one or more alternative tokens to associate with one or more tokens of the at least one data set,
wherein the at least one enhanced data set is further based, at least in part, on the association of the one or more alternative tokens with the one or more tokens.

### Claim 14 (depends on 11)

An apparatus of claim 11, wherein the apparatus is further caused to:
process and/or facilitate a processing of the at least one data set to determine one or more prefix tokens, one or more suffix tokens, or a combination thereof,
wherein the at least one enhanced data set is further based, at least in part, on filtering the one or more prefix tokens, the one or more suffix tokens, or a combination thereof from the at least one data set.

### Claim 15 (depends on 11)

An apparatus of claim 11, wherein the apparatus is further caused to:
process and/or facilitate a processing of at least one data set to determine one or more synonymous tokens; and
cause, at least in part, a normalization of the one or more synonymous tokens,
wherein the at least one enhanced data set is further based, at least in part, on the normalization.

### Claim 16 (depends on 15)

An apparatus of claim 15, wherein the apparatus is further caused to:
determine respective context information associated with the one or more synonymous tokens;
process and/or facilitate a processing of the respective context information to determine one or more duplicates among the one or more synonymous tokens,
wherein the normalization comprises, at least in part, removal of the one or more duplicates.

### Claim 17 (depends on 15)

An apparatus of claim 15, wherein the apparatus is further caused to:
process and/or facilitate a processing of the at least one data set to determine one or more translations, one or more permutations, or a combination thereof of the one or more synonymous tokens,
wherein the normalization is based, at least in part, on the one or more translation, the one or more permutations, or a combination thereof.

### Claim 18 (depends on 11)

An apparatus of claim 11, wherein the apparatus is further caused to:
process and/or facilitate a processing of the at least one data set to determine context information, one or more users, or a combination thereof associated with one or more tokens of the at least one data set; and
determine a frequency distribution based, at least in part, on the context information, the one or more users, or a combination thereof,
wherein the at least one enhanced data set is further based, at least in part, on filtering of the one or more tokens according to the frequency distribution.

### Claim 19 (depends on 11)

An apparatus of claim 11, wherein the apparatus is further caused to:
process and/or facilitate a processing of the at least one data set to determine one or more string tokens associated with at least one test model,
wherein the at least one enhanced data set is further based, at least in part, on filtering of the one or more string tokens.

### Claim 20 (depends on 11)

An apparatus of claim 11, wherein the search process includes, at least in part, a location-based search process, a content search process, a service search process, or a combination thereof.
