# US 9,870,511 B2 · Method and apparatus for providing image classification based on opacity > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,870,511 B2 - Document ID: US9870511B2 - Status: Granted - Kind: B2 - Application number: 14/883,274 - Filed: 2015-10-14 - Published: 2017-04-20 - Granted: 2018-01-16 - Earliest claimed: 2015-10-14 - Assignees: HERE Global B.V. - Applicants: HERE Global B.V. - Inventors: Anish Mittal; William Marks - Web page: https://patentgrep.com/patent/US9870511B2 ## CPC - G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An approach is provided for automated classification of an image based on the fogging attributes associated with the image. The approach involves processing and/or facilitating a processing of image data associated with at least one image to cause, at least in part, an extraction of one or more fogging attributes from the image data. The approach also involves causing, at least in part, a mapping of the one or more fogging attributes to one or more features of at least one classifier, wherein the at least one classifier is trained based, at least in part, on a co-registration of the one or more features to one or more records of previously made image judgements. The approach further involves causing, at least in part, a classification of the at least one image as either in a fogging-afflicted state or a non-fogging-afflicted state based, at least in part, on the at least one classifier. ## Claims ### Claim 1 A method comprising: determining, by an apparatus, image data from a plurality of bounding boxes each centering at an identical point of an image, wherein the bounding boxes are of different sizes each smaller than a size of the image; initiating, by the apparatus, an extraction of one or more fogging attributes from the image data; initiating, by the apparatus, a mapping of the one or more fogging attributes to one or more features of at least one classifier, wherein the at least one classifier is trained based, at least in part, on a co-registration of the one or more features to one or more records of previously made image judgements; and initiating, by the apparatus, a classification of the image as either in a fogging-afflicted state or a non-fogging-afflicted state based, at least in part, on the at least one classifier. ### Claim 2 (depends on 1) A method of claim 1, wherein the bounding boxes are located within a center region of the image. ### Claim 3 (depends on 2) A method of claim 2, wherein the identical point of the image is the center point of the image, the bounding boxes include, at least in part, one or more small bounding boxes, one or more medium bounding boxes, and one or more large bounding boxes specified for a plurality of color channels of the image. ### Claim 4 (depends on 3) A method of claim 3, further comprising: determining at least one multi-dimensional contrast attribute vector based, at least in part, on the bounding boxes for every pixel in each of the color channels. ### Claim 5 (depends on 3) A method of claim 3, further comprising: computing an average value of contrast of pixels per bounding box for each of the one or more small bounding boxes, the one or more medium bounding boxes, and the one or more large bounding boxes in each of the color channels; and including the average value of contrast in the one or more fogging attributes. ### Claim 6 (depends on 1) A method of claim 1, wherein the one or more features of the at least one classifier include, at least in part, one or more color-based localized contrast features. ### Claim 7 (depends on 6) A method of claim 6, further comprising: determining the one or more color-based localized contrast features based, at least in part, on a Michelson contrast value. ### Claim 8 (depends on 7) A method of claim 7, further comprising: determining that the one or more color-based localized contrast features are associated with the fogging-afflicted state if the Michelson contrast value is below a threshold value; and determining that the one or more color-based localized contrast features are associated with the non-fogging-afflicted state if the Michelson contrast value is above a threshold value. ### Claim 9 (depends on 7) A method of claim 7, further comprising: determining the Michelson contrast value for at least one pixel of the image based, at least in part, on intensity information associated with one or more neighboring pixels. ### Claim 10 (depends on 1) A method of claim 1, further comprising: using one or more classifying algorithms to generate the at least one classifier based, at least in part, on comparing the one or more fogging attributes to one or more subjective fogging level judgements provided by human users, wherein the fogging-afflicted state is associated with at least a fogging or a hazing at least one image, wherein the fogging or the hazing results from one or more conditions of at least one camera component used to capture the image, one or more external conditions associated with at least one environment captured in the image, or a combination thereof. ### Claim 11 An apparatus comprising: at least one processor; and at least one memory including computer program code for one or more programs, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following, determine image data from a plurality of bounding boxes each centering at an identical point of an image, wherein the bounding boxes are of different sizes each smaller than a size of the image; initiate an extraction of one or more fogging attributes from the image data; initiate a mapping of the one or more fogging attributes to one or more features of at least one classifier, wherein the at least one classifier is trained based, at least in part, on a co-registration of the one or more features to one or more records of previously made image judgements; and initiate a classification of the image as either in a fogging-afflicted state or a non-fogging-afflicted state based, at least in part, on the at least one classifier. ### Claim 12 (depends on 11) An apparatus of claim 11, wherein the bounding boxes are located within a center region of the image. ### Claim 13 (depends on 12) An apparatus of claim 12, wherein the identical point of the image is the center point of the image, the bounding boxes include, at least in part, one or more small bounding boxes, one or more medium bounding boxes, and one or more large bounding boxes specified for a plurality of color channels of the image. ### Claim 14 (depends on 13) An apparatus of claim 13, wherein the apparatus is further caused to: determine at least one multi-dimensional contrast attribute vector based, at least in part, on the bounding boxes for every pixel in each of the color channels. ### Claim 15 (depends on 12) An apparatus of claim 12, wherein the apparatus is further caused to: compute an average value of contrast of pixels per bounding box for each of the one or more small bounding boxes, the one or more medium bounding boxes, and the one or more large bounding boxes in each of the color channels; and include the average value of contrast in the one or more fogging attributes. ### Claim 16 (depends on 11) An apparatus of claim 11, wherein the one or more features of the at least one classifier include, at least in part, one or more color-based localized contrast features. ### Claim 17 (depends on 16) An apparatus of claim 16, wherein the apparatus is further caused to: determine the one or more color-based localized contrast features based, at least in part, on a Michelson contrast value. ### Claim 18 A non-transitory computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps: determining image data from a plurality of bounding boxes each centering at an identical point of an image, wherein the bounding boxes are of different sizes each smaller than a size of the image; initiating an extraction of one or more fogging attributes from the image data; initiating a mapping of the one or more fogging attributes to one or more features of at least one classifier, wherein the at least one classifier is trained based, at least in part, on a co-registration of the one or more features to one or more records of previously made image judgements; and initiating a classification of the image as either in a fogging-afflicted state or a non-fogging-afflicted state based, at least in part, on the at least one classifier. ### Claim 19 (depends on 18) A non-transitory computer-readable storage medium of claim 18, wherein the bounding boxes are located within a center region of the image. ### Claim 20 (depends on 19) A non-transitory computer-readable storage medium of claim 19, wherein the identical point of the image is the center point of the image, the bounding boxes include, at least in part, one or more small bounding boxes, one or more medium bounding boxes, and one or more large bounding boxes specified for a plurality of color channels of the image.