# US 12,217,333 B2 · Colors as an intelligent service > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,217,333 B2 - Document ID: US12217333B2 - Status: Granted - Kind: B2 - Application number: 17/878,892 - Filed: 2022-08-01 - Published: 2024-02-01 - Granted: 2025-02-04 - Earliest claimed: 2022-08-01 - Assignees: Microsoft Technology Licensing, LLC - Applicants: Microsoft Technology Licensing, LLC - Inventors: Hafsa Azaz; Bryan Allan Coard; Vikas Ajay Taskar - Web page: https://patentgrep.com/patent/US12217333B2 ## CPC - G06F 40/103: Formatting, i.e. changing of presentation of documents (automatic justification G06F40/189; automatic line break hyphenation G06F40/191) - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/60: Creating or editing images; Combining images with text - G06V 10/56: relating to colour - G06V 10/70: using pattern recognition or machine learning (optical pattern recognition or electronic computations therefor G06V10/88) - G06V 10/95: {structured as a network, e.g. client-server architectures} - G06T 2200/24: involving graphical user interfaces [GUIs] - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Systems and methods for providing color recommendations for content editing applications include receiving a color recommendation request from a content editing application that includes color information pertaining to a document being edited by the content editing application. At least one color is identified based on at least one of a predefined accessibility standard, predetermined telemetry data, and organizational/group preferences with reference to the color information in the color recommendation request using a color recommendation service. A color recommendation indicating the at least one identified color is provided from the color recommendation service to the content editing application. ## Claims ### Claim 1 A data processing system comprising: a processor; and a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the data processing system to perform functions of: receiving a color recommendation request from a content editing application, the color recommendation request including color information pertaining to a document being edited by the content editing application; identifying at least one color using a color selection machine learning (ML) model pretrained to select the at least one color based on the color information in the color recommendation request, the color selection ML model being trained using training data based on telemetry data generated by at least one user of content editing applications, the telemetry data indicating color choices in different contexts made by the at least one user, the color selection ML model being trained to receive the color information as input and output the at least one color; and providing a color recommendation indicating the at least one color identified by the color selection ML model to the content editing application, wherein: the telemetry data includes user-specific telemetry data pertaining to past color choices made by users in interacting with content editing applications, and the color selection ML model is trained to learn rules for identifying the at least one color for the color recommendation based on the user-specific telemetry data. ### Claim 2 (depends on 1) The data processing system of claim 1, wherein the telemetry data includes telemetry data pertaining to past color choices made by a plurality of users of content editing applications, and wherein the color selection ML model is trained to learn rules for identifying the at least one color for the color recommendation based on the telemetry data for the plurality of users. ### Claim 3 (depends on 1) The data processing system of claim 1, further comprising: displaying via a user interface control which displays a plurality of colors which are supported by the content editing applications, wherein each color in the plurality of colors that is included in the color recommendation is displayed by the user interface control in a manner that indicates that the color is currently selectable and usable in the content editing applications, and wherein each color in the plurality of colors that is not included in the color recommendation is displayed by the user interface control in a manner that indicates that the color is not currently available for selection and is not currently usable in the content editing applications. ### Claim 4 (depends on 1) The data processing system of claim 1, further comprising: automatically applying the at least one color in the color recommendation to at least one content element in the document. ### Claim 5 (depends on 1) The data processing system of claim 1, further comprising: using organizational/group preferences as filter parameters to filter the at least one color such that only colors that satisfy the organizational/group preferences are provided in the color recommendation. ### Claim 6 (depends on 1) The data processing system of claim 1, further comprising: identifying the at least one color such that the at least one color satisfies a preselected accessibility standard with respect to the color information from the color recommendation request. ### Claim 7 A data processing system comprising: a processor; and a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the data processing system to perform functions of: receiving a color recommendation request from a content editing application, the color recommendation request including color information pertaining to a document being edited by the content editing application; identifying at least one color using a color selection model pretrained to select the at least one color using the color information as input and based on at least one of a predefined accessibility standard, predetermined telemetry data, and organizational/group preferences with reference to the color information in the color recommendation request using a color recommendation service; and providing a color recommendation indicating the at least one identified color from the color recommendation service to the content editing application, wherein: identifying the at least one color includes identifying the at least one color based on the predetermined telemetry data, the predetermined telemetry data includes user-specific telemetry data pertaining to past color choices made by users in interacting with content editing applications, and the color selection model is trained to learn rules for identifying the at least one color for the color recommendation based on the user-specific telemetry data. ### Claim 8 (depends on 7) The data processing system of claim 7, wherein identifying the at least one color includes identifying the at least one color based on the predefined accessibility standard, and wherein the predefined accessibility standard includes a Web Content Accessibility Guideline (WCAG) standard. ### Claim 9 (depends on 7) The data processing system of claim 7, wherein identifying the at least one color includes identifying the at least one color based on the predetermined telemetry data, wherein the predetermined telemetry data includes telemetry data pertaining to past color choices made by a plurality of users of content editing applications, and wherein the at least one color is identified using a color selection model trained to learn rules for identifying the at least one color for the color recommendation based on the telemetry data for the plurality of users. ### Claim 10 (depends on 7) The data processing system of claim 7, further comprising: using the color recommendation in the content editing application to limit selectable colors for use in editing content in the document. ### Claim 11 (depends on 7) The data processing system of claim 7, further comprising: automatically applying the at least one identified color in the color recommendation to at least one content element in the document. ### Claim 12 (depends on 7) The data processing system of claim 7, wherein identifying the at least one color includes identifying the at least one color based on the predetermined telemetry data, and wherein the organizational/group preferences are used as filter parameters for filtering the at least one color such that only colors that satisfy the organizational/group preferences are provided in the color recommendation. ### Claim 13 A data processing system comprising: a processor; and a memory in communication with the processor, the memory comprising executable instructions that, when executed by the processor, cause the data processing system to perform functions of: receiving a color recommendation request from a content editing application, the color recommendation request including color information pertaining to a document being edited by the content editing application; identifying at least one color based on at least one of a predefined accessibility standard, predetermined telemetry data, and organizational/group preferences with reference to the color information in the color recommendation request using a color recommendation service; and providing a color recommendation indicating the at least one identified color from the color recommendation service to the content editing application, wherein: identifying the at least one color includes identifying the at least one color based on the predetermined telemetry data, the predetermined telemetry data includes user-specific telemetry data pertaining to past color choices made by users in interacting with content editing applications, and the at least one color is identified using a color selection model trained to learn rules for identifying the at least one color for the color recommendation based on the user-specific telemetry data. ### Claim 14 (depends on 13) The data processing system of claim 13, wherein identifying the at least one color includes identifying the at least one color based on the predefined accessibility standard, and wherein the predefined accessibility standard includes a Web Content Accessibility Guideline (WCAG) standard. ### Claim 15 (depends on 13) The data processing system of claim 13, wherein identifying the at least one color includes identifying the at least one color based on the predetermined telemetry data, wherein the predetermined telemetry data includes telemetry data pertaining to past color choices made by a plurality of users of content editing applications, and wherein the at least one color is identified using a color selection model trained to learn rules for identifying the at least one color for the color recommendation based on the telemetry data for the plurality of users. ### Claim 16 (depends on 13) The data processing system of claim 13, further comprising: using the color recommendation in the content editing application to limit selectable colors for use in editing content in the document. ### Claim 17 (depends on 13) The data processing system of claim 13, further comprising: automatically applying the at least one identified color in the color recommendation to at least one content element in the document.