# US 2021/0243498 A1 · Techniques for generating contextually-relevant recommendations > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2021/0243498 A1 - Document ID: US20210243498A1 - Status: Published application - Kind: A1 - Application number: 16/779,520 - Filed: 2020-01-31 - Published: 2021-08-05 - Earliest claimed: 2020-01-31 - Assignees: Disney Enterprises, Inc. - Applicants: Disney Enterprises, Inc. - Inventors: Michael P. GOSLIN; Erika Varis DOGGETT; Anthony M. ACCARDO; Noel Brandon VASQUEZ - Web page: https://patentgrep.com/patent/US20210243498A1 ## CPC - H04N 21/4668: {for recommending content, e.g. movies} - G06F 9/453: {Help systems} - G06F 16/2379: {Updates performed during online database operations; commit processing} - G06F 16/2455: Query execution - G06Q 10/087: Inventory or stock management, e.g. order filling, procurement or balancing against orders - G06Q 10/08776: {by management of storage life of perishable or hazardous products} - G09B 19/003: {Repetitive work cycles; Sequence of movements} - H04N 21/4131: {home appliance, e.g. lighting, air conditioning system, metering devices (home automation data switching networks exchanging configuration information on appliance services H04L12/2807)} - H04N 21/42202: {environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes} - H04N 21/43615: {Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals (home Audio Video Interoperability [HAVI] data switching networks H04L12/2805)} - H04N 21/47217: {for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312)} - H04N 21/854: Content authoring - H05B 6/6435: {Aspects relating to the user interface of the microwave heating apparatus} - H05B 6/6438: {allowing the recording of a program of operation of the microwave heating apparatus} - H05B 6/668: {Microwave heating devices connected to a telecommunication network} - G09B 19/0092: {Nutrition} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06Q: INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL ## Abstract A recommendation engine generates contextually relevant media programs tailored to the specific context of the user. The recommendation engine interfaces with one or more Internet-of-Things (IoT) appliances to determine one or more food items stored within the IoT appliance(s) and/or one or more cooking capabilities associated with the IoT appliance(s). The recommendation engine also gathers profile data that reflects a set of preferences associated with the user. Based on the gathered data, the recommendation engine queries a database of cooking program data associated with various cooking programs. The recommendation engine obtains cooking program data that is contextually relevant to the user and then generates a contextual cooking program that describes how to perform a given recipe. During playback of the contextual cooking program, the recommendation engine can modify the contextual cooking program based on the progress of the user in following the recipe. ## Claims ### Claim 1 A computer-implemented method for generating a media program, the method comprising: determining a first state that is associated with a procedure to be performed by a user, wherein the first state comprises a capability of a first appliance or an availability of at least one item stored within the first appliance; determining a set of instructions for performing the procedure based on a comparison of the first state with a set of dependencies for the procedure; determining a first portion of media content that depicts a first instruction included in the set of instructions; generating a first media program based on the first portion of media content, wherein the first media program provides the first instruction to the user. ### Claim 2 (depends on 1) The computer-implemented method of claim 1, further comprising: determining that the user has performed a first operation corresponding to the first instruction; and in response, advancing the first media program to a playback position corresponding to a second instruction included in the set of instructions. ### Claim 3 (depends on 1) The computer-implemented method of claim 1, further comprising: determining that the user is performing a first operation corresponding to the first instruction; determining a first interval of time during which the user performs the first operation; pausing playback of the first media program during the first interval of time; and playing at least a portion of interstitial content during the first interval of time. ### Claim 4 (depends on 1) The computer-implemented method of claim 1, further comprising: determining a first dependency associated with the first instruction based on a source media program that includes the first portion of media content, wherein the first dependency indicates a skill or item that is needed to implement the first instruction; generating a first data record that includes the first portion of media content, the first instruction, and the first dependency; and populating a database with the first data record. ### Claim 5 (depends on 4) The computer-implemented method of claim 4, wherein determining the set of instructions comprises executing a query against the database using the first state to identify the first data record. ### Claim 6 (depends on 1) The computer-implemented method of claim 1, wherein the first appliance comprises a food storage appliance, the at least one item comprises at least one food item, and the first appliance stores the at least one food item. ### Claim 7 (depends on 6) The computer-implemented method of claim 6, wherein the first state indicates an expiration date associated with the at least one food item. ### Claim 8 (depends on 1) The computer-implemented method of claim 1, wherein the first appliance comprises a food preparation appliance, and the first state comprises a food preparation capability associated with the first appliance. ### Claim 9 (depends on 8) The computer-implemented method of claim 8, wherein the first state indicates a temperature range associated with the food preparation capability, wherein the first appliance performs food preparation operations associated with the temperature range. ### Claim 10 (depends on 1) The computer-implemented method of claim 1, wherein the first appliance comprises a kitchen appliance, and the first media program comprises a cooking program. ### Claim 11 A non-transitory computer-readable medium storing program instructions that, when executed by a processor, cause the processor to generate a media program by performing the steps of: determining a first state that is associated with a procedure to be performed by a user, wherein the first state comprises a capability of a first appliance or an availability of at least one item stored within the first appliance; determining a set of instructions for performing the procedure based on a comparison of the first state with a set of dependencies for the procedure; determining a first portion of media content that depicts a first instruction included in the set of instructions; generating a first media program based on the first portion of media content, wherein the first media program provides the first instruction to the user ### Claim 12 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the program instructions further cause the processor to perform the steps of: determining that the user has performed a first operation corresponding to the first instruction; and in response, advancing the first media program to a playback position corresponding to a second instruction included in the set of instructions. ### Claim 13 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the program instructions further cause the processor to perform the steps of: determining that the user is performing a first operation corresponding to the first instruction; determining a first interval of time during which the user performs the first operation; pausing playback of the first media program during the first interval of time; and playing at least a portion of interstitial content during the first interval of time. ### Claim 14 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the program instructions further cause the processor to perform the steps of: determining a first dependency associated with the first instruction based on a source media program that includes the first portion of media content, wherein the first dependency indicates a skill or item that is needed to implement the first instruction; generating a first data record that includes the first portion of media content, the first instruction, and the first dependency; and populating a database with the first data record. ### Claim 15 (depends on 14) The non-transitory computer-readable medium of claim 14, wherein the step of determining the set of instructions comprises executing a query against the database using the first state to identify the first data record. ### Claim 16 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the first instruction is associated with performing at least one food preparation operation for a recipe being presented to a user via the first media program. ### Claim 17 (depends on 11) The non-transitory computer-readable medium of claim 11, wherein the program instructions further cause the processor to perform comprising the steps of: determining a first dependency associated with the first instruction that indicates a skill or item that is needed to implement the first instruction; and performing a first action to provide the user with the skill or item. ### Claim 18 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the step of performing the first action comprises displaying a second portion of media content to the user, wherein the second portion of media content indicates one or more techniques for performing the skill. ### Claim 19 (depends on 17) The non-transitory computer-readable medium of claim 17, wherein the step of performing the first action comprises automatically ordering the item for delivery to the user. ### Claim 20 A system, comprising: a memory storing a software application; and a processor that, when executing the software application, is configured to generate a media program by performing the steps of: determining a first state that is associated with a procedure to be performed by a user, wherein the first state comprises a capability of a first appliance or an availability of at least one item stored within the first appliance; determining a set of instructions for performing the procedure based on a comparison of the first state with a set of dependencies for the procedure; determining a first portion of media content that depicts a first instruction included in the set of instructions; and generating a first media program based on the first portion of media content, wherein the first media program provides the first instruction to the user.