Display device and display device control method

A refrigerator, comprising:

• a camera;
• a processor;
• and
• a memory,
• wherein the memory stores instructions for causing the processor to:
• based on receiving a request requesting information related to the refrigerator, obtain at least one image of contents of the refrigerator using the camera;
• obtain first text information related to a food ingredient based on recognizing the food ingredient in the at least one image;
• transmit the first text information to a server;
• receive broadcast content on cooking obtained by the server;
• and
• transmit the broadcast content on cooking and an image of inside the refrigerator including the food ingredient to an external device such that the broadcast content on cooking is displayed in a first display area of a display of the external device and, while the broadcast content on cooking is displayed in the first display, the image of inside the refrigerator including the food ingredient included in the broadcast content is displayed in a second display area of the display of the external device, the food ingredient being distinguished from other food ingredients inside the refrigerator,
• wherein the broadcast content on cooking is obtained by the server by identifying, from media content pre-stored in the server, image frames for which second text information related to cooking information, recognized from text included in the image frames, corresponds to the first text information and obtaining, as the broadcast content on cooking, media content from the pre-stored media content corresponding to the identified image frames.

A server, comprising:

• a communicator including a communication circuit;
• a processor;
• and
• a memory,
• wherein the memory stores instructions for causing the processor to:
• based on receiving an input via the communicator requesting information related to the refrigerator being received, control the communicator to transmit a request requesting transmission of an image of contents of the refrigerator obtained using a camera of the refrigerator;
• in response to the request, control the communicator to receive at least one image from the refrigerator;
• obtain first text information related to a name of a food ingredient based on recognizing the food ingredient in the at least one image;
• obtain broadcast content on cooking by identifying, from media content pre-stored in the server, image frames for which second text information related to cooking information, recognized from text included in the image frames, corresponds to the first text information and obtaining, as the broadcast content on cooking, media content from the pre-stored media content corresponding to the identified image frames;
• and
• control the communicator to transmit the broadcast content on cooking and an image of inside the refrigerator including the food ingredient to an external device such that the broadcast content on cooking is displayed in a first display area of a display of the external device and, while the broadcast content on cooking is displayed in the first display, the image of inside the refrigerator including the food ingredient included in the broadcast content is displayed in a second area of the display of the external device, the food ingredient being distinguished from other food ingredients inside the refrigerator.

A control method of display device, the method comprising:

• based on receiving an input to the display device requesting information related to a refrigerator, transmitting to the refrigerator a request requesting transmission of an image of contents of the refrigerator obtained using a camera of the refrigerator;
• receiving at least one image from the refrigerator based on the request;
• obtaining first text information related to a name of a food ingredient based on recognizing the food ingredient in the at least one image;
• transmitting the first text information to a server;
• receiving broadcast content on cooking obtained by the server;
• and
• displaying the broadcast content on cooking in a first display area of the display device and, while the broadcast content on cooking is displayed in the first display area of the display, displaying an image of inside the refrigerator in a second display area of the display device by distinguishing the food ingredient included in the broadcast content from other food ingredients inside the refrigerator,
• wherein the broadcast content on cooking is obtained by the server by identifying, from media content pre-stored in the server, image frames for which second text information related to cooking information, recognized from text included in the image frames, corresponds to the first text information and obtaining, as the broadcast content on cooking, media content from the pre-stored media content corresponding to the identified image frames.