Rich content for query answers

A method performed by data processing apparatus, the method comprising:

• receiving, by a data processing apparatus, a query determined to be a question query and a corresponding answer generated in response to the question query, the answer determined to be responsive to the question query, wherein each of the question query and the answer has one or more terms;
• generating, by the data processing apparatus, a contextual query that includes an element relating to the question query and an element relating to the answer;
• submitting, by the data processing apparatus, the contextual query to a rich content search process and receiving data specifying a first set of rich content items responsive to the contextual query, the rich content items ranked according to an order that is indicative of the relevance of each rich content item to a query for which the set was generated;
• determining, by the data processing apparatus, first rich content items in the first set of rich content items that meet a context condition that is indicative of a rich content item providing contextual information of both elements of the question query and the answer;
• determining, by the data processing apparatus, second rich content items in the first set of rich content items that do not meet the context condition;
• and
• selecting rich content items from one or more of the first rich content items and the second rich content items, wherein the selected one or more rich content items are provided as one or more answer rich content items;
• wherein determining first rich content items in the first set of rich content items meet a context condition that is indicative of an rich content item providing contextual information of both terms of the question and terms of the answer and second rich content items that do not meet the context condition comprises:
• for each rich content item in the first set of rich content items, receiving data specifying rich content item labels for the rich content item;
• determining each rich content item having labels that match terms of the answer and terms of the question query as a first rich content item;
• and
• determining each rich content item not having labels that match at least one terms of the answer and terms of the question query as a second rich content item;
• wherein the rich content items are non-textual content.

A method performed by data processing apparatus, the method comprising:

• receiving, by a data processing apparatus, a query determined to be a question query and a corresponding answer generated in response to the question query, the answer determined to be responsive to the question query, wherein each of the question query and the answer has one or more terms;
• generating, by the data processing apparatus, a contextual query that includes an element relating to the question query and an element relating to the answer;
• submitting, by the data processing apparatus, the contextual query to a rich content search process and receiving data specifying a first set of rich content items responsive to the contextual query, the rich content items ranked according to an order that is indicative of the relevance of each rich content item to a query for which the set was generated;
• determining, by the data processing apparatus, first rich content items in the first set of rich content items that meet a context condition that is indicative of a rich content item providing contextual information of both elements of the question query and the answer;
• determining, by the data processing apparatus, second rich content items in the first set of rich content items that do not meet the context condition;
• and
• selecting rich content items from one or more of the first rich content items and the second rich content items wherein the selected one or more rich content items are provided as one or more answer rich content items;
• wherein determining first rich content items in the first set of rich content items meet a context condition that is indicative of an rich content item providing contextual information of both terms of the question and terms of the answer and second rich content items that do not meet the context condition comprises:
• for each rich content item in the set of first rich content items, detecting entities depicted in the rich content item by use of rich content item processing;
• determining each rich content item depicting entities that are described by both terms of the answer and terms of the question query as a first rich content item;
• and
• determining each rich content item depicting entities that are not described by both terms of the answer and terms of the question query as a second rich content item;
• wherein the rich content items are non-textual content.

A system, comprising:

• a data processing apparatus;
• and
• a computer readable memory system in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:
• receiving a query determined to be a question query and a corresponding answer generated in response to the question query, the answer determined to be responsive to the question query, wherein each of the question query and the answer has one or more terms;
• generating a contextual query that includes an element relating to the question query and an element relating to the answer;
• submitting the contextual query to a rich content search process and receiving data specifying a first set of rich content item responsive to the contextual query, the rich content items ranked according to an order that is indicative of the relevance of each rich content item to a query for which the set was generated, the submitting comprising submitting each of the question query, the answer, and the contextual query to the rich content item search process and receiving data specifying the first set of rich content items responsive to the contextual query, a second set of rich content items responsive to the question query, and a third set of rich content items responsive to the answer, wherein each set of rich content items differs from each other respective set of rich content items, and the rich content items in each set of rich content items are ranked according to an order that is indicative of the relevance of each rich content item to a query for which the set was generated;
• determining first rich content items in the first set of rich content items that meet a context condition that is indicative of a rich content item providing contextual information of both elements of the question query and the answer, query, the determining first rich content items comprising determining from the data specifying the first, second and third sets of rich content items, first rich content items in the first set that that are not included in both of the second set and the third set and second rich content items in the first set that are included in at least one of the second set or third set;
• determining second rich content items in the first set of rich content items that do not meet the context condition;
• and
• selecting rich content items from one or more of the first rich content items and the second rich content items, wherein the selected one or more rich content items are provided as one or more answer rich content items;
• wherein the rich content items are non-textual content.

A system, comprising:

• a data processing apparatus;
• and
• a computer readable memory system in data communication with the data processing apparatus and storing instructions executable by the data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:
• receiving a query determined to be a question query and a corresponding answer generated in response to the question query, the answer determined to be responsive to the question query, wherein each of the question query and the answer has one or more terms;
• generating a contextual query that includes an element relating to the question query and an element relating to the answer;
• submitting the contextual query to an image search process and receiving data specifying a first set of images responsive to the contextual query, the images ranked according to an order that is indicative of the relevance of each image to a query for which the set was generated;
• determining first images in the first set of images that meet a context condition that is indicative of an image providing contextual information of both elements of the question query and the answer, query;
• determining second images in the first set of images that do not meet the context condition;
• and
• selecting one or more images from one or more of the first images and the second images, wherein the selected images are provided as one or more answer images;
• wherein determining first images in the first set of images meet a context condition that is indicative of an image providing contextual information of both terms of the question and terms of the answer and second images that do not meet the context condition comprises:
• for each image in the set of first images, receiving data specifying image labels for the image;
• determining each image having labels that match terms of the answer and terms of the question query as first images;
• and
• determining each image not having labels that match at least one terms of the answer and terms of the question query as second images.

A computer readable memory apparatus storing instructions executable by a data processing apparatus and that upon such execution cause the data processing apparatus to perform operations comprising:

• receiving a query determined to be a question query and a corresponding answer generated in response to the question query, the answer determined to be responsive to the question query, wherein each of the question query and the answer has one or more terms;
• generating a contextual query that includes an element relating to the question query and an element relating to the answer;
• submitting the contextual query to a rich content search process and receiving data specifying a first set of rich content items responsive to the contextual query, the rich content items ranked according to an order that is indicative of the relevance of each rich content item to a query for which the set was generated;
• determining first rich content item in the first set of rich content items that meet a context condition that is indicative of a rich content item providing contextual information of both elements of the question query and the answer;
• determining second rich content items in the first set of rich content items that do not meet the context condition and
• selecting rich content items from one or more of the first rich content items and the second rich content items, wherein the selected one or more rich content items are provided as one or more answer rich content items;
• wherein determining first rich content items in the first set of rich content items meet a context condition that is indicative of an rich content item providing contextual information of both terms of the question and terms of the answer and second rich content items that do not meet the context condition comprises:
• for each rich content item in the first set of rich content items, receiving, data specifying rich content item labels for the rich content item;
• determining each rich content item having labels that match terms of the answer and terms of the question query as a first rich content item;
• and
• determining each rich content item not having labels that match at least one terms of the answer and terms of the question query as a second rich content item;
• wherein the rich content items are non-textual content.