# US 2013/0156308 A1 · Picture detection device, picture recording device, picture recording/reproduction device, picture detection method, picture recording method, and picture recording/reproduction method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2013/0156308 A1 - Document ID: US20130156308A1 - Status: Published application - Kind: A1 - Application number: 13/669,678 - Filed: 2012-11-06 - Published: 2013-06-20 - Earliest claimed: 2011-12-20 - Inventors: Akio ABE - Web page: https://patentgrep.com/patent/US20130156308A1 ## CPC - G06V 10/50: by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/4334: {Recording operations (recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/47: End-user applications - H04N 21/4858: {for modifying screen layout parameters, e.g. fonts, size of the windows} - G06V 30/414: Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text - H04N 21/488: Data services, e.g. news ticker {(systems specially adapted for using meteorological information in broadcast systems H04H60/71)} - H04N 21/8126: {involving additional data, e.g. news, sports, stocks, weather forecasts} - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A picture detection device includes an estimation unit configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimate an edge portion of the picture frame in which the second picture is displayed from among above-described four portions; and a detection unit configured to detect the first picture of the picture flame; wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline. ## Claims ### Claim 1 A picture detection device, comprising: an estimation unit configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimate an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; and a detection unit configured to detect the first picture of the picture flame; wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline. ### Claim 2 (depends on 1) The picture detection device according to claim 1, wherein the pixel color information is a color difference, and when the color differences of all pixels in a prescribed number of lines in the edge portion of the picture frame are the same, or when the ratio of the number of pixels approximating a color difference among all pixels in a prescribed number of lines in the edge portion of the picture frame to the number of all pixels is equal to or greater than a first threshold, the estimation unit estimates the edge portion of the picture frame to be a edge portion of the picture frame in which the second picture is displayed. ### Claim 3 (depends on 1) The picture detection device according to claim 1, wherein, when the color differences of a portion of pixels in a prescribed number of lines in the edge portion of the picture frame are the same, or when the ratio of the number of pixels approximating a color difference among a portion of pixels in a prescribed number of lines in the edge portion of the picture frame to the number of the portion of pixels is equal to or greater than a second threshold, the estimation unit estimates the edge portion of the picture frame to be a edge portion of the picture frame in which the second picture is displayed. ### Claim 4 (depends on 1) The picture detection device according to claim 1, wherein the detection unit moves a vertical-direction first borderline detection line in a horizontal direction from the center of the picture frame toward the estimated vertical-direction edge portion, and moves a horizontal-direction second borderline detection line in a vertical direction from the center of the picture frame toward the estimated horizontal-direction edge portion, and based on brightness differences of pixels in the vicinities of the first and second borderline detection lines, detects borderlines between the first picture and the second picture. ### Claim 5 (depends on 4) The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of vertical-direction borderlines and also detects a plurality of horizontal-direction borderlines, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of vertical-direction borderlines and also selects one among the plurality of horizontal-direction borderlines and then detects the first picture having the aspect ratio. ### Claim 6 (depends on 4) The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of vertical-direction borderlines and also detects one horizontal-direction borderline, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of vertical-direction borderlines and detects the first picture having the aspect ratio. ### Claim 7 (depends on 4) The picture detection device according to claim 4, wherein, when the detection unit detects a plurality of horizontal-direction borderlines and also detects one vertical-direction borderline, based on the aspect ratio of the picture frame, the detection unit selects one among the plurality of horizontal-direction borderlines and detects the first picture having the aspect ratio. ### Claim 8 A picture recording device, comprising: an estimation unit, configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimates an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; a detection unit configured to detect the first picture of the picture flame; and a recording unit configured to record on a recording medium a picture signal of the detected first picture; wherein the detection unit moves a borderline detection line from the center of the picture frame toward the estimated edge portion, and detects a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detects the first picture based on the detected borderline. ### Claim 9 A picture recording/reproduction device, comprising: an estimation unit, configured to, based on deviations in color information of pixels of a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion, and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimates an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; a detection unit configured to move a borderline detection line from the center of the picture frame toward the estimated edge portion, detect a borderline between the first picture and the second picture based on a brightness difference of pixels in the vicinity of the borderline detection line, and detect the first picture based on the detected borderline; a recording unit configured to record on a recording medium a picture signal of the picture frame in association with positional information of the detected borderline in the picture frame; and a reproduction configured to reproduce the picture signal; wherein the detection unit configured to detect the first picture in the picture frame recorded on the recording medium, based on the positional information of the borderline recorded in association with the picture signal of the picture frame recorded on the recording medium; and the reproduction unit configured to reproduce the picture signal of the detected first picture. ### Claim 10 A picture detection method, comprising: based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture; and based on the detected borderline, detecting the first picture. ### Claim 11 A picture recording method, comprising: based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture; based on the detected borderline, detecting the first picture; and recording the picture signal of the detected first picture on a recording medium. ### Claim 12 A picture recording/reproduction method, comprising: based on deviations in color information of pixels in a prescribed number of lines in an upper-edge portion, lower-edge portion, left-edge portion and right-edge portion of a picture frame including a first picture and a second picture displayed on the periphery of the first picture, estimating an edge portion of the picture frame in which the second picture is displayed from among the upper-edge portion, the lower-edge portion, the left-edge portion, and the right-edge portion; moving a borderline detection line from the center of the picture frame toward the estimated edge portion, and based on brightness differences of pixels in the vicinity of the borderline detection line, detecting a borderline between the first picture and the second picture; recording the picture signal of the picture frame in association with positional information of the detected borderline in the picture frame on a recording medium; based on the positional information of the borderline recorded in association with a picture signal of the picture frame recorded on the recording medium, detecting a first picture in the picture frame recorded on the recording medium; and reproducing the picture signal of the detected first picture.