# US 10,313,636 B2 · Display system and display apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,636 B2 - Document ID: US10313636B2 - Status: Granted - Kind: B2 - Application number: 16/039,423 - Filed: 2018-07-19 - Published: 2018-11-08 - Granted: 2019-06-04 - Earliest claimed: 2014-12-08 - Assignees: Japan Display Inc. - Applicants: Japan Display Inc. - Inventors: Yutaka Ozawa; Akira Sakaigawa; Keiji Fukuhara - Web page: https://patentgrep.com/patent/US10313636B2 ## CPC - H04N 7/181: {for receiving images from a plurality of remote sources} - B60R 1/025: {comprising special mechanical means for correcting the field of view in relation to particular driving conditions, e.g. change of lane; scanning mirrors} - G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)} - G09G 5/005: {Adapting incoming signals to the display format of the display terminal} - H04L 12/1895: {for short real-time information, e.g. alarms, notifications, alerts, updates} - H04N 5/42: for transmitting at will black-and-white or colour signals - H04N 5/77: between a recording apparatus and a television camera - H04N 5/772: {the recording apparatus and the television camera being placed in the same enclosure} - H04N 7/188: {Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253)} - H04N 7/24: Systems for the transmission of television signals using pulse code modulation (H04N21/00 takes precedence) - H04N 23/80: Camera processing pipelines; Components thereof - H04N 23/951: by using two or more images to influence resolution, frame rate or aspect ratio - H04N 23/957: Light-field or plenoptic cameras or camera modules - B60R 2001/1253: {with cameras, video cameras or video screens} - G09G 2300/0452: Details of colour pixel setup, e.g. pixel composed of a red, a blue and two green components - G09G 2340/0457: Improvement of perceived resolution by subpixel rendering - G09G 2370/12: Use of DVI or HDMI protocol in interfaces along the display data pipeline - G09G 2380/10: Automotive applications - H04N 5/14: Picture signal circuitry for video frequency region (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract The display system includes a display system including an image-capturing apparatus including an image-capturing element; an image processing apparatus that performs image processing on the image; and a display apparatus including a display device that displays the image resulting from the image processing. The image processing apparatus includes an image processor that performs the image processing on a predetermined number of line images corresponding to a part of a frame image captured by the image-capturing element, sequentially outputs the image to the display apparatus per the predetermined number of line images, and causes the display apparatus to display the frame image; and a storage device that stores the predetermined number of line images until the frame image is completed. The image processor is configured to perform the image processing including frame unit processing on the predetermined number of line images associated with the frame image to be output. ## Claims ### Claim 1 A display system comprising: a display apparatus that displays an image resulting from image processing; an image-capturing apparatus that sequentially captures and outputs a part of a frame image that corresponds to a predetermined number of line images that are to be displayed by the display apparatus; a storage device that stores the predetermined number of line images until the frame image is completed to store line images of a completed frame image; and an image processor that is configured to sequentially, receive the predetermined number of line images, perform pixel interpolation and then frame unit processing on the predetermined number of line images based on the line images of the completed frame image, and sequentially output the image per the predetermined number of line images to cause the display apparatus to receive and display the part of the frame image sequentially; and a display apparatus that displays the image per the predetermined number of line images on which the pixel interpolation and the frame unit processing are performed and on which encoding and decoding are not performed. ### Claim 2 (depends on 1) The display system according to claim 1, wherein the completed frame image used in performing the frame unit processing on the part of the image is a frame image one or more frames before a frame image to which the part of the image belongs. ### Claim 3 (depends on 1) The display system according to claim 1, wherein the image processor is configured to perform the image processing including line unit processing on the predetermined number of line images to be output to the display apparatus, and wherein the line unit processing includes one or more of gradation correction and color correction by using the data of the completed frame image. ### Claim 4 (depends on 1) The display system according to claim 1, wherein the frame unit processing includes one or more of distortion correction, auto exposure, and auto white balance of the image by using the data of the completed frame image. ### Claim 5 (depends on 1) The display system according to claim 1, wherein the display apparatus includes a plurality of pixels arranged in a matrix of a row direction and a column direction, and the part of the frame image is one of a line image displayed by the pixels of one of the row. ### Claim 6 (depends on 1) The display system according to claim 1, further comprising an image processing apparatus that performs the image processing on the image, including a storage device and the image processor; and a coupler used to transmit data between the image-capturing apparatus and the image processing apparatus, between the image processing apparatus and the display apparatus, or both wherein the storage device stores the predetermined number of line images until the frame image is completed to store line images of the completed frame image. ### Claim 7 (depends on 6) The display system according to claim 6, wherein the coupler is provided between the image-capturing apparatus and the image processing apparatus, and is configured to transmit data of the line images yet to be subjected to Bayer conversion, and wherein the image processing apparatus performs the pixel interpolation on the line images yet to be subjected to Bayer conversion. ### Claim 8 (depends on 6) The display system according to claim 6, wherein the image-capturing apparatus and the display apparatus are configured to operate in association with a vehicle, and wherein the image-capturing apparatus is configured to capture an image outside the vehicle. ### Claim 9 (depends on 6) The display system according to claim 6, wherein the coupler includes a least one of a serializer, a deserializer and a signal line. ### Claim 10 (depends on 7) The display system according to claim 7, wherein the image-capturing apparatus and the display apparatus are configured to operate in association with a vehicle, and wherein the image-capturing apparatus is configured to capture an image outside the vehicle. ### Claim 11 (depends on 10) The display system according to claim 10, wherein the display system comprises a plurality of the display apparatuses, and wherein, when at least one of the display apparatuses is not operable, at least one of the display apparatuses is operable and configured to display and output data as a substitute for the display apparatus that is not operable. ### Claim 12 (depends on 11) The display system according to claim 11, wherein the display system comprises a plurality of the image-capturing apparatuses, and wherein the image processor is configured to synthesize images captured by the image-capturing apparatuses. ### Claim 13 (depends on 10) The display system according to claim 10, wherein the display system comprises a plurality of the image-capturing apparatuses, and wherein the image processor is configured to synthesize images captured by the image-capturing apparatuses.