# US 12,112,534 B2 · Sticking determination device and sticking determination method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,112,534 B2 - Document ID: US12112534B2 - Status: Granted - Kind: B2 - Application number: 17/453,989 - Filed: 2021-11-08 - Published: 2022-02-24 - Granted: 2024-10-08 - Earliest claimed: 2019-06-03 - Assignees: Denso Corporation - Applicants: Denso Corporation - Inventors: Nobuhiko Tanibata - Web page: https://patentgrep.com/patent/US12112534B2 ## CPC - G06V 10/98: Detection or correction of errors, e.g. by rescanning the pattern or by human intervention; Evaluation of the quality of the acquired patterns - G09G 3/006: {Electronic inspection or testing of displays and display drivers, e.g. of LED or LCD displays (testing individual LED's G01R31/2635; testing lamps G01R31/44; testing of optical features of LCD displays G02F1/1309)} - G06T 1/20: Processor architectures; Processor configuration, e.g. pipelining - G06T 1/60: Memory management - G06V 10/751: {Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching} - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast - H04N 17/00: Diagnosis, testing or measuring for television systems or their details - H04N 23/60: Control of cameras or camera modules - G09G 2360/145: the light originating from the display screen - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A sticking determination device includes a CPU, a GPU, a memory, a bus, and an image acquiring unit configured to acquire an image data from the camera and save the image data to the memory. The image acquiring unit transmits, to the CPU, a save completion notification indicative of completion of saving respective one of divided units of the image data. The CPU transmits a read instruction to the GPU to read, from the memory, a pixel value of at least one pixel at a sticking determination target position. The GPU reads the pixel value of the at least one pixel from the memory and transmits the read pixel value to the CPU. The CPU is configured to determine whether the image data is stuck by comparing the pixel value in a current frame with the pixel value in a previous frame. ## Claims ### Claim 1 A sticking determination device configured to determine whether image data having pixel values of a plurality of pixels that form an image taken by a camera is stuck, the sticking determination device comprising: a CPU; a GPU; a memory; a bus that connects together the CPU, the GPU, and the memory; and an image acquiring unit configured to acquire the image data from the camera and save the image data to the memory, wherein the image data of each frame is formed of a plurality of divided units, upon saving a respective one of the plurality of divided units to the memory, the image acquiring unit transmits, to the CPU, a save completion notification indicative of completion of saving the respective one of the plurality of divided units, upon receiving the save completion notification, the CPU transmits a read instruction to the GPU to read, from the memory, the pixel values of some of the plurality of pixels at positions in one horizontal line serving as sticking determination target positions, upon receiving the read instruction from the CPU, the GPU reads the pixel values of the some of the plurality of pixels from the memory and transmits the read pixel values to the CPU, and the CPU is configured to perform a pixel value comparison process to determine whether the image data is stuck by comparing the pixel values of the some of the plurality of pixels in a current frame that is read from the memory with the pixel values of the some of the plurality of pixels in a previous frame. ### Claim 2 (depends on 1) The sticking determination device according to claim 1, wherein the CPU is configured to use positions of some pixels of the plurality of pixels of the image data of each frame as the sticking determination target positions in a process to determine whether the image data of each frame is stuck. ### Claim 3 (depends on 2) The sticking determination device according to claim 2, wherein the camera is mounted in a vehicle to take the image of an area in front of or behind the vehicle, and the sticking determination device is configured to determine whether the image data is stuck for every frame. ### Claim 4 (depends on 2) The sticking determination device according to claim 2, wherein the CPU is configured to reduce, based on a load on the CPU, a number of the pixels whose positions are used as the sticking determination target positions in the process to determine whether the image data of each frame is stuck. ### Claim 5 (depends on 2) The sticking determination device according to claim 2, wherein the CPU is configured to change at least some of the pixels whose positions are used as the sticking determination target positions for each frame in the process to determine whether the image data of each frame is stuck. ### Claim 6 (depends on 5) The sticking determination device according to claim 5, wherein the CPU is configured to change the sticking determination target positions in the current frame by one pixel from the sticking determination target positions in the previous frame in the process to determine whether the image data of each frame is stuck. ### Claim 7 (depends on 5) The sticking determination device according to claim 5, wherein the CPU is configured to determine the pixels whose positions are used as the sticking determination target positions at random for each frame in the process to determine whether the image data of each frame is stuck. ### Claim 8 (depends on 1) The sticking determination device according to claim 1, wherein the sticking determination target position are set at same positions of a plurality of target pixels regardless of frames, and the CPU is configured to, in a process to determine whether the image data of each frame is stuck, calculate a hash value from the pixel values of the plurality of target pixels at the sticking determination target positions; and determine whether the image data is stuck by comparing the hash value calculated from the pixel values in the current frame with the hash value calculated from the pixel values in the previous frame. ### Claim 9 (depends on 8) The sticking determination device according to claim 8, wherein the CPU is configured to calculate the hash value from the pixel values of the pixels in one vertical or horizontal line. ### Claim 10 A sticking determination device configured to determine whether image data having pixel values of a plurality of pixels that form an image taken by a camera is stuck, the sticking determination device comprising: a CPU; a GPU; a memory; a bus that connects together the CPU, the GPU, and the memory; and an image acquiring unit configured to acquire the image data from the camera and save the image data to the memory, wherein upon saving a part or whole of the image data of one frame to the memory, the image acquiring unit transmits, to the CPU, a save completion notification indicative of completion of saving, upon receiving the save completion notification, the CPU transmits a read instruction to the GPU to read, from the memory, the pixel values of some of the plurality of pixels at positions in one horizontal line serving as sticking determination target positions, upon receiving the read instruction from the CPU, the GPU reads the pixel values of the some of the plurality of pixels from the memory and transmits the read pixel values to the CPU, the CPU is configured to perform a pixel value comparison process to determine whether the image data is stuck by comparing the pixel values of the some of the plurality of pixels in a current frame that is read from the memory with the pixel values of the some of the plurality of pixels in a previous frame, and the CPU is configured to use positions of some pixels of the plurality of pixels of the image data of each frame as the sticking determination target positions. ### Claim 11 (depends on 10) The sticking determination device according to claim 10, wherein the CPU is configured to reduce, based on a load on the CPU, a number of the pixels whose positions are used as the sticking determination target positions in a process to determine whether the image data of each frame is stuck. ### Claim 12 (depends on 10) The sticking determination device according to claim 10, wherein the CPU is configured to change at least some of the pixels whose positions are used as the sticking determination target positions for each frame in a process to determine whether the image data of each frame is stuck. ### Claim 13 (depends on 12) The sticking determination device according to claim 12, wherein the CPU is configured to change the sticking determination target positions in the current frame by one pixel from the sticking determination target positions in the previous frame in the process to determine whether the image data of each frame is stuck. ### Claim 14 (depends on 12) The sticking determination device according to claim 12, wherein the CPU is configured to determine the pixels whose positions are used as the sticking determination target positions at random for each frame in the process to determine whether the image data of each frame is stuck. ### Claim 15 (depends on 10) The sticking determination device according to claim 10, wherein the sticking determination target positions are set at same positions of a plurality of target pixels regardless of frames, and the CPU is configured to, in a process to determine whether the image data of each frame is stuck, calculate a hash value from the pixel values of the plurality of target pixels at the sticking determination target positions; and determine whether the image data is stuck by comparing the hash value calculated from the pixel values in the current frame with the hash value calculated from the pixel values in the previous frame. ### Claim 16 (depends on 15) The sticking determination device according to claim 15, wherein the CPU is configured to calculate the hash value from the pixel values of the pixels in one vertical or horizontal line. ### Claim 17 A method for a device to determine whether image data having pixel values of a plurality of pixels that form an image taken by a camera is stuck, the device including: a CPU; a GPU; a memory; a bus that connects together the CPU, the GPU, and the memory; and an image acquiring unit configured to acquire the image data and save the image data to the memory, wherein the image data of each frame is formed of a plurality of divided units, and the method comprises: upon saving a respective one of the plurality of divided units to the memory by the image acquiring unit, transmitting, to the CPU by the image acquiring unit, a save completion notification indicative of completion of saving the respective one of the plurality of divided units, upon receiving the save completion notification by the CPU, transmitting by the CPU a read instruction to the GPU to read, from the memory, the pixel values of some of the plurality of pixels at positions in one horizontal line serving as sticking determination target positions, upon receiving the read instruction from the CPU by the GPU, reading by the GPU the pixel values of the some of the plurality of pixels from the memory, transmitting the read pixel values to the CPU by the GPU, and performing a pixel value comparison process by the CPU to determine whether the image data is stuck by comparing the pixel values of the some of the plurality of pixels in a current frame that is read from the memory with the pixel values of the some of the plurality of pixels in a previous frame. ### Claim 18 A method for a device to determine whether image data having pixel values of a plurality of pixels that form an image taken by a camera is stuck, the device including: a CPU; a GPU; a memory; a bus that connects together the CPU, the GPU, and the memory; and an image acquiring unit configured to acquire the image data and save the image data to the memory, the method comprising: upon saving a part or whole of the image data of one frame to the memory by the image acquiring unit, transmitting, to the CPU by the image acquiring unit, a save completion notification indicative of completion of saving, upon receiving the save completion notification by the CPU, transmitting by the CPU a read instruction to the GPU to read, from the memory, the pixel values of some of the plurality of pixels positions in one horizontal line serving as sticking determination target positions, upon receiving the read instruction from the CPU by the GPU, reading by the GPU the pixel values of the at least one pixel some of the plurality of pixels from the memory, transmitting the read pixel values to the CPU by the GPU, performing a pixel value comparison process by the CPU to determine whether the image data is stuck by comparing the pixel values of the some of the plurality of pixels in a current frame that is read from the memory with the pixel values of the some of the plurality of pixels in a previous frame, wherein positions of some pixels of the plurality of pixels of the image data of each frame are used as the sticking determination target positions.