# US 2024/0205355 A1 · Enabling automatic generation of dailies > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2024/0205355 A1 - Document ID: US20240205355A1 - Status: Published application - Kind: A1 - Application number: 18/210,322 - Filed: 2023-06-15 - Published: 2024-06-20 - Earliest claimed: 2022-12-19 - Assignees: Sony Group Corporation; Sony Pictures Entertainment Inc. - Applicants: Sony Group Corporation; Sony Pictures Entertainment Inc. - Inventors: Joshua Rizzo; Phillip Squyres - Web page: https://patentgrep.com/patent/US20240205355A1 ## CPC - H04N 5/06: Generation of synchronising signals - G06V 30/1448: {based on markings or identifiers characterising the document or the area} - G11B 27/10: Indexing; Addressing; Timing or synchronising; Measuring tape travel - H04N 21/4302: {Content synchronisation processes, e.g. decoder synchronisation} - H04N 21/8547: involving timestamps for synchronizing content - H04N 5/04: Synchronising (for television systems using pulse code modulation H04N7/56) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G11B: INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER (recording measured values in a way that does not require playback through a transducer G01D9/00; recording or playback apparatus using mechanically marked tape, e.g. punched paper tape, or using unit records, e.g. punched or magnetically marked cards G06K; transferring data from one type of record carrier to another G06K1/18; circuits for coupling output of reproducer to radio receiver H04B1/20; gramophone pick-ups or like acoustic electromechanical transducers or circuits therefor H04R) ## Abstract Synchronizing audio and video streams to enable automatic generation of dailies, including: identifying a first time in the audio stream when a sound occurs from closing clapper sticks; identifying a second time in the video stream when there is an image of the clapper sticks closed, wherein the clapper sticks include symbols or patterns applied on a surface of the clapper sticks which appear complete when the clapper sticks are closed; and synchronizing the audio and video streams using the first and the second time. ## Claims ### Claim 1 A method for synchronizing audio and video streams to enable automatic generation of dailies, the method comprising: identifying a first time in the audio stream when a sound occurs from closing clapper sticks; identifying a second time in the video stream when there is an image of the clapper sticks closed, wherein the clapper sticks include symbols or patterns applied on a surface of the clapper sticks which appear complete when the clapper sticks are closed; and synchronizing the audio and video streams using the first and the second time. ### Claim 2 (depends on 1) The method of claim 1, further comprising automatically generating the dailies once the audio and video streams are synchronized. ### Claim 3 (depends on 1) The method of claim 1, wherein synchronizing the audio and video streams includes applying optical character recognition (OCR) to frames of the video stream to read the symbols or patterns, wherein when the read symbols or patterns match known characters on the clapper sticks, it is determined that the clapper sticks are closed. ### Claim 4 (depends on 1) The method of claim 1, wherein the symbols or patterns applied on a surface of the clapper sticks include at least one of letters, numbers, symbols, codes, pictures, and other similar patterns printed or attached to the clapper sticks. ### Claim 5 (depends on 1) The method of claim 1, wherein the symbols or patterns are split and aligned so that an upper half of the symbols or patterns is on an upper part of the clapper stick and a lower half of the symbols or patterns is on a lower part of the clapper stick. ### Claim 6 (depends on 5) The method of claim 5, wherein the upper half and the lower half of the symbols or patterns are attached to the clapper sticks by glue, tape, or adhesive so that the symbols or patterns are aligned and readable when the clapper sticks are closed. ### Claim 7 (depends on 1) The method of claim 1, wherein identifying a second time in the video stream includes applying a difference detection on frames of the video stream to determine the second time and a corresponding frame when the symbols or patterns are not changing, indicating that the clapper sticks are closed. ### Claim 8 (depends on 1) The method of claim 1, wherein applying the symbols or patterns on the surface of the clapper sticks includes one of printing the symbols or patterns on the clapper sticks, printing the symbols or patterns on a material to attach to the clapper sticks, engraving the symbols or patterns directly on the clapper sticks, or forming the symbols or patterns as an integral part of the clapper sticks. ### Claim 9 (depends on 1) The method of claim 1, wherein applying the symbols or patterns on the surface of the clapper sticks includes projecting or displaying the symbols or patterns onto the surface using at least one of visible light and IR light. ### Claim 10 (depends on 9) The method of claim 9, wherein the projected or displayed symbols or patterns change based on audio detection. ### Claim 11 (depends on 10) The method of claim 10, wherein the symbols or patterns change by transforming from a first form to a second form when the sound from the clapper sticks closing is detected. ### Claim 12 (depends on 1) The method of claim 1, wherein the dailies are automatically generated for one of movie production, game development, motion capture, speeches, presentation, or educational content. ### Claim 13 A system for synchronizing audio and video streams to enable automatic generation of dailies, the system comprising: an audio processor to receive and process the audio stream to identify a first time in the audio stream when a sound occurs from bringing clapper sticks together; a video processor to receive and process the video stream to identify a second time in the video stream when there is an image of the clapper sticks brought together, wherein the clapper sticks include symbols or patterns applied on a surface of the clapper sticks which appear complete when the clapper sticks are brought together; and a synchronization processor to synchronize the audio and video streams using the first and the second time. ### Claim 14 (depends on 13) The system of claim 13, wherein the synchronization processor automatically generates the dailies once the audio and video streams are synchronized. ### Claim 15 (depends on 13) The system of claim 13, wherein the synchronization processor applies OCR to frames of the video stream to read the symbols or patterns, wherein when the read symbols or patterns match known characters on the clapper sticks, it is determined that the clapper sticks are closed. ### Claim 16 (depends on 13) The system of claim 13, wherein the video processor applies a difference detection on frames of the video stream to determine the second time and a corresponding frame when the symbols or patterns are not changing, indicating that the clapper sticks are brought together. ### Claim 17 A non-transitory computer-readable storage medium storing a computer program to synchronize audio and video streams to enable automatic generation of dailies, the computer program comprising executable instructions that cause a computer to: identify a first time in the audio stream when a sound occurs from closing clapper sticks; identify a second time in the video stream when there is an image of the clapper sticks closed, wherein the clapper sticks include symbols or patterns applied on a surface of the clapper sticks which appear complete when the clapper sticks are closed; and synchronize the audio and video streams using the first and the second time. ### Claim 18 (depends on 17) The non-transitory computer-readable storage medium of claim 17, further comprising executable instructions that cause the computer to automatically generate the dailies once the audio and video streams are synchronized. ### Claim 19 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein executable instructions that cause the computer to synchronize the audio and video streams include executable instructions that cause the computer to apply OCR to frames of the video stream to read the symbols or patterns, wherein when the read symbols or patterns match known characters on the clapper sticks, it is determined that the clapper sticks are closed. ### Claim 20 (depends on 17) The non-transitory computer-readable storage medium of claim 17, wherein executable instructions that cause the computer to identify the second time in the video stream include executable instructions that cause the computer to apply a difference detection on frames of the video stream to determine the second time and a corresponding frame when the symbols or patterns are not changing, indicating that the clapper sticks are closed.