# US 5,583,577 A · Caption data coding/decoding systems and methods that includes key data indicating intermediate levels of attenuation in the vicinity of the caption > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 5,583,577 A - Document ID: US5583577A - Status: Granted - Kind: A - Application number: 08/387,904 - Filed: 1995-04-03 - Granted: 1996-12-10 - Earliest claimed: 1993-06-30 - Assignees: Sony Corporation - Inventors: Ikuo Tsukagoshi - Web page: https://patentgrep.com/patent/US5583577A ## CPC - H04N 21/4348: {Demultiplexing of additional data and video streams} - H04N 5/278: Subtitling - H04N 5/44504: {Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits} - H04N 7/0884: {for the transmission of additional display-information, e.g. menu for programme or channel selection} - H04N 7/0885: {for the transmission of subtitles} - H04N 9/8233: {the additional signal being a character code signal} - H04N 19/467: characterised by the embedded information being invisible, e.g. watermarking - H04N 21/23614: {Multiplexing of additional data and video streams (arrangements for simultaneous broadcast of plural pieces of information H04H20/28)} - H04N 21/2662: Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities - H04N 21/434: Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream {(demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00)} - H04N 21/435: Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream - H04N 21/4382: {Demodulation or channel decoding, e.g. QPSK demodulation (analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002)} - H04N 21/440272: {for performing aspect ratio conversion} - H04N 21/4425: Monitoring of client processing errors or hardware failure - H04N 21/4884: {for displaying subtitles} - H04N 21/6332: directed to client - H04N 21/6336: directed to decoder - H04N 21/654: Transmission by server directed to the client - H04N 7/0122: {the input and the output signals having different aspect ratios} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A caption coding method is for coding a caption, represented by caption data, to be superimposed on a video image for display. Caption data, representing the caption to be superimposed on the video image for display, is coded. Key data is coded to have a value corresponding to one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of portions of the video image in a vicinity of the caption. The coded caption data and the coded key data are combined with video image data that represents the video image, to generate a combined image signal. ## Claims ### Claim 1 A caption coding method for coding a caption, represented by caption data, to be superimposed on a video image for display, comprising: coding the caption data representing the caption to be superimposed on the video image for display; coding key data to have a value corresponding to one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of portions of the video image in a vicinity of the caption; and combining the coded caption data and the coded key data with video image data that represents the video image, to generate a combined image signal. ### Claim 2 (depends on 1) The caption coding method according to claim 1, and further comprising: quantizing the caption data and the key data. ### Claim 3 (depends on 1) The caption coding method according to claim 1, and further comprising: expressing each of the caption data and the key data by a predetermined number of bits, and selectively coding one of the caption data and the key data, but not both, into a predetermined portion of the combined image signal. ### Claim 4 (depends on 1) The caption coding method according to claim 1, and further comprising: coding the caption data in a squeeze mode when the video image data is coded in the squeeze mode. ### Claim 5 (depends on 1) The caption coding method according to claim 1, and further comprising: compressively coding the video image, to achieve the video image data, at a rate according to an amount of code generated for the caption data and key data. ### Claim 6 (depends on 1) The caption coding method according to claim 1, and further comprising: coding brightness data of the caption as at least a portion of the caption data by calculating a difference of the color data of the caption for a first field or frame of the video image relative to the color data of the caption for a second field or frame of the video image to determine color difference data, and coding the color difference data. ### Claim 7 (depends on 1) The caption coding method according to claim 1, wherein the step of coding the color difference data includes: combining the color difference data of the caption with an offset value corresponding to a coordinate position, of the video image, of a change point of the color difference data, to determine a chroma vector, and coding the chroma vector. ### Claim 8 (depends on 7) The caption coding method according to claim 7, and further comprising: multiplexing the offset value of the brightness data of said caption into the combined image signal. ### Claim 9 (depends on 1) The caption coding method according to claim 1, and further comprising: combining position data, representing a position of the video image at which the caption is to be superimposed, with the caption data. ### Claim 10 (depends on 1) The caption coding method according to claim 1, and further comprising: combining a page end word representing the page end of the caption, for each page of the caption. ### Claim 11 (depends on 1) The caption coding method according to claim 1, and further comprising: adding a code for error detection for each page of the caption. ### Claim 12 (depends on 1) The caption coding method according to claim 1, wherein the caption data and key data are coded using at least one of DPCM, run length coding, or variable-length coding. ### Claim 13 A caption decoding method for decoding coded data, comprising: generating a signal representing a caption, based on a coded caption data portion of the coded data, to be superimposed onto a video image; and attenuating the video image in a vicinity of the caption at one of a maximum rate, a minimum rate, and one or more intermediate rates, based on a coded key data portion of the coded data. ### Claim 14 (depends on 13) The caption decoding method according to claim 13, and further comprising: inverse-quantizing the coded caption data. ### Claim 15 (depends on 13) The caption decoding method according to claim 13, and further comprising: separating a coded video image signal from the coded data, and decoding the coded video image signal to generate the video image. ### Claim 16 (depends on 13) The caption decoding method according to claim 13, and further comprising: decoding coded brightness data from the coded data, and adding coded color difference data for a predetermined field or frame to decode color difference data, to thereby generate a color difference of the caption. ### Claim 17 (depends on 13) The caption decoding method according to claim 13, and further comprising: decoding coded brightness data, and decoding coded color difference data based on an offset value of a predetermined color difference data and a chroma vector corresponding to a coordinate position, of the video image, of a change point of the color difference data of the caption, to thereby generate a color difference of the caption. ### Claim 18 (depends on 17) The caption decoding method according to claim 17, and further comprising: adding an offset value of the brightness data of the coded data to the decoded brightness data based on the chroma vector. ### Claim 19 (depends on 13) The caption decoding method according to claim 13, and further comprising: controlling the position of the caption on the video image based on position data in the coded data. ### Claim 20 (depends on 13) The caption decoding method according to claim 13, and further comprising: storing the coded caption data and the coded key data in a memory; and reading and decoding the coded caption data and the coded key data stored in the memory. ### Claim 21 (depends on 20) The caption decoding method according to claim 20, and further comprising: performing bank switching of the memory based on a page end word in the transmitted coded data representing the page end of the caption of the coded data. ### Claim 22 (depends on 13) The caption decoding method according to claim 13, and further comprising: performing error detection using a code for error detection provided for each page of the caption and, when an error is detected, stopping the decoding of the coded data of the page of the caption including the detected error. ### Claim 23 (depends on 13) The caption decoding method according to claim 13, and further comprising: decoding the caption data and key data using at least one of variable-length decoding, run length decoding, or IDPCM. ### Claim 24 (depends on 19) The caption decoding method according to claim 19, and further comprising: changing the display position of the caption to a position different from a position indicated by the position data. ### Claim 25 A data transmission method for transmitting data associated with a caption to be superimposed on a video image for display, comprising: generating key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in the vicinity of the caption; combining the key data with caption data that represents the caption and with a video image signal to generate a combined image signal; transmitting the combined image signal. ### Claim 26 (depends on 25) The data transmission method according to claim 25, and further comprising: quantizing the key data; and transmitting the quantized key data as bits at predetermined positions in the combined image signal. ### Claim 27 A video image control method for superimposing a caption on a video image for display, comprising: receiving coded key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in a vicinity of the caption; decoding the coded key data; and attenuating the video image in the vicinity of the caption at a rate indicated by the decoded key data. ### Claim 28 A video image control method for superimposing a caption on a video image for display, comprising: receiving coded key data representing an attenuation rate of the video image in a vicinity of the caption; decoding the coded key data; attenuating the video image in the vicinity of the caption at a rate indicated by the decoded key data; making the attenuation rate of said video image minimum when said decoded key data is minimum data; making the attenuation rate of said video image maximum when said key data is maximum data; and making the attenuation rate of said video image correspond to the magnitude of said value when said key data is a value between the minimum and the maximum. ### Claim 29 A recording medium having a video image recorded thereon, the recording medium having recorded thereon coded caption data for controlling a display apparatus to display a caption superimposed on a video image and coded key data for controlling the display apparatus to attenuate the video image at one of a maximum rate, a minimum rate, and one or more intermediate rates between the maximum rate and the minimum rate, in a vicinity of the caption. ### Claim 30 (depends on 29) The recording medium according to claim 29, having further recorded thereon an offset value of predetermined color difference data, and a chroma vector corresponding to a coordinate position, of the video image, of a change point of a color difference of the caption. ### Claim 31 (depends on 30) The recording medium according to claim 30, having further recorded thereon an offset value of brightness data of the caption. ### Claim 32 (depends on 29) The recording medium according to claim 29, having further recorded thereon position data for controlling a position of the video image at which the display apparatus is to display the caption. ### Claim 33 (depends on 29) The recording medium according to claim 29, having further recorded thereon a page end word representing a page end of the caption. ### Claim 34 (depends on 29) The recording medium according to claim 29, having further recorded thereon a code for error detection for each page of the caption. ### Claim 35 (depends on 29) The recording medium according to claim 29, wherein the coded caption data includes brightness data representing the brightness of the caption and color difference data differentiated for a predetermined field or frame of the caption. ### Claim 36 A caption coding system for coding a caption to be superimposed on a video image for display, comprising: caption data coding means for coding caption data representing a caption to be superimposed on a video image for display, key data coding means for coding key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in a vicinity of the caption; and combining means for combining the coded caption data and the coded key data with video image data that represents the video image, to generate a combined image signal. ### Claim 37 (depends on 36) The caption coding system according to claim 36, wherein the caption data coding means and the key data coding means includes quantizing means for quantizing the caption data and the key data. ### Claim 38 (depends on 36) The caption coding system according to claim 36, wherein the caption data coding means and the key data coding means expresses each of the caption data and the key data by a predetermined number of bits and selectively codes one of the caption data and the key data, but not both, into a predetermined portion of the combined image signal. ### Claim 39 (depends on 36) The caption coding system according to claim 36, wherein the coding means codes the caption data in a squeeze mode when the video image is coded in the squeeze mode. ### Claim 40 (depends on 36) The caption coding system according to claim 36, and further comprising: image coding means for compressively coding the video image according to an amount of code generated for the caption data and key data. ### Claim 41 (depends on 36) The caption coding system according to claim 36, wherein the caption data coding means codes brightness data of the caption as at least a portion of the caption data, and calculates a difference of color difference data of the caption for a predetermined field or frame of the video image, and codes the difference. ### Claim 42 (depends on 36) The caption coding system according to claim 36, wherein the caption data coding means codes brightness data of the caption as the caption data, and the coding means includes combining means for combining color difference data of the caption with the coded brightness data of the caption as a chroma vector corresponding to a predetermined offset value and a coordinate position, of the video image, of a change point of the color difference data of the caption. ### Claim 43 (depends on 42) The caption coding system according to claim 42, wherein the combining means also combines an offset value of the brightness data of the caption with the coded brightness data of the caption. ### Claim 44 (depends on 36) The caption coding system according to claim 36, wherein the coding means includes combining means for combining position data representing a position of the video image at which the caption is to be displayed, with the coded caption data and the coded key data. ### Claim 45 (depends on 36) The caption coding system according to claim 36, wherein the coding means includes combining means for combining a page end word representing the page end of the caption for each page of the caption. ### Claim 46 (depends on 36) The caption coding system according to claim 36, wherein the coding means includes combining means for adding a code for error detection for each page of the caption. ### Claim 47 (depends on 36) The caption coding system according to claim 36, wherein the caption data coding means codes the caption data and the key data coding means codes the key data using at least one of DPCM, run length coding, or variable-length coding. ### Claim 48 A caption decoding system for decoding a coded caption, comprising: caption generation means for generating a signal representing a caption based on the coded caption data of coded data; and video image control means for attenuating the video image on which the caption is to be superimposed, at one of a maximum rate, a minimum rate, and one or more intermediate rates between the maximum rate and the minimum rate, based on coded key data of the coded data. ### Claim 49 (depends on 48) The caption decoding system according to claim 48, and further comprising: inverse quantizing means for inverse-quantizing the coded caption data. ### Claim 50 (depends on 48) The caption decoding system according to claim 48, and further comprising: separation means for separating a coded video image signal from the coded data; and decoding means for decoding the coded video image signal to generate the video image. ### Claim 51 (depends on 48) The caption decoding system according to claim 48, wherein the caption generation means decodes coded brightness data, and adds a coded color difference data for a predetermined field or frame to decode the color difference data, to thereby generate the caption. ### Claim 52 (depends on 48) The caption decoding system according to claim 48, wherein the caption generation means decodes coded brightness data, and decodes coded color difference data based on an offset value of a predetermined color difference data and a chroma vector corresponding to a coordinate position, of the video image, of a change point of the color difference data, thereby generating the caption. ### Claim 53 (depends on 52) The caption decoding system according to claim 52, wherein the caption generation means adds the offset value of the brightness data of the transmitted coded data to the decoded brightness data based on the chroma vector. ### Claim 54 (depends on 48) The caption decoding system according to claim 48, and further comprising: control means for controlling a display position of the caption based on position data of the coded data. ### Claim 55 (depends on 48) The caption decoding system according to claim 48, and further comprising: memory means for storing the coded caption data and the coded key data, wherein the caption generation means reads and decodes the coded caption data and the coded key data stored in the memory. ### Claim 56 (depends on 55) The caption decoding system according to claim 55, and further comprising: memory control means for switching banks of the memory means based on a page end word representing the page end of a caption of the transmitted coded data. ### Claim 57 (depends on 48) The caption decoding system according to claim 48, and further comprising: error detection means for performing error detection using a code for error detection provided for each page of the caption and, when an error is detected, stopping the decoding of the coded data in a page of the caption which contains the detected error. ### Claim 58 (depends on 48) The caption decoding system according to claim 48, wherein the caption generation means decodes the caption data and key data using at least one of variable-length decoding, run length decoding, or IDPCM. ### Claim 59 (depends on 54) The caption decoding system according to claim 54, and further comprising: control means for changing a display position of the caption to a position different from a position indicated by the position data. ### Claim 60 A data transmission system for transmitting data associated with a caption to be superimposed on a video image for display, comprising: means for generating key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in a vicinity of the caption when the caption is superimposed on the video image; and transmission means for transmitting the key data as at least a portion of a transmission signal. ### Claim 61 (depends on 60) The data transmission system according to claim 60, wherein the transmission means quantizes the key data, and transmits the quantized key data as predetermined portions of the transmission signal. ### Claim 62 A video image control system for superimposing a caption on a video image for display, comprising: means for receiving a coded key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in a vicinity of the caption when the caption is superimposed on the video image; decoding means for decoding the coded key data; and attenuating means for attenuating the video image based on the decoded key data. ### Claim 63 A video image control system for superimposing a caption on a video image for display, comprising: means for receiving a coded key data representing an attenuation rate of the video image in a vicinity of the caption when the caption is superimposed on the video image; decoding means for decoding the coded key data; and attenuating means for attenuating the video image based on the decoded key data wherein the attenuating means makes the attenuation rate of said video image minimum when the decoded key data is minimum data, makes the attenuation rate of the video image maximum when the key data is maximum data and, makes the attenuation rate of the video image correspond to the magnitude of the value, when the key data is a value between the minimum and the maximum. ### Claim 64 A recording medium having a video image signal recorded thereon for controlling a display apparatus to display the video image signal, the recording medium being created by: coding a video image; coding caption data representing a caption to be superimposed on the video image for display; coding key data representing one of a maximum attenuation rate, a minimum attenuation rate, and one or more intermediate attenuation rates between the maximum attenuation rate and the minimum attenuation rate, of the video image in a vicinity of the caption when the caption is superimposed on the video image by the display apparatus; and recording the coded video image, caption data, and key data onto the recording medium. ### Claim 65 A caption coding method for coding a caption, represented by caption data, to be superimposed on a video image for display, comprising: coding the caption data representing the caption to be superimposed on the video image for display; coding key data to have a value corresponding to an attenuation rate of portions of the video image in a vicinity of the caption; combining the caption data and the key data with video image data that represents the video image, to generate a combined image signal wherein, in the caption data coding step and the key data coding step, each of the caption data and the key data are expressed by a predetermined number of bits and one of the caption data and the key data, but not both, is selectively coded into a predetermined portion of the combined image signal. ### Claim 66 A caption coding method for coding a caption, represented by caption data, to be superimposed on a video image for display, comprising: coding the caption data representing the caption to be superimposed on the video image for display, including combining color difference data of the caption with an offset value corresponding to the coordinate position, of the video image, of a change point of the color difference data, to determine a chroma vector, and coding the chroma vector into the caption data; coding key data to have a value corresponding to an attenuation rate of portions of the video image in a vicinity of the caption; and combining the caption data and the key data with video image data that represents the video image, to generate a combined image signal. ### Claim 67 (depends on 66) The caption coding method of claim 66, and further comprising: multiplexing the offset value of the brightness data of the caption into the combined image signal. ### Claim 68 A caption decoding method for decoding transmitted coded data, comprising: generating a signal representing a caption, based on a coded caption data portion of the transmitted coded data, to be superimposed onto a video image, including decoding coded brightness data, and decoding coded color difference data based on an offset value of a predetermined color difference data and a chroma vector corresponding to a coordinate position, of the video image, of a change point of the color difference data of the caption, to thereby generate a color difference of the caption; and attenuating the video image in a vicinity of the caption at one of a maximum rate, a minimum rate, and one or more intermediate rates, based on a coded key data portion of the transmitted coded data. ### Claim 69 (depends on 68) The caption decoding method according to claim 68, and further comprising: adding an offset value of the brightness data of the transmitted coded data to the decoded brightness data based on the chroma vector. ### Claim 70 A caption coding system for coding a caption to be superimposed on a video image for display, comprising: caption data coding means for coding caption data representing a caption to be superimposed on a video image for display, key data coding means for coding key data representing an attenuation rate of portions of the video image in a vicinity of the caption; and combining means for combining the coded caption data and the coded key data with video image data that represents the video image, to generate a combined image signal, wherein the caption data coding means and the key data coding means selectively expresses each of the caption data and the key data by a predetermined number of bits and codes one of the caption data and the key data, but not both, into a predetermined portion of the combined image signal. ### Claim 71 A caption coding system for coding a caption to be superimposed on a video image for display, comprising: caption data coding means for coding caption data representing a caption to be superimposed on a video image for display, key data coding means for coding key data representing an attenuation rate of portions of the video image in a vicinity of the caption; and combining means for combining the coded caption data and the coded key data with video image data that represents the video image, to generate a combined image signal, wherein the caption data coding means codes brightness data of the caption as the caption data, and the coding means includes combining means for combining color difference data of the caption with the coded brightness data of the caption as a chroma vector corresponding to a predetermined offset value and a coordinate position, of the video image, of a change point of the color difference data of the caption. ### Claim 72 (depends on 71) The caption coding system according to claim 71, wherein the combining means also combines an offset value of the brightness data of the caption with the coded brightness data of the caption. ### Claim 73 A caption decoding system for decoding a coded caption, comprising: caption generation means for generating a signal representing a caption based on the coded caption data of coded data; and video image control means for attenuating the video image on which the caption is to be superimposed, at one of a maximum rate, a minimum rate, and one or more intermediate rates between the maximum rate and the minimum rate, based on coded key data of the coded data, wherein the caption generation means decodes coded brightness data, and decodes coded color difference data based on an offset value of a predetermined color difference data and a chroma vector corresponding to a coordinate position, of the video image, of a change point of the color difference data, thereby generating the caption. ### Claim 74 (depends on 73) The caption decoding system according to claim 73, wherein the caption generation means adds the offset value of the brightness data of the transmitted coded data to the decoded brightness data based on the chroma vector.