# US 10,321,161 B2 · Signal analysis and generation of transient information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,321,161 B2 - Document ID: US10321161B2 - Status: Granted - Kind: B2 - Application number: 15/296,633 - Filed: 2016-10-18 - Published: 2017-02-09 - Granted: 2019-06-11 - Earliest claimed: 2011-11-23 - Assignees: V-Nova International Limited - Applicants: V-Nova International Limited - Inventors: Luca Rossato; Guido Meardi - Web page: https://patentgrep.com/patent/US10321161B2 ## CPC - H04N 19/80: Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) - H04N 19/51: Motion estimation or motion compensation - H04N 19/85: using pre-processing or post-processing specially adapted for video compression - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A signal processor receives settings information. The settings information specifies a setting of a given element for each image in a sequence of multiple images in which the given element resides. The signal processor also receives precision metadata specifying an estimated precision of each of the settings of the given element for each image in the sequence. Based on the settings information and the precision metadata, the signal processor generates a setting value for the given element. If the setting value produced for the given element is relatively stable, and thus likely a better representation of a setting for the given element than a current setting of the given element, the signal processor utilizes the generated setting value instead of the current setting for encoding purposes. ## Claims ### Claim 1 A method of generating, per each image element m of a multidimensional image signal, a stable value v, based on a stability hypothesis along a dimension T of the image signal, the method comprising: receiving a plane element m of the image signal, the plane element m being one of k plane elements; based at least in part on coordinates of image element m, receiving k−1 additional plane elements of the image signal (with k≥2), the additional k−1 plane elements included in the k image elements, each of the k plane elements characterized by a different coordinate along the dimension T with a stability hypothesis; based at least in part on settings of each of the k image elements, generating the stable value, v, for plane element m; and utilizing the stable setting value, v, over a sequence of multiple images for plane element, m, instead of an original setting of the plane element m, as a basis to encode a setting of the plane element m in multiple images. ### Claim 2 (depends on 1) The method as in claim 1, wherein the k plane elements are located one subsequent to another along the dimension T with the stability hypothesis. ### Claim 3 (depends on 1) The method as in claim 1, wherein a contribution of each of the k plane elements to the stable value, v, depends at least in part on statistical parameters associated with the stable value, the method further comprising: receiving a plane element m+1 of the image signal; based at least in part on the coordinates of element m+1, receiving the k−1 additional plane elements from the image signal, each of the k plane elements characterized by a different coordinate along the dimension T with stability hypothesis; based at least in part on the settings of each of the k elements and on statistical parameters associated to each element, generating a stable value v+1 for plane element m+1. ### Claim 4 (depends on 3) The method as in claim 3, wherein statistical parameters associated to each plane element include information on the precision of each plane element. ### Claim 5 (depends on 3) The method as in claim 3, wherein the k plane elements received and the contribution of each of the k plane elements to the stable value v depend at least in part on settings of element m, the method comprising: receiving a plane element m of the image signal; based at least in part on the coordinates of plane element m and on settings of m, receiving the k−1 additional plane elements from the image signal, each of the k plane elements characterized by a different coordinate along the dimension T with stability hypothesis; based at least in part on the settings of each of the k plane elements and on statistical parameters associated to each plane element, generating a stable value v for plane element m. ### Claim 6 (depends on 3) The method as in claim 3, wherein the stable value associated to each image element m is generated by weighing the settings of each of the k plane elements based on statistical parameters associated to each of the k plane elements. ### Claim 7 (depends on 6) The method as in claim 6, wherein the weights associated to image elements whose settings differ from settings of element m beyond a threshold are set to zero, the threshold depending at least in part on estimated statistical properties of measures of the image signal for image elements with the same coordinate along dimension T as plane element m. ### Claim 8 (depends on 3) The method as in claim 3, wherein each of the k−1 plane elements selected to generate the stable value, v, for plane element m is identified by leveraging suitable motion vectors, the method comprising: receiving a plane element m of the signal; based at least in part on the coordinates of image element m, on settings of m and on a motion vector associated to element m, receiving at least one additional plane element i of the image signal, characterized by a preceding or subsequent coordinate along the dimension T with stability hypothesis; up until k plane elements have been received (with k≥2), based at least in part on coordinates of a last selected plane element, on settings of the last selected plane element and on a motion vector associated to it, receiving at least one additional plane element j of the image signal, characterized by a preceding or subsequent coordinate along the dimension T with stability hypothesis; based at least in part on settings of each of the identified plane elements and on statistical parameters associated to each plane element, generating a stable value v for plane element m. ### Claim 9 (depends on 1) The method as in claim 1, wherein the stable value associated to each plane element m is generated based at least in part on settings contained in a buffer vold associated to the coordinate of plane element m along dimension T, the method comprising: selecting a plane M of the signal for a given coordinate t along dimension T; selecting, within M, a plane element m of the image signal; identifying buffer Vold corresponding to plane M of the image signal; based at least in part on the coordinates of plane element m, selecting an plane element vold in buffer Vold; based at least in part on settings of m, on settings of vold, and on suitable weight parameters associated to settings of m and vold, generating the stable value v for plane element m. ### Claim 10 (depends on 9) The method as in claim 9, wherein the weight parameters depend on statistical parameters such as estimated precisions of m and vold. ### Claim 11 (depends on 8) The method as in claim 8, wherein a weight parameter associated to vold is set to zero whenever settings of m and vold differ beyond a threshold, the threshold depending at least in part on estimated statistical properties of m and vold. ### Claim 12 (depends on 8) The method as in claim 8, wherein a buffer Pold contains a plane of image elements pold, each image element pold of buffer Pold corresponding to an image element vold of buffer Vold, the method comprising: selecting a plane M of the signal for a given coordinate t along dimension T; selecting within M a plane element m of the signal; identifying buffer Vold corresponding to plane M of the signal; based at least in part on the coordinates of plane element m, selecting an image element vold in buffer Vold; identifying buffer Pold corresponding to plane Vold; based at least in part on the coordinates of image element vold, selecting an image element Vold in buffer Pold associated to element vold; based at least in part on settings of m, on settings of vold, and on suitable weight parameters associated to settings of m and vold, generating a stable value v for plane image element m, the weight parameter associated to vold depending at least in part on settings of element pold. ### Claim 13 (depends on 8) The method as in claim 8, wherein the weight parameters associated to settings of m depend at least in part on statistical properties pnew of the plane of differences between signal measures and corresponding generated stable values for a coordinate along dimension T neighboring the coordinate along dimension T of element m. ### Claim 14 (depends on 8) The method as in claim 8, wherein settings of buffer Vold for a given coordinate t along dimension T are generated by adjusting, based at least in part on the contents of an auxiliary map associated with the image signal, the plane of stable settings V generated for the plane M of elements of the image signal with coordinate T=t. ### Claim 15 (depends on 13) The method as in claim 13, wherein settings of buffer Pold for a given coordinate t along dimension T are generated by adjusting, based at least in part on the contents of an auxiliary map associated with the image signal, a plane of settings generated based at least in part on the settings of buffer Pold for a neighboring coordinate (e.g., t−1 or t+1) of coordinate t along dimension T. ### Claim 16 (depends on 13) The method as in claim 13, wherein stable values are generated with a resolution that is different from the resolution of the image signal, the method comprising: selecting a plane M of the signal for a given coordinate t along dimension T; identifying buffer Vnew corresponding to plane M of the image signal, buffer Vnew featuring a resolution (i.e., number of elements along the various coordinates) that is different from the resolution of plane M; generating settings for buffer Vnew based at least in part on settings of plane M; selecting within Vnew a plane element vnew; identifying buffer Vold corresponding to plane M of the image signal, buffer Vold featuring a same resolution as buffer Vnew; based at least in part on the coordinates of element vnew, selecting an element vold in buffer Vold; identifying buffer Pold corresponding to plane Vold, buffer Pold featuring the same resolution as buffer Vnew and Vold; based at least in part on the coordinates of element vold, selecting an element pold in buffer Pold associated to element vold; based at least in part on the settings of vnew, on the settings of vold, and on suitable weight parameters associated to settings of vnew and vold, generating a stable value v corresponding to plane element vnew, the weight parameter associated to vold depending at least in part on settings of element pold. ### Claim 17 (depends on 1) The method as in claim 1, wherein based at least in part on the difference between stable settings v and corresponding settings of elements of the image signal, information on transient component of the signal is generated, the method comprising: selecting a plane M of the signal for a given coordinate t along dimension T; generating for each element m of plane M a stable value v; based at least in part on differences between settings of plane M and their corresponding stable values, generating information TC on transient component of plane M. ### Claim 18 (depends on 17) The method as in claim 17, wherein information TC includes parameters indicating the spectral distribution of differences between settings of plane M and their corresponding stable values. ### Claim 19 (depends on 17) The method as in claim 17, wherein information TC includes reconstruction data to reconstruct a tiered hierarchy of renditions of differences between settings of plane M and their corresponding stable values, according to a method of tiered signal decoding and signal reconstruction. ### Claim 20 (depends on 1) The method as in claim 1, wherein the stable value, v, represents a core setting for the plane element, m, over multiple images in the image signal, the core setting separated from corresponding transient information associated with the plane element m. ### Claim 21 A system comprising: computer processor hardware; computer-readable storage hardware having instructions stored thereon, the instructions, when carried out by the computer processor hardware, cause the computer processor hardware to: receive a plane element m of an image signal, the plane element m being one of k image elements; based at least in part on coordinates of plane element m, receive k−1 additional plane elements of the image signal (with k≥2), the additional k−1 plane elements included in the k plane elements, each of the k plane elements characterized by a different coordinate along the dimension T with a stability hypothesis; based at least in part on settings of each of the k plane elements, generate a stable value v for plane element m; and utilize the stable setting value, v, over a sequence of multiple images for plane element, m, instead of an original setting of the plane element m, as a basis to encode a setting of the plane element m in multiple images. ### Claim 22 Non-transitory computer-readable storage media having instructions stored thereon, the instructions, when carried out by computer processor hardware, cause the computer processor hardware to generate, per each image element m of a multidimensional image signal, a stable value v, based on a stability hypothesis along a dimension T of the image signal by: receive a plane element m of the image signal, the plane element m being one of k plane elements; based at least in part on the coordinates of image element m, receive k−1 additional plane elements of the image signal (with k≥2), the additional k−1 plane elements included in the k plane elements, each of the k plane elements characterized by a different coordinate along the dimension T with a stability hypothesis; based at least in part on the settings of each of the k image elements, generate the stable value v for plane element m; and utilize the stable setting value, v, over a sequence of multiple images for plane element, m, instead of an original setting of the plane element m, as a basis to encode a setting of the plane element m in multiple images.