Fast attention mechanisms for physical systems
OwnerOliver Thorsten Unke, Jan Thorben Frankinventors
Life of this patent
Estimating the term…
Loading patent…
OwnerOliver Thorsten Unke, Jan Thorben Frankinventors
Estimating the term…
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a prediction characterizing a physical system. In one aspect, a method comprises: generating, for each of the plurality of objects in the physical system, a feature embedding for the object; generating, for each of the plurality of objects, a spatial encoding for the object representing the spatial location of the object, wherein: the spatial encoding for each object comprises a representation of a complex number characterizing a spatial relationship between the position vector for the object and a shared reference vector; and generating an embedding of the physical system by combining, for each of the plurality of objects, the feature embedding for the object with the spatial encoding for the object; and processing the embedding of the physical system to generate a prediction characterizing the physical system.
A method performed by one or more computers, comprising:
A system comprising:
One or more non-transitory computer storage media storing instructions that when executed by one or more computers cause the one or more computers to perform operations comprising:
Dependencies are inferred from the claim text.