# US 12,762,167 B1 · Buffering AI responses for reoccurring queries > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,762,167 B1 - Document ID: US12762167B1 - Status: Granted - Kind: B1 - Application number: 19/321,103 - Filed: 2025-09-05 - Granted: 2026-10-13 - Earliest claimed: 2025-07-31 - Assignees: Vast Data Ltd. - Applicants: Vast Data Ltd. - Inventors: Nery Strasman; Asaf Levy - Web page: https://patentgrep.com/patent/US12762167B1 ## CPC - G06F 16/3349: Reuse of stored results of previous queries - G06F 40/30: Semantic analysis - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract The present disclosure provides a method for independent response to a query aimed at an artificial intelligence (AI) entity. The method comprises querying, by a computerized unit, the AI entity with a computerized unit query that is identical to a reoccurring query that received AI entity responses that change over time from the AI entity. The method further comprises receiving, by the computerized unit, an AI entity response to the computerized unit query, and buffering the AI entity response in a buffer of the computerized unit and associating timing information with the buffered AI entity response. The method includes receiving, following the buffering, the reoccurring query from a user, and responding to the reoccurring query. ## Claims ### Claim 1 A method for independent response to a query aimed at an artificial intelligence (AI) entity, the method comprising: querying, by a computerized unit, the AI entity with a computerized unit query that is identical to a reoccurring query that received AI entity responses that change over time from the AI entity; receiving, by the computerized unit, an AI entity response to the computerized unit query; buffering the AI entity response in a buffer of the computerized unit and associating timing information with the buffered AI entity response; receiving, following the buffering, the reoccurring query from a user; and responding to the reoccurring query, wherein the responding comprises: providing the buffered AI entity response and an indication regarding the timing information; when receiving from the user, following the provision of the buffered AI entity response, a request to send the reoccurring query to the AI entity then sending an AI entity response generated after the providing of the buffered entity response, to the reoccurring query to the user, and replacing the buffered AI entity response with the AI entity response to the reoccurring query to the user. ### Claim 2 (depends on 1) The method according to claim 1, comprising avoiding caching the AI response. ### Claim 3 (depends on 1) The method according to claim 1, wherein the buffered AI response is an only instance of the AI response within the computerized unit. ### Claim 4 (depends on 1) The method according to claim 1, wherein the buffer is solely dedicated for (i) buffering responses of reoccurring queries that receive AI entity responses that change over time from the AI entity, and (ii) providing buffered responses and related timing information to users. ### Claim 5 (depends on 1) The method according to claim 1, wherein the timing information is indicative of a timing of buffering the buffered AI response. ### Claim 6 (depends on 1) The method according to claim 1, comprising determining, by the computerized unit that a query received by the computerized unit reoccurs and receives AI entity responses that change over time from the AI entity. ### Claim 7 (depends on 1) The method according to claim 1, wherein the AI entity is a large language model (LLM) entity. ### Claim 8 (depends on 1) The method according to claim 1 wherein the responding comprises sending the reoccurring query to the AI entity after receiving the reoccurring query from the user without waiting to receive from the user the request to send the reoccurring query to the AI entity. ### Claim 9 (depends on 1) The method according to claim 1 wherein the responding comprises sending the reoccurring query to the AI entity after receiving the reoccurring query from the user after receiving from the user the request to send the reoccurring query to the AI entity. ### Claim 10 A non-transitory computer-readable medium for independent response to a query aimed at an artificial intelligence (AI) entity, the non-transitory computer-readable medium storing instructions that, when executed by a computerized unit, cause the computerized unit to: query the AI entity with a computerized unit query that is identical to a reoccurring query that received AI entity responses that change over time from the AI entity; receive an AI entity response to the computerized unit query; buffer the AI entity response in a buffer of the computerized unit and associating timing information with the buffered AI entity response; receive, following the buffering, the reoccurring query from a user; and respond to the reoccurring query, wherein the respond comprises: providing the buffered AI entity response and an indication regarding the timing information; when receiving from the user, following the provision of the buffered AI entity response, a request to send the reoccurring query to the AI entity then sending an AI entity response generated after the providing of the buffered entity response, to the reoccurring query to the user, and replacing the buffered AI entity response with the AI entity response to the reoccurring query to the user. ### Claim 11 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the method comprises avoiding caching the AI response. ### Claim 12 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the buffered AI response is an only instance of the AI response within the computerized unit. ### Claim 13 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the buffer is solely dedicated for (i) buffering responses of reoccurring queries that receive AI entity responses that change over time from the AI entity, and (ii) providing buffered responses and related timing information to users. ### Claim 14 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the timing information is indicative of a timing of buffering the buffered AI response. ### Claim 15 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the method comprises determining, by the computerized unit that a query received by the computerized unit reoccurs and receives AI entity responses that change over time from the AI entity. ### Claim 16 (depends on 10) The non-transitory computer-readable medium according to claim 10, wherein the AI entity is a large language model (LLM) entity. ### Claim 17 A computerized unit for independent response to a query aimed at an artificial intelligence (AI) entity, the computerized unit comprising: a controller; and a memory storing instructions that, when executed by the controller, cause the computerized unit to: query the AI entity with a computerized unit query that is identical to a reoccurring query that received AI entity responses that change over time from the AI entity; receive an AI entity response to the computerized unit query; buffer the AI entity response in a buffer of the computerized unit and associating timing information with the buffered AI entity response; receive, following the buffering, the reoccurring query from a user; and respond to the reoccurring query, wherein the respond comprises: providing the buffered AI entity response and an indication regarding the timing information; when receiving from the user, following the provision of the buffered AI entity response, a request to send the reoccurring query to the AI entity then sending an AI entity response generated after the providing of the buffered entity response, to the reoccurring query to the user, and replacing the buffered AI entity response with the AI entity response to the reoccurring query to the user. ### Claim 18 (depends on 17) The computerized unit according to claim 17, wherein the instructions cause the controller to avoid caching the AI response. ### Claim 19 (depends on 17) The computerized unit according to claim 17, wherein the responding comprises sending the reoccurring query to the AI entity after receiving the reoccurring query from the user without waiting to receive from the user the request to send the reoccurring query to the AI entity. ### Claim 20 (depends on 17) The computerized unit according to claim 17, wherein the responding comprises sending the reoccurring query to the AI entity after receiving the reoccurring query from the user after receiving from the user the request to send the reoccurring query to the AI entity.