# US 2026/0267807 A1 · Address translation prefetching for input/output devices

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2026/0267807 A1
- Document ID: US20260267807A1
- Status: Published application
- Kind: A1
- Application number: 19/666,726
- Filed: 2026-05-04
- Published: 2026-09-10
- Earliest claimed: 2022-06-09
- Assignees: Microsoft Technology Licensing, LLC
- Applicants: Microsoft Technology Licensing, LLC
- Inventors: Ramakrishna Suresh HUGGAHALLI; Shachar RAINDEL
- Web page: https://patentgrep.com/patent/US20260267807A1

## CPC

- G06F 12/1027: using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
- G06F 12/1063: {the data cache being concurrently virtually addressed}
- G06F 12/0238: {Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory}
- G06F 12/063: {for I/O modules, e.g. memory mapped I/O (I/O protocol G06F13/42)}
- G06F 12/0862: with prefetch
- G06F 12/1054: {the data cache being concurrently physically addressed}
- G06F 12/1072: Decentralised address translation, e.g. in distributed shared memory systems
- G06F 12/1081: for peripheral access to main memory, e.g. direct memory access [DMA]
- G06F 2212/1024: Latency reduction
- G06F 2212/151: Emulated environment, e.g. virtual machine
- G06F 2212/651: Multi-level translation tables
- G06F 2212/654: Look-ahead translation
- G06F 2212/681: Multi-level TLB, e.g. microTLB and main TLB
- G06F 2212/683: Invalidation
- G06F 2212/684: TLB miss handling
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

In one example of the present technology, a method includes sending, by a CPU core of a processor, a direct memory access (DMA) stream setup command to an input/output (I/O) device, the DMA stream setup command comprising a virtual address; and sending, from the CPU core of the processor, a prefetch message comprising the virtual address to an input/output memory management unit (IOMMU) to cause the IOMMU to: prefetch a translation of the virtual address into a corresponding physical address from a main memory; and store the translation of the virtual address into the corresponding physical address in a translation lookaside buffer (TLB) of the IOMMU.

## Claims

### Claim 1

A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to prime a translation lookaside buffer (TLB) of an input/output memory management unit (IOMMU) by:
sending, by a CPU core of the processor, a DMA stream setup command to an input/output (I/O) device, the DMA stream setup command comprising a virtual address; and
sending, from the CPU core of the processor, a prefetch message comprising the virtual address to the IOMMU to cause the IOMMU to:
prefetch a translation of the virtual address into a corresponding physical address from a main memory; and
store the translation of the virtual address into the corresponding physical address in the TLB of the IOMMU.

### Claim 2 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions cause the processor to send the prefetch message to the IOMMU in parallel with sending the DMA stream setup command to the I/O device.

### Claim 3 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the instructions cause the processor to store the translation in a host cache of the processor.

### Claim 4 (depends on 3)

The non-transitory computer-readable medium of claim 3, wherein the translation is stored in the host cache of the processor in response to detecting that the prefetched translation is displaced from the TLB.

### Claim 5 (depends on 3)

The non-transitory computer-readable medium of claim 3, wherein the translation is stored in the host cache of the processor based on one or more attributes associated with the prefetched translation.

### Claim 6 (depends on 1)

The non-transitory computer-readable medium of claim 1, wherein the virtual address comprises a guest virtual address visible to an application running on a guest virtual machine executed by the processor, and
wherein the corresponding physical address comprises a host physical address.

### Claim 7 (depends on 6)

The non-transitory computer-readable medium of claim 6, wherein the translation of the virtual address into the corresponding physical address is computed based on a first translation of the virtual address into a guest physical address associated with the guest virtual machine and a second translation of the guest physical address into the corresponding physical address comprising a host physical address associated with a host machine comprising the processor.

### Claim 8

A method comprising:
sending, by a CPU core of a processor, a direct memory access (DMA) stream setup command to an input/output (I/O) device, the DMA stream setup command comprising a virtual address; and
sending, from the CPU core of the processor, a prefetch message comprising the virtual address to an input/output memory management unit (IOMMU) to cause the IOMMU to:
prefetch a translation of the virtual address into a corresponding physical address from a main memory; and
store the translation of the virtual address into the corresponding physical address in a translation lookaside buffer (TLB) of the IOMMU.

### Claim 9 (depends on 8)

The method of claim 8, wherein the CPU core of the processor sends the prefetch message to the IOMMU in parallel with sending the DMA stream setup command to the I/O device.

### Claim 10 (depends on 8)

The method of claim 8, wherein the translation is stored in a host cache of the processor.

### Claim 11 (depends on 10)

The method of claim 10, wherein the translation is stored in the host cache of the processor in response to detecting that the prefetched translation is displaced from the TLB.

### Claim 12 (depends on 10)

The method of claim 10, wherein the translation is stored in the host cache of the processor based on one or more attributes associated with the prefetched translation.

### Claim 13 (depends on 8)

The method of claim 8, wherein the virtual address comprises a guest virtual address of a guest virtual machine executed by the processor, and
wherein the corresponding physical address comprises a host physical address.

### Claim 14 (depends on 13)

The method of claim 13, wherein the translation of the virtual address into the corresponding physical address is computed based on a first translation of the virtual address into a guest physical address associated with the guest virtual machine and a second translation of the guest physical address into the corresponding physical address comprising a host physical address associated with a host machine comprising the processor.

### Claim 15

A computing device comprising:
a processor comprising:
a central processing unit (CPU) core; and
a system memory management unit (SMMU) comprising a translation lookaside buffer (TLB);
a main memory storing a page table; and
an input/output (I/O) device connected to the processor and the main memory via an interconnect,
the CPU core being configured to:
transmit a direct memory access (DMA) stream setup command to the I/O device, the DMA stream setup command comprising a virtual address; and
transmit a prefetch message comprising the virtual address to the SMMU to cause the SMMU to:
prefetch a translation of the virtual address into a corresponding physical address from a main memory; and
store the translation of the virtual address into the corresponding physical address in the TLB of the SMMU.

### Claim 16 (depends on 15)

The computing device of claim 15, wherein the CPU core of the processor is configured to send the prefetch message to the SMMU in parallel with sending the DMA stream setup command to the I/O device.

### Claim 17 (depends on 15)

The computing device of claim 15, wherein the SMMU is configured to prefetch the translation of the virtual address into the corresponding physical address in response to the prefetch message.

### Claim 18 (depends on 15)

The computing device of claim 15, wherein the processor comprises a host cache, and
wherein the SMMU is further configured to:
store the prefetched translation in the host cache of the computing device.

### Claim 19 (depends on 15)

The computing device of claim 15, wherein the virtual address comprises a guest virtual address of a guest virtual machine executed by the processor, and
wherein the corresponding physical address comprises a host physical address.

### Claim 20 (depends on 19)

The computing device of claim 19, wherein the translation of the virtual address into the corresponding physical address is computed based on a first translation of the virtual address into a guest physical address associated with the guest virtual machine and a second translation of the guest physical address into the corresponding physical address comprising a host physical address associated with a host machine comprising the processor.
