A Rough Estimation Between Jetson AGX Orin Power Mode and AI Performance

Major Reference

• Jetson Modules [Link]

• Jetson Orin Power Mode [Link]

• Jetson Dev Kit AI (64GB AGX Orin) Performance [Link]

• AI Performance Study by HAL [Link]

Jetson AGX Orin Industrial

The following rough estimate assumes that CPU performance won't be the bottleneck for AI inference.

• The AI performance has a linear correlation with the frequency of either the GPU or DLA.

• JAOi MAXN Mode: 248 TOPS (2* 52.5 + 143)

  • JAOi has two DLA, each DLA contributes 52.5 TOPS

  • The GPU of JAOi contributes 143 TOPS

• JAOi 35W Mode: 176.8 TOPS (2* 51.5 + 73.8)

  • JAOi has two DLA, each DLA contributes 51.5 TOPS (52.5 * 1382.4/1408)

  • The GPU of JAOi contributes 73.8 TOPS (143 * 612/ 1185.75)

---

But the above estimataion is different from the number disclosed by NVIDIA [ref]