AI PCs Aren't Good at AI: The CPU Beats the NPU

GitHub repository 'qc_npu_benchmark' provides a code sample to benchmark models on Qualcomm's Windows PCs, specifically on Microsoft Surface tablets equipped with Qualcomm's NPU. The benchmarking reveals suboptimal NPU performance, achieving only a fraction of the claimed capabilities.

• Surface Pro 11 uses Snapdragon X1E80100.
• NPU throughput was only 1.3% of claim.
• Repo has Apache-2.0 license.
• Posted results are as of Oct 2, 2024.
• 3 GitHub stars, 0 forks.