Intel Contributes AI Acceleration to PyTorch 2.0

Reading time ( words)

​In the release of Python 2.0, contributions from Intel using Intel® Extension for PyTorch , oneAPI Deep Neural Network Library (oneDNN) and additional support for Intel® CPUs enable developers to optimize inference and training performance for artificial intelligence (AI).

As part of the PyTorch 2.0 compilation stack, the TorchInductor CPU backend optimization by Intel Extension for PyTorch and PyTorch ATen CPU achieved up to 1.7 times faster FP32 inference performance when benchmarked with TorchBench, HuggingFace and timm.1 This update brings notable performance improvements to graph compilation over the PyTorch eager mode.

Other optimizations include:

  • Improved message-passing between adjacent neural network nodes to support graph neural network in PyTorch Geometric (PyG) for enhanced inference and performance training on Intel CPUs.
  • New x86 quantization backend – a combination of FBGEMM (Facebook General Matrix-Matrix Multiplication) and oneDNN backends – replaces FBGEMM as the default quantization backend for x86 CPU platforms to enable better end-to-end int8 inference performance.
  • Extended use of oneDNN with oneDNN Graph API to maximize efficient code generation on AI hardware by automatically identifying the graph partitions to be accelerated through fusion. BFloat16 and Float32 data types are supported and only inference workloads can be optimized; BF16 is only optimized on machines with AVX512_BF16 ISA support. 


Suggested Items

AIS, Qualcomm, ZTE Announce the World’s First 5G NR-DC Showcase for 2.6GHz and 26GHz in Thailand

04/01/2022 | Qualcomm Technologies, Inc.
AIS, Qualcomm Technologies, Inc. and ZTE announced the world’s first 5G NR-DC (New Radio Dual Connectivity) showcase in the field with 2.6GHz and 26GHz, achieving 8.5Gbps peak downlink speed and 2.17Gbps peak uplink speed with a single mobile device.

DARPA Tests Advanced Chemical Sensors

05/03/2019 | DARPA
DARPA’s SIGMA program, which began in 2014, has demonstrated a city-scale capability for detecting radiological and nuclear threats that is now being operationally deployed.

Ushering in a New Generation of Low-Cost, Networked, Nuclear-Radiation Detectors

08/30/2016 | DARPA
A DARPA program aimed at preventing attacks involving radiological “dirty bombs” and other nuclear threats has successfully developed and demonstrated a network of smartphone-sized mobile devices that can detect the tiniest traces of radioactive materials.

Copyright © 2023 I-Connect007 | IPC Publishing Group Inc. All rights reserved.