ONNX is an open-source machine learning framework, offering interoperability across various platforms. It collaborates with ONNX Runtime, the runtime engine for model inference and training. AWS Graviton3 processors are specifically tailored for machine learning tasks and support a series of instructions to optimize performance. The ONNX Runtime 1.17.0 release integrates some of these instructions, improving…
Artificial intelligence (AI) startup ThirdAI has examined the potential for AWS Graviton3 processors to boost the speed of neural network training on its unique CPU-based deep learning engine. The company developed BOLT, a sparse deep learning engine designed to train and deploy models on standard CPU hardware rather than costly GPUs.
The company tested the…