Semiconductor Engineering

ResNet-50 Does Not Predict Inference Throughput For MegaPixel Neural Network Models

Customers are considering applications for AI inference and want to evaluate multiple inference accelerators. As we discussed last month, TOPS do NOT correlate with inference throughput and you should ...
InfoQ

Sony Trains ResNet-50 on ImageNet in 224 Seconds

A monthly overview of things you need to know as an architect or aspiring architect. Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with ...
Semiconductor Engineering

Do Large Batches Always Improve Neural Network Throughput?

Common benchmarks like ResNet-50 generally have much higher throughput with large batch sizes than with batch size =1. For example, the Nvidia Tesla T4 has 4x the throughput at batch=32 than when it ...
insideHPC

Groq AI Chip Benchmarks Leading Performance on ResNet-50 Inference

Today AI chip startup Groq announced that their new processor has achieved 21,700 inferences per second (IPS) for ResNet-50 v2 inference. Groq’s level of inference performance exceeds that of other ...
insideHPC

Intel Xeon Scalable Processors Set Deep Learning Performance Record on ResNet-50

Today Intel announced a deep learning performance record on image classification workloads. Intel was able to achieve 7878 images per second on ResNet-50 with its latest generation of Intel Xeon ...
ZDNet

Google's distributed computing for dummies trains ResNet-50 in under half an hour

Is it better to be as accurate as possible in machine learning, however long it takes, or pretty darned accurate in a really short amount of time? For DeepMind researchers Peter Buchlovsky and ...