RTX 3090 vs A100 in deep learning.

976 views (last 30 days)
지환 오
지환 오 on 4 May 2022
Commented: Joss Knight on 10 May 2022
I ran ResNet on RTX 3090 and A100
Performance is better in RTX 3090 about 1.2 times than A100
I searched and found out that GPU Coder helps use TensorCore
So, I want to be sure if I use GPU Coder, A100's performance is going to better before I purchasing GPU Coder
Thanks.

Accepted Answer

Joss Knight
Joss Knight on 6 May 2022
According to the spec as documented on Wikipedia, the RTX 3090 has about 2x the maximum speed at single precision than the A100, so I would expect it to be faster. The A100 is much faster in double precision than the GeForce card.
Both will be using Tensor Cores for deep learning in MATLAB.
  4 Comments

Sign in to comment.

More Answers (1)

David Willingham
David Willingham on 4 May 2022
Hi,
What version of MATLAB did you test ResNet out on? I'd recommend running benchmarks on the latest version of MATLAB.
Was it for inference or training?
AS an FYI, you can contact MathWorks and receive a trial of GPU Coder to test out the performance first hand.

Tags

Products

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!