Got it

Benchmarking ResNet50 TensorFlow Fails On Huawei Atlas 200 DK

Created: Mar 9, 2021 07:17:02Latest reply: Mar 11, 2021 02:18:46 908 6 1 0 0
  Rewarded HiCoins: 5 (problem resolved)

Hello!

When I try to benchmark my Huawei Atlas 200 DK with the benchmark programm from CANN 20.1 the benchmark fails. 
I got the benchmark from here:
Introduction_Ascend CANN (20.1)_System Tool Guide_Inference Benchmark Tool User Guide_Introduction_HUAWEI CLOUD

I execute the "pure inference scenario" because I wan't to measure the inference time.
When I use the benchmark with YOLO offline models or ResNet50 Caffe offline models it works.

But the benchmark fails when I try TensorFlow ResNet50 offline models from Huawei Modelzoo. 
ATC SSD-ResNet50-FPN (INT8)-Ascend Community (huawei.com)
The download includes two offline models but both do not work. I tried to convert the modell by myself using the ATC but it still doesn't work.

Here is the error message:

Runtime error benchmark tensorflow


Featured Answers

Best answer

Recommended answer

Andy_Meng
Created Mar 11, 2021 02:18:46

Officially only several specified Atlas devices are supported by Benchmark tool, as shown on the official document, except Atlas 200DK unfortunately:
https://support.huaweicloud.com/intl/en-us/ug-bench-cann/atlasbenchmark_02_0004.html

Atlas 300I AI inference card (Model 3000)

Atlas 300I AI inference card (model 3010)

Atlas 800 AI inference server (Model 3000)

Atlas 800 AI inference server (Model 3010)

Atlas 500 AI Edge Station (models 3000, 3010)
View more
  • x
  • convention:

Andy_Meng
Andy_Meng Created Mar 11, 2021 02:57:28 (1) (0)
However, I have to say, to have Benchmark tool support Atlas200DK is absolutely necessary and useful feature since I believe majority developers intend to run this tool on 200dk as an agile and fast environment during the development.  
Daniel_EdgeAI
Daniel_EdgeAI Reply Andy_Meng  Created Mar 15, 2021 07:23:36 (0) (0)
Hello Andy!
Thank you very much for your answer. What a pity that it doesn't work on the Huawei Atlas 200 DK. But however thank you very much for the information.  
All Answers
Hi, we are working on it now.
View more
  • x
  • convention:

tianyuzhou
tianyuzhou Created Mar 10, 2021 16:57:15 (0) (0)
The model itself has no problem. I have tested this model on an Atlas 800 X86 inference server. It seems that the combination of the Atlas 200DK + benchmark tool creates this issue  
Hi,
Kindly wait for a second, we'll get a professional engineer to process your problem.
View more
  • x
  • convention:

Officially only several specified Atlas devices are supported by Benchmark tool, as shown on the official document, except Atlas 200DK unfortunately:
https://support.huaweicloud.com/intl/en-us/ug-bench-cann/atlasbenchmark_02_0004.html

Atlas 300I AI inference card (Model 3000)

Atlas 300I AI inference card (model 3010)

Atlas 800 AI inference server (Model 3000)

Atlas 800 AI inference server (Model 3010)

Atlas 500 AI Edge Station (models 3000, 3010)
View more
  • x
  • convention:

Andy_Meng
Andy_Meng Created Mar 11, 2021 02:57:28 (1) (0)
However, I have to say, to have Benchmark tool support Atlas200DK is absolutely necessary and useful feature since I believe majority developers intend to run this tool on 200dk as an agile and fast environment during the development.  
Daniel_EdgeAI
Daniel_EdgeAI Reply Andy_Meng  Created Mar 15, 2021 07:23:36 (0) (0)
Hello Andy!
Thank you very much for your answer. What a pity that it doesn't work on the Huawei Atlas 200 DK. But however thank you very much for the information.  

Comment

You need to log in to comment to the post Login | Register

Notice: To protect the legitimate rights and interests of you, the community, and third parties, do not release content that may bring legal risks to all parties, including but are not limited to the following:
  • Politically sensitive content
  • Content concerning pornography, gambling, and drug abuse
  • Content that may disclose or infringe upon others ' commercial secrets, intellectual properties, including trade marks, copyrights, and patents, and personal privacy
Do not share your account and password with others. All operations performed using your account will be regarded as your own actions and all consequences arising therefrom will be borne by you. For details, see " User Agreement."

My Followers

Login and enjoy all the member benefits

Login

Block
Are you sure to block this user?
Users on your blacklist cannot comment on your post,cannot mention you, cannot send you private messages.
Reminder
Please bind your phone number to obtain invitation bonus.