性能测试
测试硬件信息
板卡型号 |
CPU 频率 (GHz) |
NPU 频率 (GHz) |
DDR传输速率 （MT/s） |
DDR4内存容量 （G） |
|---|---|---|---|---|
FT78E_DSKC_202311V0 |
1.6 |
1 |
2666 |
8 |
模型详情
index |
model_name |
model_size |
framework |
input |
sum_macc |
sum_param |
layers_number |
|---|---|---|---|---|---|---|---|
1 |
mobilenet_v2_tflite |
13.98 MB |
tflite |
1x3x224x224 |
307.1M |
3.31M |
101 |
2 |
mobilenet_v2_pb |
7.93 MB |
tensorflow |
1x3x224x224 |
19.52M |
1.86M |
101 |
3 |
mobilenet_v2_caffe |
14.19 MB |
caffe |
1x3x224x224 |
437.64M |
3.31M |
102 |
4 |
shufflenet_v2_x0.5 |
5.53 MB |
caffe |
1x3x224x224 |
41.57M |
1.29M |
126 |
5 |
squeezenet_v1.1_pth |
6.12 MB |
pytorch |
1x3x224x224 |
351.74M |
1.17M |
56 |
6 |
efficientnet_b0 |
21.2 MB |
onnx |
1x3x224x224 |
395.3M |
5.34M |
193 |
7 |
shufflenet_v1_pth |
7.61 MB |
onnx |
1x3x224x224 |
141.36M |
1.72M |
117 |
8 |
resnet50 |
102.46 MB |
caffe |
1x3x224x224 |
3.87G |
26.37M |
120 |
9 |
resnet18 |
46.93 MB |
pytorch |
1x3x224x224 |
1.82G |
10.9M |
48 |
10 |
pva_faster_rcnn_original |
37.12 MB |
caffe |
1x3x256x320 |
404.59M |
51.42M |
146 |
11 |
alexnet |
243.86 MB |
caffe |
1x3x227x227 |
704.74M |
36.47M |
19 |
12 |
bvlc_googlenet |
28.02 MB |
onnx |
1x3x224x224 |
1.59G |
6.69M |
132 |
13 |
inception_v3 |
95.61 MB |
tensorflow |
1x3x229x229 |
5.72G |
24.74M |
207 |
14 |
inception_v4 |
171.05 MB |
caffe |
1x3x229x229 |
12.27G |
41.43M |
319 |
15 |
resnet101 |
178.09 MB |
tensorflow |
1x3x224x224 |
7.21G |
42.38M |
237 |
16 |
vgg16 |
553.43 MB |
caffe |
1x3x224x224 |
15.41G |
58.28M |
35 |
17 |
mobilenet_ssd |
23.15 MB |
caffe |
1x3x300x300 |
1.16G |
5.5M |
93 |
18 |
prototypical_network |
438.0 KB |
pytorch |
1x1x28x28 |
9.88M |
108.56K |
16 |
19 |
u2netp |
6.1 MB |
pytorch |
1x3x320x320 |
19.88G |
1.07M |
386 |
20 |
openpose |
15.9 MB |
pytorch |
1x3x256x424 |
7.15G |
3.88M |
126 |
21 |
yolo_v2 |
269.87 MB |
caffe |
1x3x416x416 |
17.52G |
64.3M |
49 |
22 |
yolov3 |
248.01 MB |
darknet |
1x3x416x416 |
32.98G |
59.03M |
172 |
23 |
yolov4-tiny |
24.25 MB |
darknet |
1x3x416x416 |
3.46G |
5.77M |
45 |
24 |
yolov4_416 |
257.72 MB |
darknet |
1x3x416x416 |
30.07G |
61.32M |
245 |
25 |
yolov5s_640 |
29.3 MB |
pytorch |
1x3x640x640 |
8.25G |
6.88M |
255 |
26 |
yolov7_640 |
147.7 MB |
pytorch |
1x3x640x640 |
52.34G |
35.17M |
304 |
27 |
yolov7_w6 |
281.6 MB |
pytorch |
1x3x1280x1280 |
45.02G |
67.1M |
346 |
28 |
yolov7-tiny-640 |
23.7 MB |
pytorch |
1x3x640x640 |
6.87G |
61.87M |
140 |
29 |
yolov7_tiny_d_640 |
25.0 MB |
darknet |
1x3x640x640 |
6.87G |
59.98M |
98 |
30 |
yolov8s |
44.8 MB |
pytorch |
1x3x640x640 |
4.34G |
10.63M |
237 |
31 |
yolov8n_640 |
12.0 MB |
pytorch |
1x3x640x640 |
4.39G |
3.0M |
235 |
32 |
yolox_s |
35.9MB |
pytorch |
1x3x416x416 |
5.65G |
8.53M |
272 |
33 |
superpoint |
5.2MB |
tensorflow |
1x1x416x416 |
14.71G |
1.24M |
30 |
34 |
swin-T |
112.6MB |
pytorch |
1x3x224x224 |
4.51G |
4.04G |
897 |
模型测试结果
index |
model_name |
model_type |
nbg_size |
avg(ms) |
best(ms) |
Time_1 |
Time_2 |
Time_3 |
|---|---|---|---|---|---|---|---|---|
1 |
mobilenet_v2_tflite |
uint8 |
3.43 MB |
2.04 |
2.01 |
2.07 |
2.04 |
2.01 |
mobilenet_v2_tflite |
int8 |
3.55 MB |
6.74 |
6.67 |
6.67 |
6.7 |
6.84 |
|
mobilenet_v2_tflite |
int16 |
7.03 MB |
10.71 |
10.61 |
10.61 |
10.64 |
10.89 |
|
mobilenet_v2_tflite |
float |
8.34 MB |
142.59 |
142.54 |
142.58 |
142.64 |
142.54 |
|
2 |
mobilenet_v2_pb |
uint8 |
14.11 MB |
1.07 |
1.05 |
1.05 |
1.08 |
1.07 |
mobilenet_v2_pb |
int8 |
9.89 MB |
1 |
0.98 |
1.02 |
0.98 |
0.99 |
|
mobilenet_v2_pb |
int16 |
19.46 MB |
1.97 |
1.95 |
1.95 |
2 |
1.97 |
|
mobilenet_v2_pb |
float |
5.26 MB |
16.7 |
16.68 |
16.68 |
16.7 |
16.73 |
|
3 |
mobilenet_v2_caffe |
uint8 |
3.4 MB |
2.26 |
2.22 |
2.26 |
2.28 |
2.22 |
mobilenet_v2_caffe |
int8 |
2.97 MB |
2.1 |
2.09 |
2.1 |
2.11 |
2.09 |
|
mobilenet_v2_caffe |
int16 |
6.72 MB |
9.78 |
9.77 |
9.77 |
9.79 |
9.79 |
|
mobilenet_v2_caffe |
float |
8.34 MB |
196.43 |
196.21 |
196.74 |
196.21 |
196.34 |
|
4 |
shufflenet_v2_x0.5 |
uint8 |
1.63 MB |
1.1 |
1.1 |
1.11 |
1.1 |
1.1 |
shufflenet_v2_x0.5 |
int8 |
1.34 MB |
1.05 |
1.05 |
1.06 |
1.05 |
1.05 |
|
shufflenet_v2_x0.5 |
int16 |
2.71 MB |
2.28 |
2.27 |
2.27 |
2.27 |
2.29 |
|
shufflenet_v2_x0.5 |
float |
3.53 MB |
23.03 |
23.01 |
23.04 |
23.05 |
23.01 |
|
5 |
shufflenet_v1_pth |
uint8 |
1.13 MB |
4.17 |
4.15 |
4.18 |
4.18 |
4.15 |
shufflenet_v1_pth |
int8 |
1.14 MB |
3.56 |
3.56 |
3.57 |
3.57 |
3.56 |
|
shufflenet_v1_pth |
int16 |
2.25 MB |
8.09 |
8.06 |
8.11 |
8.12 |
8.06 |
|
shufflenet_v1_pth |
float |
2.78 MB |
176.81 |
176.71 |
176.71 |
176.87 |
176.83 |
|
6 |
efficientnet-b0 |
uint8 |
5.7 MB |
11.64 |
11.53 |
11.66 |
11.73 |
11.53 |
efficientnet-b0 |
int8 |
9.08 MB |
9.82 |
9.71 |
9.82 |
9.92 |
9.71 |
|
efficientnet-b0 |
int16 |
13.16 MB |
18.65 |
18.65 |
18.65 |
18.65 |
18.65 |
|
efficientnet-b0 |
float |
15.13 MB |
330.5 |
330.47 |
330.55 |
330.49 |
330.47 |
|
7 |
squeezenet_v1.1_pth |
uint8 |
1.73 MB |
1.17 |
1.15 |
1.18 |
1.18 |
1.15 |
squeezenet_v1.1_pth |
int8 |
1.65 MB |
1.16 |
1.16 |
1.16 |
1.16 |
1.17 |
|
squeezenet_v1.1_pth |
int16 |
3.72 MB |
2.12 |
2.1 |
2.11 |
2.14 |
2.1 |
|
squeezenet_v1.1_pth |
float |
8.28 MB |
141.8 |
141.32 |
142.04 |
142.04 |
141.32 |
|
8 |
resnet50 |
uint8 |
16.93 MB |
10.26 |
10.23 |
10.23 |
10.25 |
10.29 |
resnet50 |
int8 |
15.08 MB |
9.39 |
9.37 |
9.4 |
9.37 |
9.39 |
|
resnet50 |
int16 |
40.79 MB |
31.13 |
30.97 |
30.97 |
31.36 |
31.05 |
|
resnet50 |
float |
53.11 MB |
1100.26 |
1098.59 |
1098.59 |
1100.48 |
1101.72 |
|
9 |
resnet18 |
uint8 |
8.34 MB |
4.48 |
4.47 |
4.49 |
4.47 |
4.49 |
resnet18 |
int8 |
6.99 MB |
2.85 |
2.82 |
2.82 |
2.84 |
2.9 |
|
resnet18 |
int16 |
18.85 MB |
7.52 |
7.45 |
7.6 |
7.52 |
7.45 |
|
resnet18 |
float |
23.97 MB |
489.2 |
487.04 |
489.45 |
491.1 |
487.04 |
|
10 |
pva_faster_rcnn_original |
uint8 |
6.55 MB |
5.37 |
5.34 |
5.36 |
5.34 |
5.41 |
pva_faster_rcnn_original |
int8 |
6.2 MB |
5.1 |
5.08 |
5.08 |
5.14 |
5.1 |
|
pva_faster_rcnn_original |
int16 |
15.45 MB |
10 |
9.95 |
10.06 |
9.98 |
9.95 |
|
pva_faster_rcnn_original |
float |
19.45 MB |
332.84 |
332.6 |
333.25 |
332.6 |
332.67 |
|
11 |
alexnet |
uint8 |
56.57 MB |
5 |
4.98 |
5.03 |
4.98 |
4.99 |
alexnet |
int8 |
46.06 MB |
4.01 |
3.96 |
4 |
3.96 |
4.08 |
|
alexnet |
int16 |
108.82 MB |
10.55 |
10.53 |
10.54 |
10.53 |
10.58 |
|
alexnet |
float |
151.87 MB |
296.36 |
292.45 |
292.45 |
297.58 |
299.05 |
|
12 |
bvlc_googlenet |
uint8 |
5.8 MB |
4.25 |
4.24 |
4.24 |
4.27 |
4.24 |
bvlc_googlenet |
int8 |
5.16 MB |
4.1 |
4.08 |
4.1 |
4.08 |
4.13 |
|
bvlc_googlenet |
int16 |
11.96 MB |
8.91 |
8.84 |
8.84 |
8.84 |
9.06 |
|
bvlc_googlenet |
float |
15.38 MB |
478.83 |
478.38 |
479.53 |
478.58 |
478.38 |
|
13 |
inception_v3 |
uint8 |
25.01 MB |
12.77 |
12.76 |
12.76 |
12.78 |
12.76 |
inception_v3 |
int8 |
22.05 MB |
12.03 |
12.01 |
12.02 |
12.06 |
12.01 |
|
inception_v3 |
int16 |
53.39 MB |
35.88 |
35.67 |
36.22 |
35.67 |
35.77 |
|
inception_v3 |
float |
50.24 MB |
1785.26 |
1779.88 |
1779.88 |
1791.08 |
1784.84 |
|
14 |
inception_v4 |
uint8 |
44.54 MB |
24.81 |
24.79 |
24.8 |
24.83 |
24.79 |
inception_v4 |
int8 |
39.59 MB |
23.33 |
23.3 |
23.34 |
23.34 |
23.3 |
|
inception_v4 |
int16 |
94.52 MB |
75.98 |
75.74 |
75.84 |
76.35 |
75.74 |
|
inception_v4 |
float |
88.06 MB |
3449.72 |
3433.61 |
3433.61 |
3462.09 |
3453.47 |
|
15 |
resnet101 |
uint8 |
30.84 MB |
13.52 |
13.42 |
13.7 |
13.43 |
13.42 |
resnet101 |
int8 |
27.29 MB |
13.03 |
12.96 |
12.96 |
13.06 |
13.07 |
|
resnet101 |
int16 |
72.13 MB |
42.18 |
42.12 |
42.18 |
42.12 |
42.24 |
|
resnet101 |
float |
91.62 MB |
1979.12 |
1978.77 |
1979.2 |
1979.4 |
1978.77 |
|
16 |
vgg16 |
uint8 |
107.89 MB |
12.01 |
11.86 |
11.86 |
12.26 |
11.93 |
vgg16 |
int8 |
102.45 MB |
9.89 |
9.86 |
9.95 |
9.88 |
9.86 |
|
vgg16 |
int16 |
246.7 MB |
36.99 |
36.83 |
37.1 |
36.83 |
37.03 |
|
vgg16 |
float |
332.82 MB |
4036.01 |
4019.07 |
4042.73 |
4046.23 |
4019.07 |
|
17 |
mobilenet_ssd |
uint8 |
4.37 MB |
3.6 |
3.6 |
3.6 |
3.6 |
3.6 |
mobilenet_ssd |
int8 |
4.07 MB |
3.61 |
3.6 |
3.61 |
3.61 |
3.6 |
|
mobilenet_ssd |
int16 |
10.01 MB |
16.56 |
16.52 |
16.59 |
16.52 |
16.58 |
|
mobilenet_ssd |
float |
12.07 MB |
386.95 |
385.8 |
388.86 |
385.8 |
386.2 |
|
18 |
prototypical_network |
uint8 |
114.0 KB |
0.05 |
0.05 |
0.05 |
0.05 |
0.05 |
prototypical_network |
int8 |
110.0 KB |
0.05 |
0.05 |
0.06 |
0.05 |
0.05 |
|
prototypical_network |
int16 |
227.0 KB |
0.1 |
0.1 |
0.1 |
0.1 |
0.1 |
|
prototypical_network |
float |
276.0 KB |
2.96 |
2.96 |
2.96 |
2.96 |
2.96 |
|
19 |
u2netp |
uint8 |
3.71 MB |
61.6 |
61.57 |
61.57 |
61.59 |
61.63 |
u2netp |
int8 |
1.27 MB |
141.19 |
140.85 |
141.52 |
140.85 |
141.2 |
|
u2netp |
int16 |
2.45 MB |
227.79 |
227.44 |
227.54 |
227.44 |
228.38 |
|
u2netp |
float |
4.16 MB |
10124.1 |
10122.2 |
10125.3 |
10124.8 |
10122.2 |
|
20 |
openpose |
uint8 |
3.02 MB |
8.27 |
8.22 |
8.22 |
8.26 |
8.32 |
openpose |
int8 |
2.65 MB |
8.11 |
8.06 |
8.15 |
8.06 |
8.1 |
|
openpose |
int16 |
6.09 MB |
70.25 |
70.24 |
70.24 |
70.26 |
70.25 |
|
openpose |
float |
11.4 MB |
2868.76 |
2851.17 |
2886.11 |
2851.17 |
2869.01 |
|
21 |
yolo_v2 |
uint8 |
46.36 MB |
19.65 |
19.6 |
19.68 |
19.6 |
19.66 |
yolo_v2 |
int8 |
42.04 MB |
19.3 |
19.21 |
19.3 |
19.21 |
19.4 |
|
yolo_v2 |
int16 |
110.81 MB |
64.89 |
64.76 |
64.88 |
65.04 |
64.76 |
|
yolo_v2 |
float |
135.15 MB |
4988.01 |
4981.53 |
4995.26 |
4987.25 |
4981.53 |
|
22 |
yolov3 |
uint8 |
42.0 MB |
52.66 |
52.63 |
52.63 |
52.71 |
52.63 |
yolov3 |
int8 |
37.58 MB |
49.34 |
49.31 |
49.31 |
49.37 |
49.34 |
|
yolov3 |
int16 |
102.0 MB |
129.41 |
129.32 |
129.51 |
129.32 |
129.4 |
|
yolov3 |
float |
124.71 MB |
8880.21 |
8868.96 |
8887.41 |
8868.96 |
8884.26 |
|
23 |
yolov4-tiny |
uint8 |
3.99 MB |
13.62 |
13.52 |
13.65 |
13.52 |
13.68 |
yolov4-tiny |
int8 |
3.44 MB |
13.38 |
13 |
13 |
13.64 |
13.52 |
|
yolov4-tiny |
int16 |
9.88 MB |
13.98 |
13.88 |
14.11 |
13.96 |
13.88 |
|
yolov4-tiny |
float |
12.34 MB |
943.66 |
943.16 |
943.16 |
943.72 |
944.12 |
|
24 |
yolov4_416 |
uint8 |
41.05 MB |
80.36 |
80.28 |
80.33 |
80.45 |
80.28 |
yolov4_416 |
int8 |
36.9 MB |
120.37 |
120.22 |
120.52 |
120.38 |
120.22 |
|
yolov4_416 |
int16 |
102.44 MB |
220 |
219.9 |
220.12 |
219.9 |
219.97 |
|
yolov4_416 |
float |
129.9 MB |
8523.89 |
8518.15 |
8520.02 |
8533.5 |
8518.15 |
|
25 |
yolov5s_640 |
uint8 |
7.0 MB |
51.75 |
51.69 |
51.81 |
51.69 |
51.75 |
yolov5s_640 |
int8 |
6.4 MB |
50.6 |
50.53 |
50.62 |
50.53 |
50.65 |
|
yolov5s_640 |
int16 |
19.0 MB |
103 |
102.9 |
102.93 |
103.18 |
102.9 |
|
yolov5s_640 |
float |
15.5 MB |
2737.03 |
2733.34 |
2733.34 |
2734.17 |
2743.57 |
|
26 |
yolov7 |
uint8 |
27.4 MB |
221.31 |
220.37 |
221.83 |
220.37 |
221.74 |
yolov7 |
int8 |
24.1 MB |
300.43 |
299.59 |
300.86 |
299.59 |
300.84 |
|
yolov7 |
int16 |
65.3 MB |
514.31 |
513.8 |
513.8 |
515.15 |
513.99 |
|
yolov7 |
float |
74.8 MB |
16486.1 |
16477.1 |
16482.9 |
16477.1 |
16498.2 |
|
27 |
yolov7-w6 |
uint8 |
51.5 MB |
208.91 |
208.48 |
209.73 |
208.51 |
208.48 |
yolov7-w6 |
int8 |
46.1 MB |
230.74 |
230.38 |
230.71 |
230.38 |
231.15 |
|
yolov7-w6 |
int16 |
114.0 MB |
362.58 |
362.06 |
362.06 |
363.04 |
362.64 |
|
yolov7-w6 |
float |
142.0 MB |
12818.7 |
12817.2 |
12819.1 |
12817.2 |
12819.7 |
|
28 |
yolov7-tiny-640 |
uint8 |
5.92 MB |
39.24 |
39.21 |
39.22 |
39.28 |
39.21 |
yolov7-tiny-640 |
int8 |
5.43 MB |
31.3 |
31.25 |
31.25 |
31.28 |
31.38 |
|
yolov7-tiny-640 |
int16 |
15.2 MB |
103.79 |
103.78 |
103.82 |
103.78 |
103.78 |
|
yolov7-tiny-640 |
float |
15.3 MB |
2234.78 |
2234 |
2234 |
2235.39 |
2234.95 |
|
29 |
yolov7_tiny_d_640 |
uint8 |
4.36 MB |
34.83 |
34.8 |
34.82 |
34.87 |
34.8 |
yolov7_tiny_d_640 |
int8 |
3.9 MB |
26.94 |
26.91 |
26.91 |
26.97 |
26.93 |
|
yolov7_tiny_d_640 |
int16 |
10.3 MB |
98.22 |
98.18 |
98.18 |
98.21 |
98.29 |
|
yolov7_tiny_d_640 |
float |
12.7 MB |
2228.84 |
2223.21 |
2233.52 |
2229.79 |
2223.21 |
|
30 |
yolov8s |
uint8 |
9.2 MB |
54.61 |
54.47 |
54.59 |
54.78 |
54.47 |
yolov8s |
int8 |
8.1 MB |
53.49 |
53.03 |
53.58 |
53.03 |
53.87 |
|
yolov8s |
int16 |
22.6 MB |
111.19 |
111.12 |
111.22 |
111.24 |
111.12 |
|
yolov8s |
float |
25.8 MB |
4105.95 |
4104.29 |
4104.29 |
4106.98 |
4106.6 |
|
31 |
yolov8n_640 |
uint8 |
4.66 MB |
48.34 |
48.28 |
48.33 |
48.28 |
48.41 |
yolov8n_640 |
int8 |
4.3 MB |
33.23 |
33.21 |
33.21 |
33.24 |
33.23 |
|
yolov8n_640 |
int16 |
9.1 MB |
75.55 |
75.34 |
75.49 |
75.8 |
75.34 |
|
yolov8n_640 |
float |
9.5 MB |
1575.63 |
1575.46 |
1575.63 |
1575.82 |
1575.46 |
|
32 |
yolox_s |
uint8 |
7.4 MB |
21.6 |
21.46 |
21.46 |
21.76 |
21.57 |
yolox_s |
int8 |
6.7 MB |
21.17 |
21 |
21 |
21.28 |
21.23 |
|
yolox_s |
int16 |
16.3 MB |
53.53 |
53.38 |
53.81 |
53.38 |
53.41 |
|
yolox_s |
float |
19.5 MB |
1666.07 |
1665.22 |
1667.53 |
1665.22 |
1665.45 |
|
33 |
superpoint |
uint8 |
0.66 MB |
6.46 |
6.45 |
6.46 |
6.46 |
6.45 |
superpoint |
int8 |
0.62 MB |
6.43 |
6.36 |
6.4 |
6.53 |
6.36 |
|
superpoint |
int16 |
3.3 MB |
29.04 |
29.02 |
29.05 |
29.04 |
29.02 |
|
superpoint |
float |
2.9 MB |
6006.2 |
6003.57 |
6003.57 |
6008.61 |
6006.42 |
|
34 |
swin-T |
uint8 |
22.4MB |
290.76 |
290.54 |
291.08 |
290.54 |
290.66 |
swin-T |
int8 |
20.8MB |
286.45 |
286.35 |
286.43 |
286.58 |
286.35 |
|
swin-T |
int16 |
54.1MB |
357.63 |
356.74 |
358.09 |
356.74 |
358.06 |
|
swin-T |
float |
57.9MB |
3534.78 |
3534.75 |
3534.79 |
3534.8 |
3534.75 |
作者 @ogl ougaoliang@hngwg.com