The bug of auto-tuning [parameters setting]

zzw · April 26, 2019, 3:35pm

Following the Tutorials of Auto-tuning a convolutional network for ARM CPU

I just replace the “resnet18_v1” by “ssd_512_mobilenet1.0_voc”, and then to tune the network for rk3399. However, when run the codes, I got some error in the running:

[details="Summary"]
DEBUG:autotvm:Early stopped. Best iter: 0.
DEBUG:autotvm:XGB load 2176 entries from history log file
DEBUG:autotvm:XGB iter:   0	tr-a-recall@128: 0.034634	tr-map: 1.000000
DEBUG:autotvm:XGB iter:  25	tr-a-recall@128: 0.034634	tr-map: 1.000000
DEBUG:autotvm:XGB iter:  50	tr-a-recall@128: 0.034634	tr-map: 1.000000
DEBUG:autotvm:XGB iter:  75	tr-a-recall@128: 0.034634	tr-map: 1.000000
DEBUG:autotvm:XGB iter: 100	tr-a-recall@128: 0.034634	tr-map: 1.000000
DEBUG:autotvm:XGB stopped. Best iteration: [0] tr-a-recall@128:0.034634	tr-map:1 
DEBUG:autotvm:XGB train: 19.20	obs: 2176
DEBUG:autotvm:SA iter: 50	last_update: 0	max-0: 0.50	max-1: 0.50	temp: 0.90	elapsed: 14.37
DEBUG:autotvm:SA iter: 50	last_update: 0	max-0: 0.50	max-1: 0.50	elapsed: 14.37
DEBUG:autotvm:SA Maximums: [(0.5, 14), (0.5, 61), (0.5, 16), (0.5, 93), (0.5, 65), (0.5, 47), (0.5, 24), (0.5, 216), (0.5, 114), (0.5, 84), (0.5, 212), (0.5, 48), (0.5, 551), (0.5, 241), (0.5, 714), (0.5, 609), (0.5, 219), (0.5, 603), (0.5, 1718), (0.5, 161), (0.5, 174), (0.5, 736), (0.5, 1204), (0.5, 1077), (0.5, 204), (0.5, 1080), (0.5, 1171), (0.5, 781), (0.5, 641), (0.5, 1057), (0.5, 723), (0.5, 1131), (0.5, 2230), (0.5, 625), (0.5, 606), (0.5, 2134), (0.5, 751), (0.5, 2233), (0.5, 1775), (0.5, 1104), (0.5, 1215), (0.5, 1621), (0.5, 2122), (0.5, 1622), (0.5, 1288), (0.5, 1269), (0.5, 2170), (0.5, 1671), (0.5, 1772), (0.5, 2101), (0.5, 1681), (0.5, 1571), (0.5, 1741), (0.5, 2090), (0.5, 1669), (0.5, 1662), (0.5, 1052), (0.5, 2081), (0.5, 670), (0.5, 1260), (0.5, 1549), (0.5, 1666), (0.5, 1597), (0.5, 1719)]
INFO:autotvm:Get devices for measurement successfully!
DEBUG:autotvm:No: 1	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.3254116)	[('tile_p', [2, 3]), ('tile_k', [6, 4]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,14
DEBUG:autotvm:No: 2	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.3639374)	[('tile_p', [3, 2]), ('tile_k', [12, 2]), ('tile_c', [256, 4]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,61
DEBUG:autotvm:No: 3	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.393963)	[('tile_p', [6, 1]), ('tile_k', [4, 6]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,16
DEBUG:autotvm:No: 4	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.3942487)	[('tile_p', [3, 2]), ('tile_k', [8, 3]), ('tile_c', [128, 8]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,93
DEBUG:autotvm:No: 5	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.394447)	[('tile_p', [3, 2]), ('tile_k', [8, 3]), ('tile_c', [256, 4]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,65
DEBUG:autotvm:No: 6	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.4312575)	[('tile_p', [1, 6]), ('tile_k', [4, 6]), ('tile_c', [512, 2]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,47
DEBUG:autotvm:No: 7	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255129.468973)	[('tile_p', [6, 1]), ('tile_k', [2, 12]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,24
.
.
.
DEBUG:autotvm:No: 380	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255297.8897216)	[('tile_p', [2, 3]), ('tile_k', [3, 8]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,22
DEBUG:autotvm:No: 381	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255297.9168646)	[('tile_p', [2, 3]), ('tile_k', [12, 2]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'unroll'])],winograd,None,286
DEBUG:autotvm:No: 382	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255297.950325)	[('tile_p', [1, 6]), ('tile_k', [2, 12]), ('tile_c', [128, 8]), ('ann_reduce', ['none']), ('ann_spatial', ['none', 'none'])],winograd,None,111
DEBUG:autotvm:No: 383	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255297.980815)	[('tile_p', [1, 6]), ('tile_k', [2, 12]), ('tile_c', [512, 2]), ('ann_reduce', ['unroll']), ('ann_spatial', ['none', 'vec'])],winograd,None,755
DEBUG:autotvm:No: 384	GFLOPS: 0.00/0.00	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556255298.0214326)	[('tile_p', [1, 6]), ('tile_k', [2, 12]), ('tile_c', [1024, 1]), ('ann_reduce', ['none']), ('ann_spatial', ['unroll', 'none'])],winograd,None,867
WARNING:autotvm:Too many errors happen in the tuning. Now is in debug mode

Segmentation fault: 11

Stack trace returned 10 entries:
[bt] (0) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x22b18d) [0x7fd99e2bc18d]
[bt] (1) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398857e) [0x7fd9a1a1957e]
[bt] (2) /lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7fd9f43da4b0]
[bt] (3) /lib/x86_64-linux-gnu/libc.so.6(getenv+0xad) [0x7fd9f43de81d]
[bt] (4) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398861b) [0x7fd9a1a1961b]
[bt] (5) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398a012) [0x7fd9a1a1b012]
[bt] (6) /lib/x86_64-linux-gnu/libc.so.6(__libc_fork+0x1b6) [0x7fd9f44714f6]
[bt] (7) python3() [0x4c8c2c]
[bt] (8) python3(PyEval_EvalFrameEx+0x45f4) [0x53ad74]
[bt] (9) python3(PyEval_EvalFrameEx+0x4b14) [0x53b294]
[/details]

In above step, the program meybe stops running…

peterlau123 · April 26, 2019, 11:24am

You may try a smaller n_trial and early_stopping like n_trail=500,early_stopping=100
Check whether the error happens again

zzw · April 26, 2019, 12:37pm

I have try bigger ones that without error. Is there some tricks for set these two parameters, n_trail and early_stopping.

peterlau123 · April 26, 2019, 1:46pm

You can find measure_option to find out what does these two options mean.In theory,the larger they are the better results we will get.

zzw · April 26, 2019, 2:18pm

okey, thanks. But, when I use bigger ones (n_trial=1500, early_stopping=1200), the same problem also occurs that the program stop running…

DEBUG:autotvm:XGB load 11700 entries from history log file
DEBUG:autotvm:XGB iter:   0	tr-a-recall@128: 0.000567	tr-map: 0.000102
DEBUG:autotvm:XGB iter:  25	tr-a-recall@128: 0.023467	tr-map: 0.000151
DEBUG:autotvm:XGB iter:  50	tr-a-recall@128: 0.015471	tr-map: 0.000155
DEBUG:autotvm:XGB iter:  75	tr-a-recall@128: 0.016994	tr-map: 0.000224
DEBUG:autotvm:XGB iter: 100	tr-a-recall@128: 0.022380	tr-map: 0.000242
DEBUG:autotvm:XGB stopped. Best iteration: [22] tr-a-recall@128:0.033311	tr-map:0.000139 
DEBUG:autotvm:XGB train: 93.22	obs: 11700
DEBUG:autotvm:SA iter: 50	last_update: 47	max-0: 3.11	max-1: 3.75	temp: 0.90	elapsed: 12.55
DEBUG:autotvm:SA iter: 100	last_update: 99	max-0: 3.18	max-1: 3.75	temp: 0.80	elapsed: 20.30
DEBUG:autotvm:SA iter: 149	last_update: 99	max-0: 3.18	max-1: 3.75	elapsed: 26.04
DEBUG:autotvm:SA Maximums: [(3.7527895, 14522), (3.723404, 3258), (3.6886911, 18746), (3.6593056, 7482), (3.6567423, 14170), (3.6429365, 15226), (3.6273568, 2906), (3.613551, 3962), (3.592644, 18394), (3.578838, 19450), (3.5632584, 7130), (3.5494525, 8186), (3.5468893, 14874), (3.5175037, 3610), (3.482791, 19098), (3.4534054, 7834), (3.4189792, 14565), (3.403492, 14479), (3.4022164, 18703), (3.3905025, 14213), (3.3895936, 3301), (3.3741064, 3215), (3.3728309, 7439), (3.3620157, 14741), (3.3620157, 3477), (3.361117, 2949), (3.3561563, 18789), (3.3276796, 18437), (3.3267708, 7525), (3.3091254, 15269), (3.3069136, 14127), (3.305638, 18351), (3.298294, 7173), (3.2936387, 15183), (3.2923632, 19407), (3.2830648, 7658), (3.2817893, 18922), (3.2806487, 14917), (3.2797399, 4005), (3.278741, 7701), (3.278741, 18965), (3.277528, 2863), (3.2762525, 7087), (3.2660253, 3434), (3.2642531, 3919), (3.2629776, 8143), (3.2521625, 4181), (3.2521625, 15445), (3.2514975, 14389), (3.2514975, 3125), (3.2512631, 3653), (3.2463026, 19493), (3.2438242, 14698), (3.2204218, 7306), (3.2191463, 18570), (3.217826, 19141), (3.216917, 8229), (3.2016268, 7349), (3.2016268, 18613), (3.1970603, 14831), (3.1957848, 19055), (3.1884403, 7877), (3.184822, 7263), (3.1835465, 18527)]
INFO:autotvm:Get devices for measurement successfully!
DEBUG:autotvm:No: 1	GFLOPS: 8.91/8.91	result: MeasureResult(costs=(0.0094114342,), error_no=0, all_cost=7.986784219741821, timestamp=1556281439.7488291)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14522
DEBUG:autotvm:No: 2	GFLOPS: 15.82/15.82	result: MeasureResult(costs=(0.0053016462,), error_no=0, all_cost=8.312735557556152, timestamp=1556281440.2741497)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3258
DEBUG:autotvm:No: 3	GFLOPS: 14.65/15.82	result: MeasureResult(costs=(0.0057263682,), error_no=0, all_cost=8.693290948867798, timestamp=1556281440.7368302)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,18746
DEBUG:autotvm:No: 4	GFLOPS: 7.84/15.82	result: MeasureResult(costs=(0.0106937668,), error_no=0, all_cost=9.261219501495361, timestamp=1556281441.3090894)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7482
DEBUG:autotvm:No: 5	GFLOPS: 12.02/15.82	result: MeasureResult(costs=(0.0069779012,), error_no=0, all_cost=9.816282272338867, timestamp=1556281441.8720064)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14170
DEBUG:autotvm:No: 6	GFLOPS: 17.37/17.37	result: MeasureResult(costs=(0.0048297328,), error_no=0, all_cost=10.053438901901245, timestamp=1556281442.4006672)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,15226
DEBUG:autotvm:No: 7	GFLOPS: 12.63/17.37	result: MeasureResult(costs=(0.0066405618,), error_no=0, all_cost=10.63239336013794, timestamp=1556281442.9654477)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,2906
DEBUG:autotvm:No: 8	GFLOPS: 12.39/17.37	result: MeasureResult(costs=(0.0067719276,), error_no=0, all_cost=11.629758358001709, timestamp=1556281444.129806)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3962
DEBUG:autotvm:No: 9	GFLOPS: 12.38/17.37	result: MeasureResult(costs=(0.006777119199999999,), error_no=0, all_cost=11.19797658920288, timestamp=1556281443.5309227)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,18394
DEBUG:autotvm:No: 10	GFLOPS: 13.88/17.37	result: MeasureResult(costs=(0.0060420662,), error_no=0, all_cost=12.30599069595337, timestamp=1556281444.7187889)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,19450
DEBUG:autotvm:No: 11	GFLOPS: 13.43/17.37	result: MeasureResult(costs=(0.006248389599999999,), error_no=0, all_cost=12.876094818115234, timestamp=1556281445.2687564)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [2, 5]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7130

DEBUG:autotvm:No: 1415	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(InstantiationError(['Too large factor for unrolling'],),), error_no=1, all_cost=0.04433441162109375, timestamp=1556282939.6144764)	[('tile_co', [2, 512]), ('tile_oh', [8, 1]), ('tile_ow', [1, 10]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['unroll', 'unroll', 'unroll'])],direct,None,17389
DEBUG:autotvm:No: 1416	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282939.866414)	[('tile_co', [8, 128]), ('tile_oh', [2, 4]), ('tile_ow', [5, 2]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'none', 'none'])],direct,None,11337
DEBUG:autotvm:XGB iter:   0	tr-a-recall@64: 0.015387	tr-map: 0.001056
DEBUG:autotvm:XGB iter:  25	tr-a-recall@64: 0.163500	tr-map: 0.001047
DEBUG:autotvm:XGB stopped. Best iteration: [9] tr-a-recall@64:0.206676	tr-map:0.002625 
DEBUG:autotvm:XGB train: 2.33	obs: 1416	error: 411	n_cache: 26742
DEBUG:autotvm:SA iter: 50	last_update: 49	max-0: 0.76	max-1: 1.10	temp: 0.90	elapsed: 2.23
DEBUG:autotvm:SA iter: 100	last_update: 93	max-0: 0.79	max-1: 1.10	temp: 0.80	elapsed: 4.50
DEBUG:autotvm:SA iter: 150	last_update: 136	max-0: 0.79	max-1: 1.10	temp: 0.70	elapsed: 6.63
DEBUG:autotvm:SA iter: 186	last_update: 136	max-0: 0.79	max-1: 1.10	elapsed: 7.95
DEBUG:autotvm:SA Maximums: [(1.1044867, 18482), (1.1044867, 18834), (1.1044867, 19538), (1.1044867, 14258), (1.1044867, 19186), (1.1044867, 14962), (0.9705855, 18318), (0.9705855, 19022), (0.9705855, 2830), (0.9705855, 3182), (0.9705855, 3534), (0.9705855, 3886), (0.9705855, 7054), (0.9705855, 14798), (0.9705855, 7758), (0.9705855, 14094), (0.9705855, 7406), (0.9705855, 8110), (0.96372485, 3698), (0.96372485, 7570), (0.96372485, 2994), (0.96372485, 7922), (0.96372485, 7218), (0.96372485, 8274), (0.8969209, 15313), (0.8969209, 14301), (0.8969209, 18877), (0.8969209, 14257), (0.8969209, 15005), (0.8969209, 18525), (0.8969209, 14653), (0.8969209, 14609), (0.8969209, 15357), (0.8969209, 19229), (0.8969209, 14961), (0.8969209, 18481), (0.8969209, 19537), (0.8969209, 18833), (0.8969209, 19581), (0.8969209, 19185), (0.87397027, 22969), (0.87397027, 23321), (0.87397027, 26137), (0.87397027, 25433), (0.87397027, 24729), (0.87397027, 22617), (0.87397027, 24377), (0.87397027, 23673), (0.87397027, 27545), (0.87397027, 24025), (0.87397027, 26489), (0.87397027, 26841), (0.87397027, 27193), (0.87397027, 25081), (0.87397027, 27897), (0.87278795, 19010), (0.81722647, 7132), (0.81722647, 7484), (0.81722647, 8188), (0.81722647, 7836), (0.8138035, 25700), (0.785258, 21561), (0.785258, 22265), (0.785258, 21913)]
DEBUG:autotvm:No: 1417	GFLOPS: 6.95/20.80	result: MeasureResult(costs=(0.0120690566,), error_no=0, all_cost=7.709119558334351, timestamp=1556282973.45801)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,18482
DEBUG:autotvm:No: 1418	GFLOPS: 8.87/20.80	result: MeasureResult(costs=(0.009453958799999999,), error_no=0, all_cost=8.132930278778076, timestamp=1556282974.0839336)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,18834
DEBUG:autotvm:No: 1419	GFLOPS: 7.60/20.80	result: MeasureResult(costs=(0.0110391758,), error_no=0, all_cost=8.985101461410522, timestamp=1556282974.7521281)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,19538
DEBUG:autotvm:No: 1420	GFLOPS: 8.69/20.80	result: MeasureResult(costs=(0.0096585932,), error_no=0, all_cost=9.38443660736084, timestamp=1556282975.3344212)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14258
DEBUG:autotvm:No: 1421	GFLOPS: 7.91/20.80	result: MeasureResult(costs=(0.0106052314,), error_no=0, all_cost=10.048110246658325, timestamp=1556282975.9568195)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,19186
DEBUG:autotvm:No: 1422	GFLOPS: 5.58/20.80	result: MeasureResult(costs=(0.015020446600000001,), error_no=0, all_cost=10.397518634796143, timestamp=1556282976.6236203)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14962
DEBUG:autotvm:No: 1423	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.4938884)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,18318
DEBUG:autotvm:No: 1424	GFLOPS: 10.76/20.80	result: MeasureResult(costs=(0.007795533,), error_no=0, all_cost=13.88020658493042, timestamp=1556282977.207984)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['unroll', 'unroll', 'vec'])],direct,None,19022
DEBUG:autotvm:No: 1425	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.5415165)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,2830
DEBUG:autotvm:No: 1426	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.6001098)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3182
DEBUG:autotvm:No: 1427	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.628492)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3534
DEBUG:autotvm:No: 1428	GFLOPS: 13.80/20.80	result: MeasureResult(costs=(0.0060792988,), error_no=0, all_cost=14.553622722625732, timestamp=1556282977.7789824)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3886
DEBUG:autotvm:No: 1429	GFLOPS: 16.35/20.80	result: MeasureResult(costs=(0.0051303854000000005,), error_no=0, all_cost=15.026147365570068, timestamp=1556282978.300251)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7054
DEBUG:autotvm:No: 1430	GFLOPS: 11.17/20.80	result: MeasureResult(costs=(0.0075096396,), error_no=0, all_cost=15.570147037506104, timestamp=1556282978.859891)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14798
DEBUG:autotvm:No: 1431	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.7337558)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7758
DEBUG:autotvm:No: 1432	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.7786314)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['unroll', 'none', 'vec'])],direct,None,14094
DEBUG:autotvm:No: 1433	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(TimeoutError(),), error_no=6, all_cost=10, timestamp=1556282972.8242717)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7406
DEBUG:autotvm:No: 1434	GFLOPS: 12.04/20.80	result: MeasureResult(costs=(0.0069672532,), error_no=0, all_cost=15.787394762039185, timestamp=1556282979.4186325)	[('tile_co', [128, 8]), ('tile_oh', [4, 2]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 7, 8, 9]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,8110
DEBUG:autotvm:No: 1435	GFLOPS: 9.04/20.80	result: MeasureResult(costs=(0.009280882,), error_no=0, all_cost=13.455196857452393, timestamp=1556282980.0011818)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,3698
DEBUG:autotvm:No: 1436	GFLOPS: 0.00/20.80	result: MeasureResult(costs=(OSError(14, 'Bad address'),), error_no=2, all_cost=6.874565124511719, timestamp=1556282972.8251076)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'unroll']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7570
DEBUG:autotvm:No: 1437	GFLOPS: 8.42/20.80	result: MeasureResult(costs=(0.0099614604,), error_no=0, all_cost=13.919022798538208, timestamp=1556282980.6497679)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'none', 'vec'])],direct,None,2994
DEBUG:autotvm:No: 1438	GFLOPS: 8.93/20.80	result: MeasureResult(costs=(0.0093927656,), error_no=0, all_cost=14.589922666549683, timestamp=1556282981.247122)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'none']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7922
DEBUG:autotvm:No: 1439	GFLOPS: 8.98/20.80	result: MeasureResult(costs=(0.0093442904,), error_no=0, all_cost=14.966272115707397, timestamp=1556282981.847316)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['none', 'none']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,7218
DEBUG:autotvm:No: 1440	GFLOPS: 7.89/20.80	result: MeasureResult(costs=(0.0106320054,), error_no=0, all_cost=15.671269178390503, timestamp=1556282982.4720082)	[('tile_co', [256, 4]), ('tile_oh', [8, 1]), ('tile_ow', [10, 1]), ('reorder_0', [0, 1, 2, 3, 4, 5, 6, 9, 7, 8]), ('ann_reduce', ['unroll', 'unroll']), ('ann_spatial', ['none', 'unroll', 'vec'])],direct,None,8274

Segmentation fault: 11

Stack trace returned 10 entries:
[bt] (0) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x22b18d) [0x7f776c6b918d]
[bt] (1) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398857e) [0x7f776fe1657e]
[bt] (2) /lib/x86_64-linux-gnu/libc.so.6(+0x354b0) [0x7f77c27d74b0]
[bt] (3) /lib/x86_64-linux-gnu/libc.so.6(getenv+0xad) [0x7f77c27db81d]
[bt] (4) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398861b) [0x7f776fe1661b]
[bt] (5) /usr/local/lib/python3.5/dist-packages/mxnet/libmxnet.so(+0x398a012) [0x7f776fe18012]
[bt] (6) /lib/x86_64-linux-gnu/libc.so.6(__libc_fork+0x1b6) [0x7f77c286e4f6]
[bt] (7) python3() [0x4c8c2c]
[bt] (8) python3(PyEval_EvalFrameEx+0x45f4) [0x53ad74]
[bt] (9) python3(PyEval_EvalFrameEx+0x4b14) [0x53b294]

zzw · April 27, 2019, 5:03am

Set n_trial=1500, early_stopping=1200, failed…

peterlau123 · April 27, 2019, 10:13am

I see that your error mostly because of timeout,you can try a larger timeout value in LocalBuilder and Localrunner

zzw · April 27, 2019, 12:30pm

I have tryed to set timeout = 30, 50 for tuning, but it doesn’t work.

zzw · April 28, 2019, 3:15pm

who can help me solve this problem?

aoto-tuning hasn’t supportted ssd-mobilenet?

merrymercy · May 2, 2019, 12:10am

Did you meet the error when tuning resnet-18?

zzw · May 2, 2019, 4:46am

No. Auto-tuning just supports the models of the following pic now?

hlq1025 · August 6, 2019, 8:48am

i set timeout=1000000000，but the error overflow comes 。what can i do to make the n_trial and early_stopping larger?