Hi, I am auto-tuning a resnet20 on cifar10 iteratively. In the x epoch, I set the trials in the “tuning options” to x.
However, it turns out the program will stuck. for example.
Tuning…
[Task 1/14] Current/Best: 11.81/ 59.79 GFLOPS | Progress: (27/27) | 70.04 s Done.
[Task 2/14] Current/Best: 5.65/ 61.04 GFLOPS | Progress: (27/27) | 71.72 s Done.
[Task 3/14] Current/Best: 3.45/ 16.33 GFLOPS | Progress: (27/27) | 65.15 s Done.
[Task 4/14] Current/Best: 8.78/ 20.19 GFLOPS | Progress: (27/27) | 69.58 s Done.
[Task 5/14] Current/Best: 8.42/ 8.58 GFLOPS | Progress: (27/27) | 74.90 s Done.
[Task 6/14] Current/Best: 1.18/ 20.31 GFLOPS | Progress: (27/27) | 76.74 s Done.
[Task 7/14] Current/Best: 0.00/ 0.00 GFLOPS | Progress: (0/27) | 0.00 s
^CProcess ForkPoolWorker-2207:
Process ForkPoolWorker-2208:
Process ForkPoolWorker-2203:
Process ForkPoolWorker-2154:
Process ForkPoolWorker-2152:
Process Process-2155:
Process ForkPoolWorker-2149:
It seems that it stucks in the 27th epoch. Not sure why, any suggestions?
Thanks,