On default mode (generate+execute), a tmp settings yml is generated. We should save the dict object and pass it directly to execute, instead.