Error during single dataset evaluation

[umariqb]

I tried running the evaluation only for the 3DPW dataset with the following command:

python scripts/spec_eval.py --cfg data/spec/checkpoints/spec_config.yaml --opts DATASET.VAL_DS 3dpw-test-cam 

But it gives the following error:

TypeError: test_step() missing 1 required positional argument: 'dataloader_nb'

Fixed it by giving a default value for dataloader_nb for the test_step function in trainer.py:

def test_step(self, batch, batch_nb, dataloader_nb=0):
    return self.validation_step(batch, batch_nb, dataloader_nb)

The error occurs because we don't append dataloader_idx to args in evaluation_loop.py:

if multiple_test_loaders or multiple_val_loaders:
    args.append(dataloader_idx)

[uyoung-jeong]

After fixing dataloader_nb=0, I got another error in spec/trainer.py

SPEC/spec/trainer.py

Line 524 in d2fe2c2

self.val_save_best_results(acc, ds_name)

AttributeError: 'dict' object has no attribute 'append'

I added an input argument ds_name=self.val_ds[0].dataset to prevent the error.