Skip to content

Resume / overwrite existing output #46

@safl

Description

@safl

Currently when running cijoe, then the cijoe-output folder is moved into cijoe-archive.
This behavior hinders re-running a subset of steps in a workflow using the same "state/data".
For example, a workflow:

  • build
  • install
  • benchmark
  • collect
  • plot

It would be convenient to re-run using the current state of cijoe-output and then skip steps that has previously succeeded.
Otherwise, one would have to either break the above steps into separate workflows, or wait for the steps to succeed. Both of these situations are acceptable in a CI environment, where everything has to run flawlessly. However, in a development environment, where these steps are implemented, then it is quite tedious.

Thus, it would be useful addition:

  • Add a self-contained command-line option -a / --archive flag, moving the current cijoe-output into cijoe-archive/....
  • Change the default workflow-execution to enabling resuming a previous workflow, by skipping successful steps, running skipped and failed
  • This should also function when only executing a subset of steps, e.g. in the above list of steps, one might re-iterate on plot whilst all the other steps have completed successfully.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesthelp wantedExtra attention is needed

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions