Skip to content

Simplify testing infra / create centralized Python script that orchestrates Turnt #191

@ngernest

Description

@ngernest

Kevin mentioned he doesn't like our current snapshot testing setup, specifically:

  1. How we have so many different file formats (.prot, .tx, .rt)
  2. How we need to create duplicate versions of the same .prot file in order to supply arguments to Turnt (e.g. the same .prot file is present in both the interpreter & monitor subdirectories)

As we add more tests / larger benchmarks, it would be nice if our testing infra was simpler (to avoid duplicate versions of the same .prot file from being out of sync with each other). Kevin suggested having a centralized Python script that orchestrates Turnt. That is, for each .prot file, the Python test orchestrator figures the right inputs for Turnt for all the different styles of tests (monitor test, interpreter test, round-trip tests) and then actually invokes the right Turnt environment somehow.

Metadata

Metadata

Assignees

No one assigned

    Labels

    ChoreQuality-of-life improvements / Refactors that don't affect functionality

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions