Performance testing and Smoke testing

Manfred Epperequested to merge
performance_function_testing into devel
  • performance tests with PerformanceTestingSweeper, e.g. python experiment/train.py +performance=FetchReach/her-test --multirun checks the following condition: In 2 out of 3 tests, the test/success rate should be at least 0.9 after 14000 steps.
  • smoke testing with a new function in CustomOptunaSweeperImpl e.g. python experiment/train.py algorithm=hac,her env=FetchReach-v1,AntReacher-v1 ++n_epochs=2 +defaults=smoke_test --multirun checks whether each env-algo combinations can run for two epochs without errors.
  • generally improved ease of use and fixed bugs and spelling

Merge request reports