Check performance tests
I reran all performance-tests for the merge request !74 (merged) . Three of them failed:
Blocks/o1-above-ddpg_her-testBlocks/o1-none-sac_her-testFetchPush/sac_her-test
I then also ran the failed tests on the devel branch and there, the Blocks/o1-above-ddpg_her-test also failed. The success-rate was 0 on both branches (3 runs each). However, the test config also includes inconsistencies, so maybe the test config was not correct in the first place.
Blocks/o1-none-sac_her-test and FetchPush/sac_her-test only failed with the new SB3 and Mujoco version. However, the performance was only slightly worse than on the devel branch. I will merge the branch into devel regardless, because the performance tests will have to be updated later anyway and the update of SB3 is more important.
We should re-evaluate all the performance tests at a later stage and maybe run new hyperparameter-optimizations for the new SB3 version.