Skip to content

Default replay buffer should always be HER

As far as I see, HER is not enabled by default. Without HER, the results are usually quite poor, so HER should by default be enabled. Also, it is unclear to me where in the .yaml files we can enable her.