Check action noise
It looks like the SB3 HER implementation does not add any action noise. Check this.
-
Clarify for SAC -
Clarify for TD3 and DQN
Edited by Manfred Eppe
It looks like the SB3 HER implementation does not add any action noise. Check this.