Our Apex DQN implementation reaches an episodic return of 340 in just 2 hours and 34 mins, which is even better than PPO's performance that reaches an average episodic return of in 3 hours.

Section 2