Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
S Scilab-RL
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 24
    • Issues 24
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
  • Merge requests 1
    • Merge requests 1
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Commits
  • Issue Boards
Collapse sidebar
  • Manfred Eppe
  • Scilab-RL
  • Wiki
  • Home

Last edited by Manfred Eppe Oct 20, 2022
Page history

Home

First information about setting up this repository can be found in our readme. This wiki contains tutorials and some additional tips and tricks. Take a look at the tutorials below!

The most common use case for a researcher is probably to extend an existing algorithm with a new feature or mechanism. This is covered in the tutorial to create a copy of SAC and start modifying it.

Tutorials

How to configure Pycharm for this project.

How to run a standard algorithm(SAC with Hindsight Experience Replay from stable baselines 3) and interpret the console output. This is also a good starting point for checking out other tutorials.

How to visualize and render.

How to manage hyperparameters and arguments with Hydra.

How to log data.

How to display logged data in MLFlow and Weights and Biases.

How to restore a saved policy.

How to set early stopping values.

As an example of how to create a new different algorithm from an existing one, we create a copy of SAC and start modifying it.

How to perform hyperparameter optimization.

How to set up and perform a performance test.

How to set up and perform a smoke test.

How to add a new robotic environment.

Further information

How are the files structured?

We created an overview over our custom environments.

Tips for training on remote computers.

Advice on running on Windows with WSL2.

How our GitLab pipeline works.

Clone repository
  • Adding a new Environment
  • Adding a new algorithm: create a copy of SAC and start modifying it
  • Detailed Instructions for installation and getting started
  • Display logged data
  • Environments Overview
  • File structure
  • GitLab Pipeline
  • Hyperparameter management with Hydra
  • Hyperparameter optimization
  • Logger
  • Performance tests
  • Pycharm
  • Restore a saved policy
  • Run a standard algorithm
  • Running on Windows with WSL2
View All Pages