Skip to content

Commit 44ce91e

Browse files
lihuoranyou-n-g
andauthored
Simple RL notebook (#1395)
* Simple RL notebook * Add link to the notebook Co-authored-by: Young <[email protected]>
1 parent ebb8ec3 commit 44ce91e

File tree

3 files changed

+354
-1
lines changed

3 files changed

+354
-1
lines changed

docs/component/rl/framework.rst

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,4 +42,8 @@ As you may have noticed, a training vessel itself holds all the required compone
4242

4343
With a training vessel, the trainer could finally launch the training pipeline by simple, Scikit-learn-like interfaces (i.e., ``trainer.fit()``).
4444

45-
The API for Trainer and TrainingVessel and can be found `here <../../reference/api.html#module-qlib.rl.trainer>`__.
45+
The API for Trainer and TrainingVessel and can be found `here <../../reference/api.html#module-qlib.rl.trainer>`__.
46+
47+
The RL module is designed in a loosely-coupled way. Currently, RL examples are integrated with concrete business logic.
48+
But the core part of RL is much simpler than what you see.
49+
To demonstrate the simple core of RL, `a dedicated notebook <https://github.com/microsoft/qlib/tree/main/examples/rl/simple_example.ipynb>`__ for RL without business loss is created.

examples/rl/README.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -53,3 +53,8 @@ python -m qlib.rl.contrib.backtest --config_path ./experiment_config/backtest/co
5353
```
5454

5555
The backtest workflow will use the trained model in `checkpoints/`. The backtest summary can be found in `outputs/`.
56+
57+
## Others
58+
The RL module is designed in a loosely-coupled way. Currently, RL examples are integrated with concrete business logic.
59+
But the core part of RL is much simpler than what you see.
60+
To demonstrate the simple core of RL, [a dedicated notebook](./simple_example.ipynb) for RL without business loss is created.

examples/rl/simple_example.ipynb

Lines changed: 344 additions & 0 deletions
Large diffs are not rendered by default.

0 commit comments

Comments
 (0)