Skip to content

Commit

Permalink
updated readme
Browse files Browse the repository at this point in the history
  • Loading branch information
joshuaspear committed Jun 4, 2024
1 parent 76d0013 commit 5a0f04a
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -65,16 +65,18 @@ Basic unit testing has been implemented for all the core functionality of the pa
* PyPi: https://pypi.org/project/offline-rl-ope/
* To install from sourse using pip, clone this repository and run ```pip install .``` in the top level of the repo.

### Limitations
* When using DM methods with the d3rlpy training API, the FQE model is required to be refitted for every epoch. This could be improved by trainin the FQE model once, before training of the offline RL model commences

### Future work
* Async/multithread support
* Additional estimators:
* DualDICE
* MAGIC
* Extended DR estimator as per equation 12 in https://arxiv.org/pdf/1511.03722.pdf
* APIs
* Extend d3rlpy
* Add additional apis e.g. for stable baselines
* Continuous action spaces
* Address limitations with existing DM integration with d3rlpy


### Tips
Expand Down

0 comments on commit 5a0f04a

Please sign in to comment.