Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
joshuaspear authored Jul 22, 2024
1 parent 2660244 commit 6c77c2e
Showing 1 changed file with 1 addition and 5 deletions.
6 changes: 1 addition & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -65,18 +65,14 @@ Basic unit testing has been implemented for all the core functionality of the pa
* PyPi: https://pypi.org/project/offline-rl-ope/
* To install from sourse using pip, clone this repository and run ```pip install .``` in the top level of the repo.

### Limitations
* When using DM methods with the d3rlpy training API, the FQE model is required to be refitted for every epoch. This could be improved by trainin the FQE model once, before training of the offline RL model commences

### Future work
* Async/multithread support
* Additional estimators:
* DualDICE
* MAGIC
* Extended DR estimator as per equation 12 in https://arxiv.org/pdf/1511.03722.pdf
* State importance sampling
* APIs
* Add additional apis e.g. for stable baselines
* Address limitations with existing DM integration with d3rlpy


### Tips
Expand Down

0 comments on commit 6c77c2e

Please sign in to comment.