Skip to content
This repository has been archived by the owner on Jul 8, 2024. It is now read-only.

Commit

Permalink
Updated STATUS
Browse files Browse the repository at this point in the history
  • Loading branch information
Dmitry Kats committed Nov 8, 2019
1 parent b2636e4 commit e34b213
Show file tree
Hide file tree
Showing 2 changed files with 18 additions and 27 deletions.
2 changes: 2 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,8 @@ It outputs a set of relevant graphs (see [Graph Archive](#graph-archive)).

For information about the layout of the project, see [Development](docs/Development.md#structure-of-the-repository).

For information about the current status of the project, see [Status](/STATUS.md).

## Methodology

For explanations on how do we perform the benchmarking see [Benchmarking Methodology](docs/Methodology.md), [Jacobian Correctness Verification](docs/JacobianCheck.md).
Expand Down
43 changes: 16 additions & 27 deletions STATUS.md
Original file line number Diff line number Diff line change
@@ -1,23 +1,6 @@
# Status

This file contains details about the layout of the repository, and the current development status of different tools and objectives.


## Folder structure

| Folder | Purpose
| --------- | ------- |
| ADBench | Orchestration scripts, plotting etc
| Backup | Old files
| Documents | Graphs, papers, presentations etc
| bak | Old files
| data | Data files for different examples
| etc | [HunterGate](https://github.com/ruslo/hunter) files
| submodules| Dependencies on other git repositories
| tmp | Output of benchmark files, figures etc
| tools | Implementations for each tested tool, one folder per tool, with *-common folders for shared files by language
| usr | Per-user scratch folder

This file contains the current development status of different tools and objectives.

## Tools

Expand All @@ -40,13 +23,14 @@ Checked items are built (where relevant) by CMake and can be run by run-all.ps1
- [x] Manual
- Manually-differentiated C++ functions
- No external dependencies
- [ ] Tapenade
- [x] Tapenade

### Python
All Python tools use pip/conda modules. See list under [Prerequisites](#prerequisites).
All Python tools use pip/conda modules. Dependencies for checked items are automatically fetched during CMake configure.
- [x] [Autograd](https://github.com/HIPS/autograd)
- [x] [Theano](https://github.com/Theano/Theano)
- [ ] [Theano](https://github.com/Theano/Theano)
- [x] [PyTorch](https://pytorch.org/)
- [x] [Tensorflow](https://www.tensorflow.org/)

### Matlab
Matlab tools are not currently run by `run-all.ps1` due to the limitations of the Matlab free trial. With the full version, they *should* run correctly.
Expand All @@ -56,10 +40,12 @@ Matlab tools are not currently run by `run-all.ps1` due to the limitations of th

### F#
- [x] [DiffSharp](https://github.com/DiffSharp/DiffSharp)
- Built using `dotnet build` (in batch file), which restores NuGet packages
- Built using `dotnet build`, which restores NuGet packages

### Julia
Dependencies for Julia-based tools are listed in `JuliaProject.toml` and automatically fetched during CMake configure.
- [ ] ForwardDiff.jl
- [x] Zygote


## Completeness
Expand All @@ -73,17 +59,20 @@ This is a table of all current tools, with their status in terms of running each
| ADOLC | x | x | x | - |
| Autograd | x | x | * | - |
| Ceres | x | x | * | - |
| DiffSharp | ! | x | - | - |
| DiffSharp | x! | x | x | x |
| Finite | x | x | x | x |
| Julia | - | - | - | - |
| Manual | x | x | x | ? |
| Julia | x | x | - | - |
| Manual | x | x | x | x |
| MuPad | x | ! | ? | - |
| PyTorch | x | ! | x | x |
| Tapenade | - | - | - | - |
| PyTorch | x | x | x | x |
| Tapenade | x | x | x | x |
| Tensorflow| x | x | x | x |
| Theano | x | x | x | - |
| Zygote | x! | x | x | x |

### Key
- `x` = Runs successfully
- `x!` = Generally runs successfully, but fails on some of the problem sizes
- `!` = Has been attempted, with problems
- `?` = Has been started, but is not complete
- `-` = Not attempted yet
Expand Down

0 comments on commit e34b213

Please sign in to comment.