Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Zipped Rune runtime #430

Draft
wants to merge 89 commits into
base: master
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
89 commits
Select commit Hold shift + click to select a range
3cda30e
Migrated the compile phase away from legion
Apr 7, 2022
5953d32
Migrated most of codegen to salsa
Apr 7, 2022
0bd4eb2
Migrated the parse phase over to salsa
Apr 7, 2022
562eacf
Use the bytes crate for representing bytes
Apr 17, 2022
a1704ac
Started adapting the lowering code
Apr 18, 2022
697ec56
Copied across the parsing code
Apr 18, 2022
c6a5412
Wired up text and diagnostics
Apr 18, 2022
fc8e9b4
Implemented most of the "lowering" phase
Apr 18, 2022
a22751b
Implemented the rest of the lowering phase
Apr 18, 2022
c269a77
Docs and minor tweaks
Apr 18, 2022
3a5e375
Making clippy happy
Apr 18, 2022
71bde19
Stubbed out a type checker module
Apr 19, 2022
483ef12
Added some snapshot tests and reproducibility
Apr 24, 2022
7a135bd
Switched to interned queries and moved lowering diagnostics to their …
Apr 24, 2022
50e226a
Implemented the Runefile.yml codegen
Apr 27, 2022
87fa8f9
Stashing some code
Apr 28, 2022
c425a7b
Deleted all unnecessary code
Apr 28, 2022
cb27bc7
Wrote up a ProcBlockRegistry trait
Apr 28, 2022
e5e5f0a
Regenerated Cargo.lock
Apr 28, 2022
6ecaa58
Upgrade rust-toolchain.toml
Apr 28, 2022
c22e09e
Remove nightly options from rustfmt.toml
Apr 28, 2022
9ba0f2c
Wired up the parser frontend
Apr 28, 2022
f37a934
Deleting stuff and shuffling around complexity
Apr 28, 2022
c4956a6
Swapped out the "im" crate and implemented the archiver
Apr 29, 2022
275e4a0
Implemented the Runefile patching
Apr 29, 2022
c2deb86
Deleted the old compiler implementation
Apr 29, 2022
aa43e3d
Added an example compiler binary
Apr 29, 2022
8f8b98b
Errors should be thread-safe
Apr 29, 2022
455d77d
Made all instrumented queries log at debug level
Apr 29, 2022
67ae98d
Renamed ReadError::UnknownScheme to UnsupportedScheme
Apr 29, 2022
96197af
Switched "rune build" over to using the compiler from crates.io
May 10, 2022
49af8ab
Added a switch for building with the new compiler
May 10, 2022
4bb14e1
Renamed the target modules to something more appropriate
May 10, 2022
70f39ee
Wire up "tracing" as the logger
May 10, 2022
47997e0
Fixed up the sine example
May 12, 2022
f71c3d2
We forgot to actually build the sine rune that our C API test requires
May 13, 2022
7f7fe55
Cargo fmt and logging cleanups
May 13, 2022
85a7e6d
Forgot to set the build config
May 17, 2022
8294306
Wired up WAPM URIs
May 19, 2022
fbd50bc
Patch capability paths to use local proc-block files
May 19, 2022
d3b6449
Forgot to add capability proc-blocks to the final ZIP file
May 19, 2022
00badc9
Updated a test
May 19, 2022
ec5fa27
Fixed how things are logged during integration tests
May 24, 2022
cd9b2ae
In Progress: Implementing Zune Engine as a webassembly engine
saidinesh5 May 31, 2022
127202c
Zune: Implement load() and predict() for ModelNode
saidinesh5 May 31, 2022
3425129
Zune: Implement graph_context_add_*_tensors
saidinesh5 May 17, 2022
13576aa
Zune: Implement kernel_context functions
saidinesh5 May 17, 2022
98e23c2
Make zune an example for now
saidinesh5 May 31, 2022
d91fb97
Zune: Fix bug - Do not share Store, import objects among proc blocks
saidinesh5 May 20, 2022
08afed0
Zune update example
saidinesh5 May 20, 2022
e16db20
zune_example: Reformat
saidinesh5 May 25, 2022
e2576d6
zune: Add GraphContext for Model nodes
saidinesh5 May 25, 2022
e001824
Github Actions: Checkout submodules
saidinesh5 May 27, 2022
23a7262
Cleanup zune.rs and zune_example.rs
saidinesh5 May 27, 2022
a59497c
Zune: get_tensors: Do not add the same node twice to visit
saidinesh5 May 31, 2022
4f29f8d
Update librunecoral
saidinesh5 May 31, 2022
e04f3df
Zune: Fix for the previous commit
saidinesh5 May 31, 2022
9b16f60
Zune: Fix Compiler breakages
saidinesh5 May 31, 2022
b18ec5e
Made the zune example compile
May 31, 2022
e079276
Copying the basic FileSystem implementation into hotg-rune-compiler
May 31, 2022
00506ca
Switched the Rune CLI over to the builtin filesystem
Jun 1, 2022
6ce2684
Adding docs and fleshing out the WapmUri type
Jun 1, 2022
95e16de
Updated a doc-comment
Jun 2, 2022
f6fa2c0
Merge pull request #432 from hotg-ai/feature/default-filesystem-imple…
Jun 2, 2022
135f641
Switch the git submodule url to HTTPS instead of SSH so cargo can clo…
Jun 2, 2022
60b3d1d
Cleaned up the Cargo.toml file
Jun 2, 2022
03feefe
Sprinkled the Zune code with tracing calls
Jun 3, 2022
d3198c1
Fixed some unused variable warnings
Jun 3, 2022
467bce6
Ran cargo fmt
Jun 3, 2022
d73fee3
Merge pull request #433 from hotg-ai/feature/logging
Jun 3, 2022
55acd09
Use WAPM's GraphQL API to find which file to download
Jun 3, 2022
8d672c4
Merge pull request #435 from hotg-ai/hotfix/download-from-wapm
Jun 3, 2022
c4cd24d
Moved ProcBlockNode and ModelNode to their own modules
Jun 3, 2022
cf7deed
Put ProcBlockNode and ModelNode behind a trait
Jun 3, 2022
58c9137
Implemented std::error::Error for KernelError and other minor cleanups
Jun 3, 2022
3ca2b04
Removing some dead code
Jun 3, 2022
d3a3fcf
The "zune" module was never put behind its feature flag
Jun 3, 2022
93d939f
Updating the path too the wit-files folder
Jun 3, 2022
41b7bd1
Merge pull request #434 from hotg-ai/refactor/optional-tflite
saidinesh5 Jun 7, 2022
45c6dc6
Zune: Fix Output node handling for now
saidinesh5 Jun 8, 2022
3482c7c
Zune: Use IndexMap instead of HashMap for now
saidinesh5 Jun 9, 2022
3f87a7a
Added a manual Deserialize implementation to Stage for better error m…
Jun 13, 2022
88048cf
Zune: Error out when proc_block loading fails
saidinesh5 Jun 13, 2022
1b86369
Zune: Minor reafactoring in mod.rs
saidinesh5 Jun 13, 2022
84f2f02
Treat a URI with invalid characters as a file path
Michael-F-Bryan Jul 5, 2022
6ac8793
Merge pull request #437 from hotg-ai/invalid-characters-are-paths
Jul 5, 2022
5efd96f
Added a test for paths containing a space
Michael-F-Bryan Jul 5, 2022
9fffed1
Made sure we can convert a FileSystem path into a URI
Michael-F-Bryan Jul 5, 2022
8a12dda
Made sure the default asset loader can handle percent-encoded paths
Michael-F-Bryan Jul 5, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,8 @@ jobs:
runs-on: ${{ matrix.os }}
steps:
- uses: actions/checkout@v2
with:
submodules: true
- uses: actions/cache@v2
with:
path: |
Expand Down Expand Up @@ -77,6 +79,8 @@ jobs:
runs-on: ubuntu-18.04
steps:
- uses: actions/checkout@v2
with:
submodules: true
- uses: actions/cache@v2
with:
path: |
Expand Down Expand Up @@ -137,6 +141,8 @@ jobs:
runs-on: ubuntu-18.04
steps:
- uses: actions/checkout@v2
with:
submodules: true
- uses: actions/cache@v2
with:
path: |
Expand Down
5 changes: 5 additions & 0 deletions .github/workflows/releases.yml
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ jobs:
steps:
- uses: actions/checkout@v2
with:
submodules: true
fetch-depth: 0
- name: print latest_commit
run: echo ${{ github.sha }}
Expand Down Expand Up @@ -61,6 +62,8 @@ jobs:
asset_name: rune-macos
steps:
- uses: actions/checkout@v1
with:
submodules: true
- uses: actions/cache@v2
with:
path: |
Expand Down Expand Up @@ -163,6 +166,8 @@ jobs:
echo "tag=nightly" >> $GITHUB_ENV
- name: Checkout code
uses: actions/checkout@v2
with:
submodules: true
- name: Fetch Pre-Compiled Binaries
uses: actions/download-artifact@v2
with:
Expand Down
1 change: 0 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,3 @@ examples/.DS_Store
*.png
tarpaulin-report.html
.ipynb_checkpoints/
build/
3 changes: 3 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
[submodule "wit-files"]
path = wit-files
url = https://github.com/hotg-ai/wit-files.git
12 changes: 0 additions & 12 deletions .rustfmt.toml
Original file line number Diff line number Diff line change
@@ -1,16 +1,4 @@
fn_single_line = true
format_code_in_doc_comments = true
format_macro_matchers = true
format_strings = true
group_imports = "StdExternalCrate"
imports_granularity = "Crate"
match_block_trailing_comma = true
max_width = 80
normalize_comments = true
normalize_doc_attributes = true
reorder_impl_items = true
report_fixme = "Unnumbered"
report_todo = "Unnumbered"
use_field_init_shorthand = true
use_try_shorthand = true
wrap_comments = true
Loading