データパイプラインの概形を作る #63
Merged
データパイプラインの概形を作る #63
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Codecov ReportAttention:
Additional details and impacted files
📢 Thoughts on this report? Let us know! |
ciscorn
force-pushed
the
feature/pipeline-outline
branch
2 times, most recently
from
e24f26f to
c1f72d2
Compare
ciscorn
force-pushed
the
feature/pipeline-outline
branch
from
c1f72d2 to
3682a66
Compare
ciscorn
force-pushed
the
feature/pipeline-outline
branch
from
34f9951 to
f58fddd
Compare
ciscorn
commented
Dec 14, 2023
ciscorn
commented
Dec 14, 2023
ciscorn
commented
Dec 14, 2023
ciscorn
force-pushed
the
feature/pipeline-outline
branch
from
142a9e8 to
a83dc76
Compare
ciscorn
added a commit
that referenced
this pull request
Dec 27, 2023
See #44 データ処理パイプライン `[Source (Input)] ==> [Transform] ==> [Sink (Output)]` の概形を作りました。 - Source や Sink から Controller にフィードバック（エラー、進捗状況、etc.）を送る仕組みも実装してあります。 - パイプラインを停止する（ユーザなどがキャンセルする）仕組みも備えています。 - Source や Sink のための Configurations の仕組みのなんとなくの大枠を用意してありますが、具体的な実装はまだありません。 テストは、「パイプライン走らせて、途中でキャンセルする」ことだけしている。test coverage: <img width="356" alt="Screenshot 2023-12-14 at 14 26 15" src="https://github.com/MIERUNE/nusamai/assets/5351911/e9ab9324-e770-4803-af32-25e529afa7ee"> Closes: #44
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See #44
データ処理パイプライン
[Source (Input)] ==> [Transform] ==> [Sink (Output)]の概形を作りました。テストは、「パイプライン走らせて、途中でキャンセルする」ことだけしている。test coverage:
Closes: #44