1.6.129 (2023-05-18)
1.6.128 (2023-05-17)
1.6.127 (2023-05-17)
- pyright issues (967278d)
1.6.126 (2023-05-14)
- add pre_script and post_script to dispatcher executor (bba57ff)
1.6.125 (2023-05-12)
- add shuffle to slices group (7cb23f0)
1.6.124 (2023-05-12)
- undefined wfdir in debug mode (875f1e4)
1.6.123 (2023-05-05)
- add sub, mul and truediv methods to ArgoVar (469ef6d)
- prepend workflow id to step id in debug mode (469ef6d)
1.6.122 (2023-05-05)
- raise error on missing module when jsonpickle.loads (aec5bbe)
1.6.121 (2023-05-04)
- handle str when passing dict of parameters (e45b40a)
1.6.120 (2023-05-04)
- move V1alpha1RetryStrategy to convert_to_argo method (8f764a9)
1.6.119 (2023-04-26)
- support for submitting workflow with ID (4bd2f84)
1.6.118 (2023-04-26)
- optimize group_size when with_param is argo_range (068dd53)
1.6.117 (2023-04-24)
- support for using local singularity image (ebf9595)
1.6.116 (2023-04-23)
- handle dependencies of task for passing a dict of parameters/artifacts (4be10d8)
1.6.115 (2023-04-23)
- support for passing a dict or list containing ArgoVar (be5fe8d)
1.6.114 (2023-04-22)
- a bug in dict argument of artifacts (4447fe5)
1.6.113 (2023-04-22)
- support for pass a dict of artifacts as argument for a step (9431af0)
1.6.112 (2023-04-19)
- close stdin after write input in run_command (f6b651f)
1.6.111 (2023-04-19)
- set PYTHONUNBUFFERED=true to output real-time log in dispatcher executor (d912e0d)
1.6.110 (2023-04-18)
- triple quotes in user's script (b9114a7)
1.6.109 (2023-04-17)
- support for HTTP artifact (cf772eb)
1.6.108 (2023-04-17)
- escaping in dispatcher executor (5cd833a)
1.6.107 (2023-04-13)
1.6.106 (2023-04-13)
- subpath slices for optional artifact (123ecb8)
1.6.105 (2023-04-07)
1.6.104 (2023-04-05)
- remove duplicated path in init-artifact of sub-path mode (3a6591a)
1.6.103 (2023-04-05)
- sub_path argument of download_artifact (cc447d3)
1.6.102 (2023-04-03)
- convert OP template to launching parser (895a938)
1.6.101 (2023-04-03)
- convert OP to launching parser (571acf7)
1.6.100 (2023-03-29)
- reusing sliced steps in sub-path mode (49c178d)
1.6.99 (2023-03-28)
- inconsistent behaviors between oss and s3 (f7403f2)
- path returned by download_artifact when slice is provided (58449a7)
1.6.98 (2023-03-28)
- waiting old pod to be deleted before post the new pod in the replay (afd92c7)
1.6.97 (2023-03-25)
- missing **kwargs in run_command (a68c588)
1.6.96 (2023-03-25)
- always deepcopy template before run (af6b3b4)
1.6.95 (2023-03-25)
- workaround dpdispatcher will not generate task hash again after modifying task (7c7a2f0)
1.6.94 (2023-03-24)
1.6.93 (2023-03-24)
- do not find download file in local context (566fff9)
- support for container template in dflow submit (566fff9)
1.6.92 (2023-03-24)
- add dflow submit (f9b1569)
- parse Workflow from yaml (f9b1569)
- skip existed dir when downloading in local context (18ab3bc)
1.6.91 (2023-03-22)
- local context of dispatcher does not support wildcard in backward files (5a4566d)
1.6.90 (2023-03-21)
- NoneType has no attribute output_parameter (0243155)
1.6.89 (2023-03-21)
- key of merged sliced step conflicted with key of artifact in debug mode (80589c9)
- update tutorials (a200bba)
1.6.88 (2023-03-21)
- success_ratio with merge_sliced_step (14d8860)
1.6.87 (2023-03-20)
- {{item}} in key when merge sliced step (c7b3cb6)
- overwrite sliced output parameter when merge sliced step (c7b3cb6)
1.6.86 (2023-03-19)
- add command line tools (0cf8155)
1.6.85 (2023-03-17)
- bug in slice super OP (44b5be2)
1.6.84 (2023-03-17)
- 'NoneType' object has no attribute 'register_workflow' (e8a15a7)
1.6.83 (2023-03-16)
- add get_artifact_metadata to MetadataClient, init S3Artifact with urn (32fa20d)
- dispatcher executor pass env var ARGO_TEMPLATE from local to remote (32fa20d)
1.6.82 (2023-03-16)
1.6.81 (2023-03-15)
1.6.80 (2023-03-15)
- support get item of artifact combined with Slices (7455632)
1.6.79 (2023-03-15)
- restrict version of typeguard<3 (dba9359)
1.6.78 (2023-03-15)
1.6.77 (2023-03-15)
- copy bug in dispatcher executor (9258223)
1.6.76 (2023-03-14)
- get step key or workflow name in OP (c37c6e7)
1.6.75 (2023-03-13)
- a bug in assemble_path_nested_dict (d56cef6)
- add add to ArgoVar (d56cef6)
- get item which is a parameter of artifact (d56cef6)
- pass ArgoVar to when (d56cef6)
1.6.74 (2023-03-10)
- get item of artifact in debug mode (48706b0)
1.6.73 (2023-03-09)
- avoid repeated deepcopy (4b651fe)
1.6.72 (2023-03-09)
- support for pass items of artifact as arguments (da9b75a)
1.6.71 (2023-03-07)
- remove node name before replay a step (5c53812)
1.6.70 (2023-03-02)
- pass backward_files to dispatcher Bohrium input_data (e31e749)
1.6.69 (2023-03-02)
- clean up useless codes (b908314)
1.6.68 (2023-03-02)
- behavior of directories when downloading sliced artifact (f0ec731)
- dynamically render if expression (f0ec731)
- warnings of unclosed socket (f0ec731)
1.6.67 (2023-03-01)
- reusing sliced steps followed by reusing sliced step in the same group (a5cdb3a)
1.6.66 (2023-03-01)
- Can't get attribute 'try_to_execute' on Mac (74d6841)
- context in debug mode (74d6841)
- continue_on_success_ratio and continue_on_num_success in debug mode (74d6841)
1.6.65 (2023-03-01)
- add group to dynamic resource (4b6ce4a)
1.6.64 (2023-02-28)
- move debug tests to the directory tests (c25f984)
- set node to phase running after replay a step (c25f984)
- step.workflow is None in debug mode (c25f984)
- use if_expression explicitly to ensure the same behavior in both default and debug modes (c25f984)
1.6.63 (2023-02-28)
- big parameter passed in debug mode (c7a03a7)
1.6.62 (2023-02-27)
1.6.61 (2023-02-24)
- wrong value of output parameter of step (bbbc6d4)
1.6.60 (2023-02-24)
- support for expressions in values of parameters (902f4ed)
1.6.59 (2023-02-24)
- do not copy reused artifact for default (2fa94ed)
1.6.58 (2023-02-23)
- allow None in List[Path] when checking types of artifact (b5b6033)
- support for login with phone number for bohrium (b5b6033)
1.6.57 (2023-02-22)
- add pre_script and post_script (fa0319d)
- dflow_success_tag cannot stat in dispatcher executor (fa0319d)
1.6.56 (2023-02-21)
- create secert with http headers (5f384cd)
1.6.55 (2023-02-21)
- pass env vars in dispatcher executor (806c0dd)
1.6.54 (2023-02-21)
- support for artifact with nested dict of path (da78171)
1.6.53 (2023-02-16)
- bug of merge_sliced_step in debug mode (b364277)
1.6.52 (2023-02-16)
- support for handling multi slices in one dispatcher job (5de1157)
1.6.51 (2023-02-16)
- upgrade (4ddab4c)
1.6.50 (2023-02-16)
- big parameter string null bug (f9925c2)
- Support BigParameter default value on local machine
1.6.49 (2023-02-15)
- deprecate lebesgue executor (0a68cb9)
- one task not failing the whole group when pool_size used (0a68cb9)
1.6.48 (2023-02-14)
1.6.47 (2023-02-13)
- add API for creating bohrium job group ID (772ad4d)
- process cannot pass dflow configs (77febb9)
- support for expression of loop item (12c58c9)
- support for slicing big parameter (772ad4d)
1.6.46 (2023-02-10)
- jsonpickle.loads failed in bohrium executor (24a603e)
1.6.45 (2023-02-10)
- save key-id mapping for super OP (fd18d0e)
1.6.44 (2023-02-09)
- fix dispatcher bohrium cannot sync log (119e91c)
1.6.43 (2023-02-09)
1.6.42 (2023-02-07)
- let argument override default value of big parameter (22db61b)
1.6.41 (2023-02-06)
- add API query_global_outputs (b96922d)
- prepend dflow_bigpar_ to global name of parameter saved as artifact (b96922d)
1.6.40 (2023-02-06)
- downgrade for query_step_by_key (8485582)
- save key2id map in global outputs, add query_step_by_key (af64ea0)
- support default value of big parameter (af64ea0)
1.6.39 (2023-02-03)
- support group_size for debug mode (5adc44c)
1.6.38 (2023-02-03)
1.6.37 (2023-02-02)
- set default mode to None for input artifacts (477f9d6)
1.6.36 (2023-02-02)
- set default mode to 755 for input artifacts (275b03d)
1.6.35 (2023-02-01)
- add group_size feature for slices (374e244)
1.6.34 (2023-01-31)
- add oss storage client (70c8950)
- add warns for handling argo objects (70c8950)
- support dict of path for artifact (70c8950)
1.6.33 (2023-01-29)
- add argument interactive to run_command (f7bd903)
1.6.32 (2023-01-20)
- sys.stdin.encoding -> sys.stdout.encoding (f531786)
- workaround for unavailable exit code of Bohrium job; (f531786)
1.6.31 (2023-01-18)
- use bash -ic instead of bash -lc (280b7b1)
1.6.30 (2023-01-17)
- continue on number/ratio skip errors (4b18efa)
1.6.29 (2023-01-17)
- add try_bash to run_command (ae1b77c)
1.6.28 (2023-01-07)
1.6.27 (2023-01-04)
- continue_on_success_ratio used with executor (e1f61ae)
1.6.26 (2023-01-03)
- duplicate template name when multiple continue_on_success_ratio used (3187ac6)
- enhance performance of querying and reusing (3187ac6)
1.6.25 (2022-12-31)
- no share path for non-dp user (ad71a77)
1.6.24 (2022-12-30)
- unclosed file ResourceWarning (2e61ef1)
1.6.23 (2022-12-28)
- ArgoStep deepcopy input dict (47ca63d)
1.6.22 (2022-12-28)
- ArgoStep not idempotent (ac255bb)
1.6.21 (2022-12-28)
- ArgoStep not idempotent (21e4628)
1.6.20 (2022-12-27)
- enhance query_step efficiency (3c5bd34)
1.6.19 (2022-12-27)
1.6.18 (2022-12-20)
- output parameter has no attribute path (95920d3)
1.6.17 (2022-12-15)
1.6.16 (2022-12-15)
- support for config from env var (1fff9f2)
1.6.15 (2022-12-14)
- path on windows: use raw string to make the cross-platform path behaviors right. (0b28521)
1.6.14 (2022-12-09)
- remove unecessary **kwargs (35f1dee)
- support for registering first slice only in lineage (35f1dee)
- support storage to argo gateway (4ba49f2)
1.6.13 (2022-12-08)
- add HTTP headers to config (a2573ff)
- create secret for env var (547dcaa)
- support for env from a source (12cd852)
- support for treating input artifact as non-archived file (a2573ff)
1.6.12 (2022-12-04)
- support Steps template for continue_on_num_success and continue_on_success_ratio (d1ce485)
1.6.11 (2022-12-02)
- add extra prefixes ignored by S3Artifact auto-prefixing (2e3ce02)
- replace github link with gitee link in install-*.sh (2e3ce02)
- support for pass list of artifacts to input artifact (b12c62e)
1.6.10 (2022-11-30)
- add debug info for workflow manifest (5ca6fa7)
- add if name == 'main': to Python OP (5ca6fa7)
- add to_dict, to_json, to_yaml methods to workflow (56ccf13)
- find function OPs (56ccf13)
1.6.9 (2022-11-21)
- use render_script method to map /tmp to /Users/x.liu/workflows/dflow/tmp for PythonOPTemplate (77a50a6)
1.6.8 (2022-11-21)
- bohrium in dispatcher executor (2c19211)
1.6.7 (2022-11-18)
1.6.6 (2022-11-18)
- add argo_sum and argo_concat (487349f)
- add register_output_artifacts for step (e047cf4)
- create secret for private registry (e047cf4)
- debug mode: mimic argo's behavior on output parameter of parallel steps (35f7f99)
- enhance error message of bohrium client (615f4c0)
- enhance function OP (6c92799)
- no prefix when user use S3Artifact() (7d17af3)
- support for always passing root path of artifact (e9257fa)
1.6.5 (2022-11-11)
- add download method to S3Artifact (6c2150a)
- add to_dict and from_dict methods to S3Artifact (e999917)
- bug in collecting output parameters of sliced step (a84f840)
- download S3Artifact (adfd046)
- support for setting bohrium url for bohrium executor (a84f840)
1.6.4 (2022-11-04)
- get k8s client when used (c1b3470)
1.6.3 (2022-11-04)
- future len of input parameter (7fd6f13)
1.6.2 (2022-11-02)
- parse repo info from configmap (f1aab93)
1.6.1 (2022-11-01)
- a bug in sliced super op (e1bf3a0)
- add bohrium storage client (8c7092c)
- support for sliced python op in sliced super op (e1bf3a0)
- support for storage plugins (8c7092c)
1.6.0 (2022-10-26)
- introduce bohrium plugin which provide realtime log and adapt bohrium platform (9296a3f)
1.5.14 (2022-10-19)
- add readme for debug mode (151130c)
- enhance error message (f009607)
- port-forward --address 0.0.0.0 in readme (f009607)
- slice by group in debug mode (f009607)
1.5.13 (2022-10-13)
- support for python3.7 in debug mode (6d7d971)
1.5.12 (2022-10-13)
1.5.11 (2022-10-13)
- a typo (c93235f)
- add comments for config and s3_config (358d4f1)
- add pool_size for slices (7fe9d8c)
- add utils for find OPs in a package (358d4f1)
- consistent APIs for default mode and debug mode (2e8f5cf)
- format error some lines are too long (06f4dd5)
- omit queue_name if it is None in dispatcher executor (2438c6c)
- pass n_total explicitly in continue_on_success_ratio (2438c6c)
- raise Exception when a parameter passed to a big parameter, vice versa (2e8f5cf)
- save info of Steps/DAG in debug mode (93784c2)
- support for download slices and modify slices in debug mode (fb1da44)
1.5.10 (2022-10-03)
1.5.9 (2022-10-03)
1.5.8 (2022-09-28)
- raise FileNotFoundError when downloading an artifact without key (615a934)
- replace python command to python3 (9c6772a)
- save uid after submission (c696f1d)
- some bugs of dispatcher executor (9c6772a)
- support for local mode of dispatcher (9c6772a)
1.5.7 (2022-09-24)
- add image pull secrets for workflow (df69681)
- refact FutureLen, add FutureRange (99730e2)
- support for skipping same files while downloading (df69681)
1.5.6 (2022-09-22)
- add methods for OP to get s3 key/link of input/output artifacts (8a12911)
- add slurm docker cluster for autotests (ef60d79)
1.5.5 (2022-09-20)
1.5.4 (2022-09-19)
- support parallelism for a parallel step other than sliced step (d62de45)
1.5.3 (2022-09-19)
- support for any private key file name (ded49c9)
1.5.2 (2022-09-18)
- add parallelism for sliced step (e620285)
- support dag of sliced tasks in debug mode (bddfbac)
- support debug mode for executor (2cfc37b)
- use process instead of thread (2612f6e)
- wait process by queue.get() (ff27daf)
1.5.1 (2022-09-16)
- mixed mode for lebesgue executor (9fe9490)
1.5.0 (2022-09-07)
- syntax-sugar: Offer
withcontext syntax for workflow, dag. (898d4e3)
- can set slices for PythonOPTemplate after initialization (81a1f43)
- pass save_as_aritfact for value_from_expression (26cb790)
- remove duplicate export class: S3Artifact (5f4198d)
- restore availability of download_sliced_output_artifact (9441971)
1.4.0 (2022-09-04)
- expose plugin dependencies class and utils for better extensibility (5a0c349)
- a bug of handling multiple big parameters (e8c35c1)
- add parallelism to steps and dag (dc3ec98)
- avoid double rendering of output parameter which refers to the input parameter of the same template (96a4e2e)
- decrease time cost of query keys (d546ad5)
1.3.1 (2022-09-01)
- getitem of ArgoVar handle non-string items (08f4336)
- add method render_script to PythonOPTemplate (8b2cb4d)
- add pod GC strategy (4b85f90)
- skip uploading non-existing files in dispatcher executor (65b7730)
1.3.0 (2022-08-10)
- Init Container: Support init_container in op_template. (77264b2)
- Ray Executor: Ray executor with dependencies settings. (7695ad8)
1.2.7 (2022-08-07)
- add image_pull_policy for util images (d08c0ac)
1.2.6 (2022-08-05)
- add sub_path and slice to download_artifact (de9148b)
- data persistent for minio (de9148b)
- handle big parameters of failed step (de9148b)
1.2.5 (2022-08-03)
- add envs to script op template (8ef468a)
- add workflow actions: terminate, delete, resubmit, resume, retry, stop, suspend (8ef468a)
1.2.4 (2022-08-01)
- add type to query conditions of workflow steps (7528151)
- avoid variable expansions in cat EOF (7528151)
- decoding error when read source file of OP (7528151)
- merge envs in dispatcher executor (7528151)
1.2.3 (2022-07-27)
1.2.2 (2022-07-27)
- call ArgoWorkflow.get_step for multiple times (450cd16)
- change query step by name from fuzzy query to exact query (450cd16)
- IfExpression: transfer to right string. (aee507f)
- RFC 1123 of step name (450cd16)
- save each reused step into a single configmap to avoid 1MB limit (450cd16)
- support for query step by a list of conditions (450cd16)
1.2.1 (2022-07-24)
- fix a bug of Path(None) (0920062)
1.2.0 (2022-07-24)
- add developer guide (93f161d)
- add server-side installation script for Linux (93f161d)
- make ArgoVar uniterable (93f161d)
- cannot pickle types in typing (691dc57)
- fix a bug of path on Windows (93f161d)
- handle big parameter whose name changes (7513567)
- jsonize parameters before reusing (7ff8272)
- line break in input parameter of Python OP (ae8d11d)
- readme: fix import typo in README (55f51a0)
- reused step does not have outputs (8abb67d)
- step.outputs has no exitCode (b98a635)
- the conflict between input parameter of Python OP and dispatcher script (c3981fb)
- add cloudpickle to dependencies
- add server-side installation script for Mac
- Lebesgue supports for mixed executor
- add container mode (docker, singularity or podman) to slurm remote executor, dispatcher executor and wlm executor.
- query archived workflows
- fit wlm for new features
- add getitem to ArgoVar
- support for defining OP in the interactive mode (e.g. jupyter notebook)
- a catalog dir instead of catalog files for artifacts
- a better solution for subpath slices
- add save_path_as_artifact to handle large path lists
- improve uploading python packages
- compatible for python 3.5
- fix format problems
- add test examples
- copy_artifact supports for sort
- support for successive sub-path slices steps
- support for path of output artifact referring to path of input artifact in sub-path slices
- update path list of S3Artifact when used
- add type hints
- add interactive mode for Lebesgue's login
- add maximum parallelism for workflows
- add set_directory and run_command to utils
- modify the interface with Lebesgue
- add Parameter type sign for Python OP
- add username and password authentication for Lebesgue executor
- add global config archive_mode
- fix: local config does not take effect for remote OP
- fix: dflow_dflow_private_key_path_list was not supplied
- support for DAG
- add catalog_file_name to configuration
- support for passing OP object instead of a derived class of OP to PythonOPTemplate
- add util_command argument to Step
- save path_list as parameter for each artifact
- add sub_path mode for slices
- add some verifications
- prevent mapping relative path repeatedly in dispatcher
- support for a sliced step outputing a list of paths with a single slice
- fix file processing on Windows
- modify interface of resource requests and limits
- fix: the conflict between input parameter of Python OP and dispatcher script
- fix: line break in input parameter of Python OP
- support for parallel step and sliced step
- support for using Python OP without dflow in the image
- fix a typo in io
- dicts override json_file in dispatcher executor
- allow for returning None for output artifact in OP
- work around Argo pod id != step id for slices and slurm job template
- support for id_rsa, id_dsa, id_ecdsa, id_ed25519
- fix \n in code for dispatcher executor
- handle io in slurm remote executor
- work around pod id != step id
- fix: parameter has no attribute value
- map /tmp to pwd/tmp in slurm job
- add dispatcher executor
- with_param receives python list
- fix: jsonize parameters before reusing
- fix: handle big parameter whose name changes
- use str instead of jsonpickle to store parameter types
- fix: cannot pickle types in typing
- fix a bug in 1.0.15
- record parameter type in parameter description
- handle big parameters in query step and reuse step
- name of OP template be optional
- add not allowed input artifact path
- not use pvc in slurm remote executor for default
- auto build docs to branch docs
- add retry for all actions in slurm remote executor
- support for use private key on node for SSH connection
- force lowercase for OP template to fix RFC 1123
- add private key option for SSH connection
- add container mode for remote Slurm executor
- add docs
- add global configurations
- modify lebesgue interfaces
- request kubernetes API server with token
- add Lebesgue plugins
- add resources requirements for templates
- support for slurm template for slices
- fix a bug in sliced step
- handle empty sliced step
- add BigParameter
- retain empty dir
- optimize opening file descriptors
- add SlurmJobTemplate to submit slurm job by using wlm-operator
- download_artifact returns path list
- add convert_to_argo method to Workflow
- add resource template
- add some manifests
- add some arguments to PVC
- restrict argo-workflows==5.0.0
- add comments doc
- initial release