Code

WIP: New queue#39

Code

Closed

davidwaroquiers wants to merge 110 commits intomainMatgenix/jobflow-remote:mainfrom queueMatgenix/jobflow-remote:queueCopy head branch name to clipboard

+14,259-59

Commits

Commits on May 17, 2023

• First minimal working implementation

  gpetretto

  committed
  2aa2bbb

• add submit function

  gpetretto

  committed
  e7be6ca

Commits on May 22, 2023

• revised configurations

  gpetretto

  committed
  b0216c2

Commits on May 24, 2023

• first daemon implementation based on supervisor

  gpetretto

  committed
  a9c82ab

Commits on Jun 1, 2023

• refactor modules, JobController and CLI

  gpetretto

  committed
  b96f9ea

Commits on Jun 2, 2023

• Added dependencies in pyproject.toml.

  davidwaroquiers

  committed
  161872f

• updates on queries and CLI

  gpetretto

  committed
  7cb1abc

Commits on Jun 5, 2023

• move remote document inside Firework document

  gpetretto

  committed
  a370bee

• more functionalities and bug fixes

  gpetretto

  committed
  7618341

Commits on Jun 6, 2023

• improve check_run_status and more CLI

  gpetretto

  committed
  0f43a33

Commits on Jun 9, 2023

• helper to generate configuration

  gpetretto

  committed
  cccf38c

Commits on Jun 12, 2023

• more refactoring of configuration

  gpetretto

  committed
  daa2ce3

Commits on Jun 13, 2023

• refactor project cli

  gpetretto

  committed
  28d5df7

• Merge remote-tracking branch 'origin/config_deps' into worker

  gpetretto

  committed
  0f8b9e9

Commits on Jun 16, 2023

• more CLI options

  gpetretto

  committed
  287f00d

• Merge pull request #1 from Matgenix/config

  gpetretto

  authored
  38570dc

Commits on Jun 18, 2023

• refactor exec config and typer error handling

  gpetretto

  committed
  278fddb

• Merge branch 'config' into develop

  gpetretto

  committed
  6d8a9ff

Commits on Jun 21, 2023

• more CLI. fix FW task

  gpetretto

  committed
  54ff0ea

Commits on Jun 28, 2023

• update remote host

  gpetretto

  committed
  568a6dc

Commits on Jun 30, 2023

• improve cli

  gpetretto

  committed
  3382890

Commits on Jul 3, 2023

• optional warnings in ConfigManager

  gpetretto

  committed
  4349881

Commits on Jul 4, 2023

• document configuration options and revise RemoteWorker

  gpetretto

  committed
  ded7c13

• get_jobstore function

  gpetretto

  committed
  a42c058

Commits on Jul 8, 2023

• Temporarily add qtoolkit as git dependency

  ml-evs

  committed
  a6235cc

• Use default/first worker if not passed to submit function

  ml-evs

  committed
  eceb1a5

• Add simple usage instructions (need checking)

  ml-evs

  committed
  f85d4c1

• Use strict jobflow deps to avoid pydantic errors

  ml-evs

  committed
  4443d43

Commits on Jul 10, 2023

• Add .DS_store to gitignore

  gpetretto

  committed
  5345de6

• enforce connecting of the remote host

  gpetretto

  committed
  a814ca3

• Pin to the development jobflow

  ml-evs

  committed
  80b130e

• Remove incorrect usage docs

  ml-evs

  committed
  8c768fd

Commits on Jul 11, 2023

• restart connection for remote host if connection is dropped

  gpetretto

  committed
  e3bae86

• Enable ConfigManager warnings for jf project check

  ml-evs

  committed
  49f1450

Commits on Jul 12, 2023

• add run time information

  gpetretto

  committed
  a6f8915

• Handle case that date in fw dict is already a date

  ml-evs

  committed
  059e2c8

• Use string datetime when pinging jobs

  ml-evs

  committed
  a3f796e

Commits on Jul 17, 2023

• Merge pull request #7 from ml-evs/develop

  Show description for 92bffd8
  davidwaroquiers

  authored
  92bffd8

• Added documentation structure.

  davidwaroquiers

  committed
  9886e44

Commits on Jul 19, 2023

• cli message for global options

  gpetretto

  committed
  9917104

Commits on Jul 24, 2023

• fix FlowInfo for string updated_on

  gpetretto

  committed
  c1d0b96

Commits on Aug 3, 2023

• Move fallback worker config up to submit function

  ml-evs

  committed
  2539e79

• Do not allow null workers when constructing a firework

  ml-evs

  committed
  52eb795

Commits on Aug 14, 2023

• Merge pull request #12 from ml-evs/ml-evs/fix

  Show description for 593224a
  gpetretto

  authored
  593224a

• improve CLI, include allow_external_references

  gpetretto

  committed
  808ca4a

Commits on Aug 16, 2023

• disable job_ids options in the CLI

  gpetretto

  committed
  8d32d9f

• Add work_dir checker to project check CLI

  Show description for 87c0753
  ml-evs

  committed
  87c0753

• Use Path for remote operations to deal with spaces in dir names

  ml-evs

  committed
  5476690

• Add validator for absoluteness of work_dir

  ml-evs

  committed
  d1298ef

• Format error_job the same way as error_remote

  ml-evs

  committed
  a325d6d

Commits on Aug 18, 2023

• Merge pull request #15 from ml-evs/ml-evs/fix

  Show description for 5e6d494
  gpetretto

  authored
  5e6d494

Commits on Aug 19, 2023

• restore queries based on job id

  gpetretto

  committed
  ae9d83e

Commits on Aug 21, 2023

• Fixed jf flow list.

  davidwaroquiers

  committed
  0bf90b5

• Fixed state query in jobcontroller.

  davidwaroquiers

  committed
  fe03b05

Commits on Aug 22, 2023

• more fix for id based searches

  gpetretto

  committed
  b29c55a

• Merge pull request #17 from Matgenix/job_id

  Show description for a606cc6
  gpetretto

  authored
  a606cc6

• Merge pull request #18 from Matgenix/flow_info

  Show description for ff4b2ed
  gpetretto

  authored
  ff4b2ed

• Merge pull request #9 from Matgenix/docs_template

  Show description for 07c20e5
  davidwaroquiers

  authored
  07c20e5

Commits on Aug 23, 2023

• fix flow query for ONGOING state

  gpetretto

  committed
  49b82a2

• Added STOPPED and CANCELLED Job States.

  Show description for 24d2eda
  davidwaroquiers

  committed
  24d2eda

• Fixed flow queries by state for STOPPED and FAILED.

  davidwaroquiers

  committed
  279f79c

Commits on Aug 24, 2023

• Merge pull request #22 from Matgenix/stopped_cancelled_states

  Show description for e4cb1e4
  gpetretto

  authored
  e4cb1e4

• jf flow info and other cli updates

  gpetretto

  committed
  994ed7f

Commits on Aug 25, 2023

• fix job query

  gpetretto

  committed
  ff181ba

Commits on Aug 28, 2023

• modify name search field

  gpetretto

  committed
  9605bf6

• Merge pull request #23 from Matgenix/flow_info

  Show description for c48634b
  gpetretto

  authored
  c48634b

Commits on Aug 29, 2023

• fix query with aggregation

  gpetretto

  committed
  5c63247

Commits on Sep 5, 2023

• fix query by name

  gpetretto

  committed
  434becc

Commits on Sep 15, 2023

• more filtering options for CLI

  gpetretto

  committed
  7bcd12e

Commits on Sep 18, 2023

• tune start date search in CLI

  gpetretto

  committed
  c77029c

Commits on Sep 21, 2023

• fix typo

  

  Fabian Peschel

  committed
  87fbb80

• Merge pull request #25 from FabiPi3/fix_typo

  Show description for 0ccbd98
  gpetretto

  authored
  0ccbd98

• Run CI on PRs to develop branch

  ml-evs

  committed
  b1edf7f

Commits on Sep 22, 2023

• set full path for queue files

  gpetretto

  committed
  0d539fe

Commits on Sep 26, 2023

• Merge pull request #28 from ml-evs/ml-evs/tweak_CI

  Show description for 92f9a57
  davidwaroquiers

  authored
  92f9a57

Commits on Sep 28, 2023

• pydantic2 updates

  gpetretto

  committed
  a077df4

Commits on Oct 10, 2023

• Use the qtoolkit and jobflow PyPI packages, add direct pydantic dep (#31)

  Show description for 37124c3
  ml-evs

  authored
  37124c3

• Fix CI trigger config

  ml-evs

  committed
  1cfc5b8

Commits on Oct 11, 2023

• Linting fixes and CI config for multiple Python 3.9+ (#34)

  Show description for 3542a70
  ml-evs

  authored
  3542a70

• add index to the folder name

  gpetretto

  committed
  d8aa3c1

• Merge branch 'develop' into pydantic2

  gpetretto

  committed
  e6b4d33

• Merge branch 'develop' of github.com:Matgenix/jobflow-remote into pydantic2

  gpetretto

  committed
  2d98143

• fix settings for python 3.9

  gpetretto

  committed
  5fe779f

Commits on Oct 12, 2023

• Merge pull request #35 from Matgenix/fix_index

  Show description for ce590bb
  gpetretto

  authored
  ce590bb

Commits on Nov 10, 2023

• New queue handling

  gpetretto

  committed
  d37a417

• Merge branch 'develop' into queue

  gpetretto

  committed
  0f1d96e

• Merge remote-tracking branch 'origin/develop' into queue

  gpetretto

  committed
  e2429a9

• Merge branch 'pydantic2' into queue

  gpetretto

  committed
  a60d5c5

• fix retry

  gpetretto

  committed
  20b9c33

Commits on Nov 14, 2023

• fix py3.9

  gpetretto

  committed
  7751ed3

Commits on Nov 15, 2023

• split runner execution

  gpetretto

  committed
  d01d71c

Commits on Nov 16, 2023

• implement max_jobs per worker. switch to schedule package. Fix for split and pydantic2

  gpetretto

  committed
  d21d8ad

Commits on Nov 21, 2023

• first implementation of batch submission

  gpetretto

  committed
  13dc947

Commits on Nov 22, 2023

• fixes and updates

  gpetretto

  committed
  e050ba0

Commits on Nov 23, 2023

• fix export typing

  gpetretto

  committed
  4c81cde

Commits on Nov 27, 2023

• fix dynamic flow. Add graph utils

  gpetretto

  committed
  79a05de

Commits on Nov 29, 2023

• some fix and test dash graph app

  gpetretto

  committed
  2b32951

Commits on Dec 7, 2023

• fix dynamics flow and more graphs

  gpetretto

  committed
  138a7b1

Commits on Dec 8, 2023

• fix cli bug and add docstrings

  gpetretto

  committed
  d6ec17c

Commits on Dec 11, 2023

• Avoid Job deserialization in Runner.

  gpetretto

  committed
  e6b5a8c

Commits on Dec 12, 2023

• fix date inizialization

  gpetretto

  committed
  1a664cc

• Merge branch 'queue' into references

  gpetretto

  committed
  818f015

• fix db_id in output's metadata

  gpetretto

  committed
  74507b7

• fix output

  gpetretto

  committed
  8d0e824

Commits on Dec 13, 2023

• more docstrings

  gpetretto

  committed
  33ba565

Commits on Dec 20, 2023

• Documentation initial version

  gpetretto

  committed
  478ada9

• Merge branch 'references' into queue

  gpetretto

  committed
  be342ae

Commits on Dec 22, 2023

• breaking: change db_id type to str

  gpetretto

  committed
  2c383f6

• breaking: rename CANCELLED JobState to USER_STOPPED and the related methods accordingly

  gpetretto

  committed
  328c6df

• more documentation

  gpetretto

  committed
  f2ddac4