Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feat dsi_pyworker #559

Merged
merged 70 commits into from
Dec 10, 2024
Merged

Feat dsi_pyworker #559

merged 70 commits into from
Dec 10, 2024

Conversation

rhugman
Copy link
Contributor

@rhugman rhugman commented Dec 6, 2024

  • relies on JDub's PR pest and pest++ output getters #557
  • added dsi_pyworker() to helpers
  • switched dsi tests in la_tests to use the pyworker
  • painted everything with red stripes for extra speeeeddddd

@jtwhite79
initial gpr setup helper
3be6bcd
@jtwhite79
Merge branch 'develop' of https://github.com/pypest/pyemu into feat_gpr
c7ee665
@jtwhite79
more work on gpr prototype
69570d0
@jtwhite79
more work on gpr emulator
aa3cc50
@jtwhite79
more gpr
ea7edbd
@jtwhite79
more dev and exp with gpr
b5bb086
@jtwhite79
Merge branch 'develop' of https://github.com/pypest/pyemu into feat_gpr
b56ab81
@jtwhite79
more thresh testing
60433cc
@jtwhite79
env
e1755e0
@jtwhite79
xfer pi from base to gpr interface
006d523
@jtwhite79
merge
f9ba3c7
@jtwhite79
starting on py worker
6dee76a
@jtwhite79
starting on py worker
542348a
@jtwhite79
more
a781836
@jtwhite79
initailization rough'd in
26965fd
@jtwhite79
more
126bcfd
@jtwhite79
refactor to listen fxn, prep for threading
91a0f99
@jtwhite79
more
c8b0774
@jtwhite79
merge
c78377c
@jtwhite79
fix for long names in a binary file
613385c
@jtwhite79
Merge remote-tracking branch 'origin/feat_ppu3' into feat_gpr
85907a2
@jtwhite79
merge
1338d47
@jtwhite79
test undo to_coo
274e29b
@jtwhite79
merge ppu3
29f5de5
@jtwhite79
Merge branch 'feat_ppu3' of https://github.com/jtwhite79/pyemu into f…
df4f5f5 
…eat_gpr
@jtwhite79
Merge branch 'feat_ppu3' of https://github.com/jtwhite79/pyemu into f…
87a30f6 
…eat_pyworker
@jtwhite79
added initial placeholder pypestworker invest function
fe3609c
@jtwhite79
working on gpr tests
e725bfc
@jtwhite79
added gpr notebook
3d7d00b
@jtwhite79
more work on hosaki
9ecef8b
jtwhite79 and others added 26 commits November 27, 2024 10:25
@jtwhite79
added multiple pyworker test
b8b4ef9
@jtwhite79
more work on pyworker test
e5b191f
@jtwhite79
timeout
04a16c5
@jtwhite79
longer default timeout, removed start_workers from pyworker test to a…
699a6ea 
…void conflicts with other tests
@jtwhite79
added try-catch-reconnect
d53baf8
@jtwhite79
fix
f22d6a8
@jtwhite79
fix
aeff898
@jtwhite79
working on ppw gpr worker
4a440e5
@jtwhite79
added gpr ppw test:
c222aaa
@jtwhite79
more work on gpr ppw fxn
1afb43d
@jtwhite79
added ppw options to start_workers
cc99529
@jtwhite79
reworked gpr notebook to use ppw, omg sooo much better
b23c72b
@jtwhite79
even longer timeout for ends tests
56a26a2
@jtwhite79
a few tweaks to the gpr hosaki notebook
a27144d
@jtwhite79
fix for notebook with really short runs being timed out
7608321
@jtwhite79
time out protection in zdt1 gpr test
487c57d
@jtwhite79
less mem in ac draw test
4fc0ab1
@jtwhite79
more test opt
b424194
@jtwhite79
trying again
b1fa1e2
@jtwhite79
turning off constr gpr test for now
4d62ba8
@jtwhite79
update get_pestpp test
2611706
@jtwhite79
more work on get_pestpp for mac:
bdaee9a
@rhugman
comment out print funx
ef54cc3
@rhugman
Merge branch 'feat_pyworker' of https://github.com/jtwhite79/pyemu in…
d1c7cad 
…to feat_pyworker
@rhugman
dsi pyworker funxs'
e8345e6
@rhugman
switch dsi tests to use pyworker
6ea3190
@coveralls
Copy link

coveralls commented Dec 6, 2024 •
edited
Loading

Coverage Status

coverage: 79.342%. first build
when pulling fa09035 on rhugman:feat_pyworker
into 90c4eec on pypest:develop.

@briochh briochh merged commit 83a6f04 into pypest:develop Dec 10, 2024
14 checks passed
@briochh
Copy link
Collaborator

briochh commented Dec 10, 2024

thanks @rhugman, getting the occasional fail in the dsi tests, unsure where they come from. e.g. https://github.com/pypest/pyemu/actions/runs/12248019374/job/34166881016#step:14:3319
Looks like it is triggered by a failure during the dsi runs. Maybe overlapping file access. Maybe memory issue when running with a few workers. Hopefully using pypestworker approach here heads it off. Let's keep an eye on it though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@rhugman @coveralls @briochh @jtwhite79