meta-modeling

[esraneufeld]

bold: done already
bold italic: to be done with priority

- parameters
- mark input ports that are exposed
- permit to set parameter values
- probes
- mark output ports that are exposed
- contain result collector that can be accessed downstream (similar to s4l)
- iterators
- predefined types
- user scripted (function services)
- sweeper (to be refined)
- sensitivity (to be refined)
- uncertainty (to be refined)
- table of configurations ('iteration', 'checkpoint')
- parameter values, probe values

• API
  • access results table
  • inject new configuration (clone)
• 'run'
  • complete execution of all configurations
  • including newly generated configurations
• checkpoint tree
  • tree with branching
  • 'master'/'meta' study (not this sprint)
• (user-)creation of iterator services
  • through scriptable iterator in the frontend (not this sprint)
  • through simplified iterator creation
• (user-)creation of meta-modeling services
  • through scriptable service
  • ***through simplified service creation
• GUI
  • **parameters
  • iterators
  • probes
  • iterated probes
  • configuration tree/selector/table
  • convert parameter to iterator
• continue working with configuration results downstream on workbench (in master checkpoint?) (not in this sprint)
• implementation issues
  • concurrency issue
  • only execute parts of pipeline that differ between configurations/checkpoints (not this sprint)

use cases

• xxx
• xxx
• xxx

[pcrespov]

Update on sprint Croissant

Planned

From now on, this is used as mother user-case for

• "meta"-related cases
  • S-D22.2 Meta-Modeling sensitivity analysis Y4M08 #353
  • S-D22.3 Meta-Modeling uncertainty assessment Y4M10 #354
  • S-D22.4 Meta-Modeling optimizer module Y4M12 #355
• "units"-related cases
  • M7 Dynamic checking during pipeline execution, whether input arguments to services satisfy constraints #516
  • M6 Support for unit conversion and detection of compatible ports #515
• Reviewed missing details for the "meta" related cases (see this case description)
• Will address "units" related cases first
• Will address "meta" related cases after ITISFoundations/osparc-issues#428 and Fix duplicate feature for large studies #558

Done

• UI improvements
  • ✨Pipeline failure to port osparc-simcore#3028
  • Metamodeling II + Markers osparc-simcore#2966
• ⚗️ Started use-cases using new approach https://github.com/pcrespov/osparc-function-services

Ongoing

None (tmp blocked by maintenance)

Open

• "units"-related cases
  • Create "examples that demos features in the UI"
    • Connect units to nodeports
  • Expose in the API: "a study, mark inputs/outputs and get schemas in api"
    • Exposing (API-based) service and study ports:
  • Follow up and support MAP-Core join-milestone
• "meta"-related cases (await improving stability of single-study)
  • create API to inject and execute new configurations
  • create ‘master' study where collected results can be further processed through pipeline
  • allow scriptable iterators simple meta-modelling service creation

[pcrespov]

Update on sprint Vaporwave

Done

• Resumed discussions with CB on metamodeling

Ongoing

• function services osparc-simcore#3418

Open

[pcrespov]

Goal for sprint Katherine Switzer

• Finalize integration in OOIL function services osparc-simcore#3418
• review sweepers design
• MVP on S-D22.4 Meta-Modeling optimizer module Y4M12 #355

Review demo

• creation of a service from a python function.
• use example by @KZzizzle with rich i/o to demo "units"
• recreate EN's example of sweepers
• ...

[elisabettai]

Hi @pcrespov, thanks a lot for the update.

Just a clarification: do you need to work on the "meta-related" and the "unit"-related cases this sprint to have the optimizer part ready (#355 and finally close the case for NIH)?

As far as I understand, the goal has really narrowed down to have an optimizer module to support CB's use-case. Feel free also to use #355, if that helps.

[pcrespov]

Update on sprint Katherine Switzer

Done

• Improve service integration
  • NEW features with o2sparc-integration-library OOIL -> Released v1.3.0
    • runs integration tests: ✨ Is3418/validation with ooil test my/osparc/service osparc-simcore#3479
    • containarized executable: ✨ ooil executable in a docker image osparc-simcore#3458
  • SIMPLIFIED cookiecutter-osparc-service:
    • Is1884/using integration library cookiecutter-osparc-service#40 -> Released v0.4.0

Ongoing

• Improve service integration:
  • SIMPLIFIED cookiecutter-osparc-service:
    • Is3418/dot osparc layout: v1.0.0 cookiecutter-osparc-service#93
    • function services osparc-simcore#3418
      • ✨ New python binder for function-services cookiecutter-osparc-service#94

Open

• MVP user story for S-D22.4 Meta-Modeling optimizer module Y4M12 #355