Skip to content

Commit

Permalink
CM v2.3.2 release (#1261)
Browse files Browse the repository at this point in the history
- fixed "cm pull repo --branch={BRANCH NAME}" behavior for all OS
- added GitHub tests for Windows
- added more tests for CM-MLPerf workflows for different hardware
  • Loading branch information
gfursin authored Jun 15, 2024
2 parents a4c6a7b + 3e526b3 commit 8159140
Show file tree
Hide file tree
Showing 6 changed files with 39 additions and 18 deletions.
2 changes: 1 addition & 1 deletion CONTRIBUTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ Modify the project in your own fork and issue a pull request once you want other
to take a look at what you have done and discuss the proposed changes.
Ensure that cla-bot and other checks pass for your Pull requests.

## CM framework author
## Original author (CK, CM, CM4MLOPS, CM4ABTF, CM4MLPERF)

* Grigori Fursin ([cKnowledge.org](https://cKnowledge.org) and [cTuning.org](https://cTuning.org))

Expand Down
18 changes: 12 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,17 +28,20 @@ CK consists of several ongoing sub-projects:
You can read more about the CM concept in this [presentation](https://doi.org/10.5281/zenodo.8105339).


* [CM automation recipes for MLOps and DevOps](cm-mlops) (*~6MB*) - a small collection of portable, extensible and technology-agnostic automation recipes
* [CM automation recipes for MLOps and DevOps](https://github.com/mlcommons/cm4mlops) (*~6MB*) - a small collection of portable, extensible and technology-agnostic automation recipes
with a human-friendly interface (aka CM scripts) to unify and automate all the manual steps required to compose, run, benchmark and optimize complex ML/AI applications
on diverse platforms with any software and hardware: see [online catalog](https://access.cknowledge.org/playground/?action=scripts)
and [source code](https://github.com/mlcommons/cm4mlops/blob/master/script).

* [CM automation recipes to reproduce research projects](https://github.com/ctuning/cm4research) - a unified CM interface to help researchers
* [CM automation recipes to reproduce research projects](https://github.com/ctuning/cm4research) (*~1MB*) - a unified CM interface to help researchers
and engineers access, prepare and run diverse research projects and make it easier to validate them in the real world
across rapidly evolving models, data, software and hardware
(see [our reproducibility initatives](https://cTuning.org/ae)
and [motivation](https://www.youtube.com/watch?v=7zpeIVwICa4) behind this project).

* [CM automation recipes for ABTF](https://github.com/mlcommons/cm4abtf) (*~1MB*) - a unified CM interface and automation recipes
to run automotive benchmark across different models, data sets, software and hardware from different vendors.

* [Modular C++ harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-cpp)

* [Modular Python harness for MLPerf loadgen](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-python)
Expand All @@ -65,7 +68,7 @@ CK consists of several ongoing sub-projects:
* [CM Getting Started Guide and FAQ](docs/getting-started.md)
* [Common CM interface to run MLPerf inference benchmarks](docs/mlperf/inference)
* [Common CM interface to re-run experiments from ML and Systems papers including MICRO'23 and the Student Cluster Competition @ SuperComputing'23](docs/tutorials/common-interface-to-reproduce-research-projects.md)
* [CM automation recipes for MLOps and DevOps](cm-mlops/script)
* [CM automation recipes for MLOps and DevOps](https://access.cknowledge.org/playground/?action=scripts)
* [Other CM tutorials](docs/tutorials)
* [Full documentation](docs/README.md)
* [CM development tasks](docs/taskforce.md#current-tasks)
Expand All @@ -78,13 +81,16 @@ Please use this [BibTex file](citation.bib).

### Acknowledgments

The open-source Collective Knowledge (CK v1,v2) and Collective Mind automation frameworks (CM) were developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind this project from the following presentations:
[Collective Knowledge automation framework (deprecated CK v1 and v2)](https://github.com/mlcommons/ck/tree/master/ck),
[Collective Mind automation framework (CM)](https://github.com/mlcommons/ck/tree/master/cm),
[CM4MLOPS](https://github.com/mlcommons/cm4mlops) and
[CM4ABTF](https://github.com/mlcommons/cm4abtf) were originally developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind these projects from the following presentations:

* ACM REP'23 keynote about the MLCommons CM automation framework: [ [slides](https://doi.org/10.5281/zenodo.8105339) ]
* ACM TechTalk'21 about automating research projects: [ [YouTube](https://www.youtube.com/watch?v=7zpeIVwICa4) ] [ [slides](https://learning.acm.org/binaries/content/assets/leaning-center/webinar-slides/2021/grigorifursin_techtalk_slides.pdf) ]

We would like to thank all
We would like to thank all our great
[volunteers, collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
for their support, fruitful discussions, and useful feedback!
We thank the [cTuning foundation](https://cTuning.org), [cKnowledge.org](https://cKnowledge.org)
Expand Down
8 changes: 8 additions & 0 deletions cm/CHANGES.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,11 @@
## V2.3.2
- fixed "cm pull repo --branch={BRANCH NAME}" behavior for all OS
- added GitHub tests for Windows
- added more tests for CM-MLPerf workflows for different hardware

## v2.3.1
- various minor fixes based on user feedback

## V2.3.0
- added automatic CM repo alias from mlcommons@ck to mlcommons@cm4mlops
unless branch and checkout are used!
Expand Down
25 changes: 16 additions & 9 deletions cm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -216,13 +216,17 @@ and how to implement and share new automations in your public or private project

**MLCommons is updating the CM documentation based on user feedback - please stay tuned for more details**.

* [News](../docs/news.md)
* [Getting Started Guide and FAQ](../docs/getting-started.md)
* [Common CM interface to run MLPerf inference benchmarks](../docs/mlperf/inference)
* [Common CM interface to re-run experiments from ML and Systems papers including MICRO'23 and the Student Cluster Competition @ SuperComputing'23](../docs/tutorials/common-interface-to-reproduce-research-projects.md)
* [Other CM tutorials]../(docs/tutorials)
* [Full documentation](../docs/README.md)
* [Getting Started Guide and FAQ](https://github.com/mlcommons/ck/tree/master/docs/getting-started.md)
* [Common CM interface to run MLPerf inference benchmarks](https://github.com/mlcommons/ck/tree/master/docs/mlperf/inference)
* [Common CM interface to re-run experiments from ML and Systems papers including MICRO'23 and the Student Cluster Competition @ SuperComputing'23](https://github.com/mlcommons/ck/tree/master/docs/tutorials/common-interface-to-reproduce-research-projects.md)
* [Other CM tutorials](https://github.com/mlcommons/ck/tree/master/docs/tutorials)
* [Full documentation](https://github.com/mlcommons/ck/tree/master/docs/tutorials/README.md)

### Projects modularized and automated by CM

* [cm4research](https://github.com/ctuning/cm4research)
* [cm4mlops](https://github.com/mlcommons/cm4mlops)
* [cm4abtf](https://github.com/mlcommons/cm4abtf)

### License

Expand All @@ -234,13 +238,16 @@ Please use this [BibTex file](https://github.com/mlcommons/ck/blob/master/citati

### Acknowledgments

The open-source Collective Knowledge (CK v1,v2) and Collective Mind automation frameworks (CM) were developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind this project from the following presentations:
[Collective Knowledge automation framework (deprecated CK v1 and v2)](https://github.com/mlcommons/ck/tree/master/ck),
[Collective Mind automation framework (CM)](https://github.com/mlcommons/ck/tree/master/cm),
[CM4MLOPS](https://github.com/mlcommons/cm4mlops) and
[CM4ABTF](https://github.com/mlcommons/cm4abtf) were originally developed by [Grigori Fursin](https://cKnowledge.org/gfursin)
and donated to MLCommons to benefit everyone. You can learn more about the motivation behind these projects from the following presentations:

* ACM REP'23 keynote about the MLCommons CM automation framework: [ [slides](https://doi.org/10.5281/zenodo.8105339) ]
* ACM TechTalk'21 about automating research projects: [ [YouTube](https://www.youtube.com/watch?v=7zpeIVwICa4) ] [ [slides](https://learning.acm.org/binaries/content/assets/leaning-center/webinar-slides/2021/grigorifursin_techtalk_slides.pdf) ]

We would like to thank all
We would like to thank all our great
[volunteers, collaborators and contributors](https://github.com/mlcommons/ck/blob/master/CONTRIBUTING.md)
for their support, fruitful discussions, and useful feedback!
We thank the [cTuning foundation](https://cTuning.org), [cKnowledge.org](https://cKnowledge.org)
Expand Down
2 changes: 1 addition & 1 deletion cm/cmind/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
#
# Written by Grigori Fursin

__version__ = "2.3.1"
__version__ = "2.3.2"

from cmind.core import access
from cmind.core import error
Expand Down
2 changes: 1 addition & 1 deletion docs/history.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ The archive of this discontinued framework is available in the [/ck directory](.
Grigori donated the CK technology to [MLCommons](https://mlcommons.org) in 2022 to benefit everyone,
prototyped a new version of CK called [Collective Mind (CM)](https://github.com/mlcommons/ck/tree/master/cm)
with [portable and reusable automation recipes for universal benchmarking and optimization of applications
and systems (CM scripts)](https://access.cknowledge.org/playground/?action=scripts),
and systems (CM4MLOps scripts and workflows)](https://github.com/mlcommons/cm4mlops),
and helped establish the [MLCommons Task Force on Automation and Reproducibility](taskforce.md)
co-led with Arjun Suresh.

Expand Down

0 comments on commit 8159140

Please sign in to comment.