Adding I/O type for ADIOS compression & Updating SCORPIO to v1.6.6 #6738
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Adding support for a new SCORPIO I/O type, adiosc, that supports compressing data (lossless compression) written out using ADIOS (BP file format) To enable data compression using ADIOS, users need to change (xmlchange) PIO_TYPENAME to "adiosc"
Adding a testmod to use/force data compression for ADIOS output
Updating SCORPIO version from 1.6.5 to 1.6.6 SCORPIO v1.6.6 includes the following fixes/enhancements, * Support for apps that use I/O type PIO_IOTYPE_ADIOSC (Build support only, ADIOS BP output with compression is not supported yet)
jayeshkrishna
added
Machine Files
BFB
|
dqwu
approved these changes
Nov 7, 2024
jayeshkrishna
added a commit
that referenced
this pull request
Nov 8, 2024
#6738) Adding preliminary support for ADIOS output compression and updating to SCORPIO v1.6.6 (which includes patch to support the new I/O type to use for data compression) Modifying CIME config and scripts to support writing ADIOS output files with data compression. A new I/O type is added to support writing output in ADIOS BP file format with data compression. However users would need to move to SCORPIO master to write ADIOS output with data compression Note: Writing ADIOS output with data compression is now supported in SCORPIO master but is not included in SCORPIO v1.6.6. A future release of SCORPIO will include this feature [BFB] * jayeshkrishna/share/spio_add_adiosc_iotype: Updating to SCORPIO v1.6.6 Adding a testmod to force ADIOS BP compression Adding support for PIO_IOTYPE_ADIOSC
Adding support for ADIOS builds that include support for BLOSC (lossless compression) in FindPIO cmake module
|
Creating tests with CIME (create_test) on next failed on machines (anlgce) with ADIOS that includes support for BLOSC (Note: create_newcase however does not show this issue and creates the case successfully on these machines). This issue has been fixed on the branch and will be re-merged to next. |
jayeshkrishna
added a commit
that referenced
this pull request
Nov 11, 2024
… (PR #6738) Adding support for ADIOS builds with BLOSC in FindPIO CMake module Adding preliminary support for ADIOS output compression and updating to SCORPIO v1.6.6 (which includes patch to support the new I/O type to use for data compression) Modifying CIME config and scripts to support writing ADIOS output files with data compression. A new I/O type is added to support writing output in ADIOS BP file format with data compression. However users would need to move to SCORPIO master to write ADIOS output with data compression Note: Writing ADIOS output with data compression is now supported in SCORPIO master but is not included in SCORPIO v1.6.6. A future release of SCORPIO will include this feature [BFB] * jayeshkrishna/share/spio_add_adiosc_iotype: Adding support for ADIOS builds with BLOSC
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Adding preliminary support for ADIOS output compression
and updating to SCORPIO v1.6.6 (which includes patch
to support the new I/O type to use for data compression)
Modifying CIME config and scripts to support writing
ADIOS output files with data compression. A new I/O
type is added to support writing output in ADIOS BP file
format with data compression.
However users would need to move to SCORPIO
master to write ADIOS output with data compression
Note: Writing ADIOS output with data compression is
now supported in SCORPIO master but is not
included in SCORPIO v1.6.6. A future release of
SCORPIO will include this feature
[BFB]