First D9 release!

• All configuration and changes from 8.x-1.13

[8.x] Images updates to 21.7.0 and Composer 2

Docker

• Added Composer 2.
• Updated images to 21.7.0 and PHP 7.4.
• Updated Xdebug flag value to use true for the new Docker images. Upstream #251

CI and workflow

• Updated behat-screenshot to the latest version.
• Updated behat-steps to use the new namespace. (#633)
• Updated behat-format-progress-fail to the latest version.
• Removed obsolete AMAZEEIO_ variables in favour of MARIADB_.
• Removed port check from builds on Linux.
• Added support for DATABASE_SSH_FINGERPRINT in CI.
• Fixed parameter parsing within deployment notification script.

Back-end

• Added running of post_update hooks on core module install.

Front-end

• Updated FE development packages to the latest versions.
• Added ahoy fei command to install FE packages.

Integrations

• Fixed environment detection in Lagoon.
• Updated Lagoon config to use correct configuration for routes for production and development environments.
• Fixed Lagoon deployment not using production branch variable.
• Fixed Lagoon private registry password variable name.
• Fixed Lagoon dotfiles were not copied into container.
• Fixed DB being sanitised in Acquia.

Documentation

• Updated command descriptions and run all tests.

[7.x] Updated images to 21.7.0 and Composer 2

• Updated to Composer 2
• Updated images to 21.7.0 and PHP 7.4
• Ported changes from:
  • 8.x-1.11
  • 8.x-1.12
  • 8.x-1.13

[8.x] Portability and stability.

This release concentrates on stability and portability.

DrevOps scripts are no longer altered as a part of install for every project. All configuration is managed through .env file.

Docker

• Updated images to new Lagoon versioning schema based on year and month 20.10.1.
• Updated PHP to 7.4
• Updated code references to Amazee repositories (now using https://github.com/uselagoon/lagoon-images).

CI and workflow

• Added support for custom scripts to run after site install. This allows to prevent the need to directly modify DrevOps scripts for every project.
• Added JS and CSS to PHPCS lint target.
• Added additional PHPCS rules to enforce no empty lines before and after function opening.
• Fixed 'ahoy debug' not restarting nginx service.
• Added support for local environment overrides using .env.local file.
• Added CONFIRM_RESPONSE to default.env.local to suppress questions locally.
• Fixed install script replacing content in binary files.
• Added suppressing of DB download flag (#618).
• Added conditional install of theme assets if the theme was provided. This allows to use DrevOps scripts without modifying them when a custom theme is not present (for example, with headless installations).
• Added enabling and disabling maintenance mode on build.
• Added re-running of failed Behat tests.
• Fixed DIDI failed tests affecting other CI builds (internal DrevOps utilities).
• Fixed Bats test helper to work with the latest Bats (internal DrevOps utilities).
• Fixed Drush lookup to always use local version before global.

Back-end

• Added post config import update Drush command post-config-import-update. Addresses this core issue https://www.drupal.org/project/drupal/issues/2901418.
• Added Composer update changelog generator (used after composer update to nicely summarise the modified packages with links to release and compare URLs).
• Added $config_exclude_modules variable to settings.
• Fixed config_split not using correct configuration per environment.
• Added support for npm assets packages for libraries. (#606)
• Switched to drupal/core-dev and updated package versions. (#611)
• Updated drupal install scripts to support DB settings read from environment variables. (#603)

Front-end

• Removed obsolete minified theme file (cleanup).

Integrations

• Added Lagoon cloud routes to trusted host patterns in settings.
• Updated Lagoon integration settings. (#604)
• Added deployment notification script which sends emails on successful deployment.

Documentation

• Added FAQ item about debugging Behat tests.

Updates

8.x-1.11

Added test for Lagoon deployment.

[8.x] Database stored in Docker image

This release adds highly demanded and long overdue support for using databases stored in Docker image. Using this workflow allows to build large database images in CI overnight and download databases as a fresh image in the morning to use for development and as a cache in CI.

During development, rebuilding local environments for projects with large databases will no longer be a long process (due to the time it takes to import from the database dump), but rather a matter of restarting a container. On the large databases (>1G) the time is reduced from 15-20 minutes to 15-30 seconds.

Additionally, there is now a support for several database sources: files or docker registry. As a result - there is a support for the following workflows (simplified):

• Download the database from CURL/FTP/Acquia as a dump file -> Import the database -> Develop/run tests -> Deploy
• Download the database from CURL/FTP/Acquia as a dump file -> Import into the Docker database image -> Push image to the registry -> Use the image to develop/run tests -> Deploy
• Download the database from the previous version of the image -> Use the image to develop/run tests -> Deploy

CI configuration now allows to enable using the database cache (file or Docker image) from the builds ran on the previous days. It also now supports nightly builds to cache the database to be used in builds during the day (significant builds speedup).

Lastly, the installer script was rewritten in PHP to allow more robust parameters handling and better development speed. It has own PHPUnit tests and updated Bats integration tests.

And of course, all the new functionality has automated tests.

Docker

• Updated images to Lagoon v1.4.1.
• Updated Docker Compose configuration to support custom database image taken from DATABASE_IMAGE environment variable.
• Removed quite pulling of the images. This is due to requests from developers to see which images were cached and which were downloaded during the build.

CI

• ❗❗Added support for nightly database builds + test.
• ❗Added support for per-workflow caching.
• Added support for cache fallback with a switch - using per-branch build caches from previous days.
• Increased database job timeout in CI to 30 minutes.

Scripts

• 🔥🔥🔥 Rewritten installer in PHP.
  • Better installer written in PHP + complies with Drupal coding standards.
  • Installer is interactive by default (previsously was quiet).
  • Added PHPunit tests for installer.
  • Updated existing integration Bats tests for installer.
  • Fixed several issues with automated configuration discovery for existing projects.
  • Installer now always overrides existing files during an update.
• 🔥🔥🔥 Added support for database-in-Docker-image. This allows to work with DB image with in-built data.
  • ❗❗❗ Use https://github.com/drevops/mariadb-drupal-data as a base image + DB seeding script is included.
  • ❗❗❗ Workflow switch is controlled by DATABASE_IMAGE environment variable (one variable to controll the whole workflow).
  • ❗❗ Added support for exporting image as archive. Used by CI to pass built images between jobs as cache and re-use this cache in the subsequent jobs.
  • ❗ Added support for deploying an image to a registry when exporting (if EXPORT_DB_DEPLOY_DOCKER is set).
  • Added reload-db command. Used to quickly restart database image.
  • Added ahoy pull-db command. Used to pull the latest version of the Database image.
• Added support for deployment of multiple docker images to Docker registry (according to provided service-to-image map).
• Added support for archiving and un-archiving of Docker images.
• Removed DrevOps test files from the downloadable package. This makes the downloadable archive cleaner.
• Moved DrevOps' tests and documentation under scripts/drevops directory.
• Added VERBOSE_BUILD variable to show the build progress.
• Added linting of Bats tests with Shellcheck.
• Improved bats test helpers and assertions.
• Added confirmations to ahoy build and ahoy down commands.

Back-end

• Removed Gherkin patch to run single tests with release of behat/gherkin version 4.6.1.
• Fixed cron running locally and in CI.

Front-end

No changes

Integrations

• Added support for ODE environments in Acquia (settings and hooks).
• Acquia is no longer an integration enabled by default.
• Lagoon is no longer an integration suggested by default.

Documentation

• Added more documentation in comments to .env file.
• Added more FAQs.
• Added documentation scaffolding (still WIP).

[7.x] Database stored in Docker image

This release adds highly demanded and long overdue support for using databases stored in Docker image. Using this workflow allows to build large database images in CI overnight and download databases as a fresh image in the morning to use for development and as a cache in CI.

During development, rebuilding local environments for projects with large databases will no longer be a long process (due to the time it takes to import from the database dump), but rather a matter of restarting a container. On the large databases (>1G) the time is reduced from 15-20 minutes to 15-30 seconds.

Additionally, there is now a support for several database sources: files or docker registry. As a result - there is a support for the following workflows (simplified):

• Download the database from CURL/FTP/Acquia as a dump file -> Import the database -> Develop/run tests -> Deploy
• Download the database from CURL/FTP/Acquia as a dump file -> Import into the Docker database image -> Push image to the registry -> Use the image to develop/run tests -> Deploy
• Download the database from the previous version of the image -> Use the image to develop/run tests -> Deploy

CI configuration now allows to enable using the database cache (file or Docker image) from the builds ran on the previous days. It also now supports nightly builds to cache the database to be used in builds during the day (significant builds speedup).

Lastly, the installer script was rewritten in PHP to allow more robust parameters handling and better development speed. It has own PHPUnit tests and updated Bats integration tests.

And of course, all the new functionality has automated tests.

Docker

• Updated images to Lagoon v1.4.1.
• Updated Docker Compose configuration to support custom database image taken from DATABASE_IMAGE environment variable.
• Removed quite pulling of the images. This is due to requests from developers to see which images were cached and which were downloaded during the build.

CI

• ❗❗Added support for nightly database builds + test.
• ❗Added support for per-workflow caching.
• Added support for cache fallback with a switch - using per-branch build caches from previous days.
• Increased database job timeout in CI to 30 minutes.

Scripts

• 🔥🔥🔥 Rewritten installer in PHP.
  • Better installer written in PHP + complies with Drupal coding standards.
  • Installer is interactive by default (previsously was quiet).
  • Added PHPunit tests for installer.
  • Updated existing integration Bats tests for installer.
  • Fixed several issues with automated configuration discovery for existing projects.
  • Installer now always overrides existing files during an update.
• 🔥🔥🔥 Added support for database-in-Docker-image. This allows to work with DB image with in-built data.
  • ❗❗❗ Use https://github.com/drevops/mariadb-drupal-data as a base image + DB seeding script is included.
  • ❗❗❗ Workflow switch is controlled by DATABASE_IMAGE environment variable (one variable to controll the whole workflow).
  • ❗❗ Added support for exporting image as archive. Used by CI to pass built images between jobs as cache and re-use this cache in the subsequent jobs.
  • ❗ Added support for deploying an image to a registry when exporting (if EXPORT_DB_DEPLOY_DOCKER is set).
  • Added reload-db command. Used to quickly restart database image.
  • Added ahoy pull-db command. Used to pull the latest version of the Database image.
• Added support for deployment of multiple docker images to Docker registry (according to provided service-to-image map).
• Added support for archiving and un-archiving of Docker images.
• Removed DrevOps test files from the downloadable package. This makes the downloadable archive cleaner.
• Moved DrevOps' tests and documentation under scripts/drevops directory.
• Added VERBOSE_BUILD variable to show the build progress.
• Added linting of Bats tests with Shellcheck.
• Improved bats test helpers and assertions.
• Added confirmations to ahoy build and ahoy down commands.

Back-end

• Removed Gherkin patch to run single tests with release of behat/gherkin version 4.6.1.
• Fixed cron running locally and in CI.

Front-end

No changes

Integrations

• Added support for ODE environments in Acquia (settings and hooks).
• Acquia is no longer an integration enabled by default.
• Lagoon is no longer an integration suggested by default.

Documentation

• Added more documentation in comments to .env file.
• Added more FAQs.
• Added documentation scaffolding (still WIP).

[8.x] Better CI handling 🤖 🤖 🤖

DrevOps has moved to its own GitHub organisation https://github.com/drevops! 🎉 🎉 🎉
This allows to maintain all repositories related to DrevOps in one place.

Docker

• 🔥 Updated container images to 1.2.0.
• 🔥 Updated PHP to 7.3.
• 🔥 Added Dockerfile for mariadb service with ability to provide custom configuration.
• Less output when installing FE tools.
• Added docker pull progress output suppression.

CI

• 🔥🔥🔥 Removed additional CI scripts. CI now uses ahoy scripts directly!
• 🔥🔥 Refactored CI config to use YAML anchors as variables. Also, defined section that should change per-project.
• 🔥 Move code linting is a separate job in CI.
• 🔥 Added default timezone for CI runner container.
• Updated CI builder image to use new namespace.
• Added more timeout for commands without output in CI.
• Fixed network warning in CI.
• Updated default database directory location in CI.
• Added artifacts storage in CI
• Added test results storage in CI

Scripts

• Workflow
  • 🔥🔥 Updated install-site script to support installing from database or fresh install if database dump file is not available.
  • 🔥🔥 Fixed env variables with values being overridden by values in .env. Any variable that has a value in the current environment would be overwritten by the value in the .env file.
  • Fixed ahoy clean command not removing files with readonly permissions.
  • Moved Composer validation to project build stage (but only if composer is installed).
  • Refactored all scripts to correctly work with database dump directory and filename.
  • Improved the logic of DB sanitization - now only runs if file exists.
• Tools
  • Updated lint for PHPCS to not be verbose while scanning.
  • Added logs for running unit tests.
  • Removed global unit test directory. Tests should live with modules.
• Doctor
  • Removed Composer presence check from Doctor. Composer is not required on host.
  • Fixed Doctor check for status code of the homepage to allow 200 and 403, returned depending on the installation type.
  • Updated Doctor to check the status of all containers.
  • Added DOCTOR_CHECK_MINIMAL shorthand variable to run minimal Doctor checks in CI env.
• Installation
  • Fixed install.sh not correctly discovering project settings when installed into a custom directory + tests.
  • Fixed install.sh not failing on errors.
  • Fixed install.sh to never modify DrevOps scripts when installing.
• Testing
  • Fixed some integration tests not running.
• 🔥 Added printing of debug output in DrevOps scripts using DREVOPS_DEBUG variable.
• Fixed code formatting in multiple scripts.
• Removed DOCKER_HOST temporary override in .env file.
• Removed default deployer user name from the deployment script. This should be set through env variables.

Back-end

• Core and Modules
  • Updated Drupal core version to 8.8.
  • Removed obsolete code to load hook implementations from included sub-directories.
  • Added Shield popup default title.
  • Removed custom patches. Some of the patches were breaking existing sites.
• Settings
  • Improved readability of settings.php file.
  • Updated default values in settings.local.php file.
  • Added skipping of permissions hardening locally and in CI.
• Testing
  • Renamed test helper class to a trait in your_site_core module.

Front-end

• Renamed style.scss to styles.scss.
• Fixed FE browser list for autoprefix package.
• Removed Barrio base theme and twbs/bootstrap library from theme.

Integrations

• Updated Acquia credentials in .env file to not rely on variables.
• Added NewRelic notifications for Acquia production.
• Fixed Acquia DB download script not correctly identifying it's location.
• Refactored Acquia hooks scripts to allow configuration through environment variables and comply with coding standards.

Other

• Removed obsolete Brewfile.
• Removed obsolete .nvmrc file.

[7.x] Better CI handling 🤖 🤖 🤖

DrevOps has moved to its own GitHub organisation https://github.com/drevops! 🎉 🎉 🎉
This allows to maintain all repositories related to DrevOps in one place.

Docker

• 🔥 Updated container images to 1.2.0.
• 🔥 Updated PHP to 7.3.
• 🔥 Added Dockerfile for mariadb service with ability to provide custom configuration.
• Less output when installing FE tools.
• Added docker pull progress output suppression.

CI

• 🔥🔥🔥 Removed additional CI scripts. CI now uses ahoy scripts directly!
• 🔥🔥 Refactored CI config to use YAML anchors as variables. Also, defined section that should change per-project.
• 🔥 Move code linting is a separate job in CI.
• 🔥 Added default timezone for CI runner container.
• Updated CI builder image to use new namespace.
• Added more timeout for commands without output in CI.
• Fixed network warning in CI.
• Updated default database directory location in CI.
• Added artifacts storage in CI
• Added test results storage in CI

Scripts

• Workflow
  • 🔥🔥 Updated install-site script to support installing from database or fresh install if database dump file is not available.
  • 🔥🔥 Fixed env variables with values being overridden by values in .env. Any variable that has a value in the current environment would be overwritten by the value in the .env file.
  • Fixed ahoy clean command not removing files with readonly permissions.
  • Moved Composer validation to project build stage (but only if composer is installed).
  • Refactored all scripts to correctly work with database dump directory and filename.
  • Improved the logic of DB sanitization - now only runs if file exists.
• Tools
  • Updated lint for PHPCS to not be verbose while scanning.
  • Updated PHPCS config to include more Features exclusions.
  • Added logs for running unit tests.
  • Removed global unit test directory. Tests should live with modules.
• Doctor
  • Removed Composer presence check from Doctor. Composer is not required on host.
  • Fixed Doctor check for status code of the homepage to allow 200 and 403, returned depending on the installation type.
  • Updated Doctor to check the status of all containers.
  • Added DOCTOR_CHECK_MINIMAL shorthand variable to run minimal Doctor checks in CI env.
• Installation
  • Fixed install.sh not correctly discovering project settings when installed into a custom directory + tests.
  • Fixed install.sh not failing on errors.
  • Fixed install.sh to never modify DrevOps scripts when installing.
• Testing
  • Fixed some integration tests not running.
• 🔥 Added printing of debug output in DrevOps scripts using DREVOPS_DEBUG variable.
• Fixed code formatting in multiple scripts.
• Removed DOCKER_HOST temporary override in .env file.
• Removed default deployer user name from the deployment script. This should be set through env variables.

Back-end

• Core and Modules
  • Updated Drupal core version to 7.69.
  • Removed obsolete code to load hook implementations from included sub-directories.
  • Added Shield popup default title.
  • Removed custom patches. Some of the patches were breaking existing sites.
• Settings
  • Improved readability of settings.php file.
  • Updated default values in settings.local.php file.
  • Added skipping of permissions hardening locally and in CI.
• Testing
  • Fixed phpunit bootstrap.
  • Moved Drupal tests to your_site_core module.
  • Renamed test helper class to a trait.

Front-end

• Renamed style.scss to styles.scss.
• Fixed FE browser list for autoprefix package.
• Removed Bootstrap 3 theme and library from theme.
• Fixed sass-lint config file location.

Integrations

• Updated Acquia credentials in .env file to not rely on variables.
• Added NewRelic notifications for Acquia production.
• Fixed Acquia DB download script not correctly identifying it's location.
• Refactored Acquia hooks scripts to allow configuration through environment variables and comply with coding standards.

Other

• Removed obsolete Brewfile.
• Removed obsolete .nvmrc file.

[8.x] Renamed project to DrevOps 🚀🚀🚀

It is time for this project to have a new catchy name: DrevOps

Drupal + DevOps = DrevOps

http://drevops.com