Skip to content

com.amadeus.elastic_scaling_2.12 2.0.3

Install 1/2: Add this to pom.xml:
Learn more about Maven or Gradle
<dependency>
  <groupId>com.amadeus</groupId>
  <artifactId>elastic_scaling_2.12</artifactId>
  <version>2.0.3</version>
</dependency>
Install 2/2: Run via command line
$ mvn install

About this package

Elastic scaling is a library that allows to control the number of resources (executors) instantiated by a Spark Structured Streaming Job in order to optimize the effective microbatch duration. The goal is to use the minimum needed resources for processing the workload, in a time that is the closest to the microbatch duration itself, adapting the number of executors to the volume of data received.