Skip to content

Apache Nemo (incubating) v0.2

Compare
Choose a tag to compare
@jeongyooneo jeongyooneo released this 27 Oct 10:05
· 36 commits to master since this release

New Features

Off-Heap Memory Management

  • Nemo supports off-heap memory: max_offheap_ratio and chunk_size_kb options added #234
  • Users can write policies with off-heap SerializedPartition with writing DirectByteBufferOuputStream #213
  • MemoryPoolAssigner used in block creation to use off-heap memory #222 #206

Smart Compiler

  • XGBoostPolicy #203

Serverless

  • Lambda execution on Nemo(ResourceLambdaProperty, LambdaPass and LambdaPolicy) #214

Streaming

  • NEXMark applications run on Nemo #198

Runtime Data Plane

  • gRPC (instead of NCS) as a default RPC implementation #218

Major refactorings

Refactoring of Existing Passes

Misc.

Committer's Guide

Other Additions

  • Refined task-level and job-level metrics #289
  • Migrated to Java 11 #291
  • Upgraded Beam version to 2.11.0 #204