Concurrent and multi-stage data ingestion and data processing with Elixir

Flow-Based Programming framework for Elixir

Elixir queue! A simple, in-memory queue with worker pooling and rate limiting in Elixir.

A Broadway connector for Kafka

A Broadway producer for RabbitMQ

A Broadway producer for Amazon SQS

A simple Elixir library for writing decently-performing crawlers with minimum effort.

A blazing fast job processing system backed by GenStage & Redis.

🚤 Better streaming for Ecto.

📮 Robust job queue powered by GenStage and Redis

Osteria demo app for GenStage in the Kitchen talk. Rough code, beware!

🐘 Postgres event store for event_bus

A Broadway producer for Redis Stream

Example GenStage producer for AWS Simple Queue Service

Elasticsearch Elixir Bulk Processor is a configurable manager for efficiently inserting data into Elasticsearch. This processor uses GenStages (data-exchange steps) for handling backpressure, and various settings to control the bulk payloads being uploaded to Elasticsearch.

GenStage producers for EventStoreDB 20+ with Spear

gen_stage for Erlang

Subscribes GenStage consumers to producers across Elixir Umbrella apps.

A simple application using GenStage with pretty tracing for studying purposes.

Galena is a topic producer-consumer library built on top of GenStage for Elixir.