Kinesis On-demand Mode #90
-
|
Hey @jshlbrd Maybe you have considered this or Substation supports it already. It seems that Kinesis supports this On-demand mode nowadays. It can scale up and down automatically to support gigabytes of write and read per minute. Have you looked at the Kinesis on-demand mode for substation? That would simplify the design a little as it currently uses a lambda to autoscale up and down the number of shards. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Hey @Bin-security 👋 Substation already supports Kinesis Data Streams' On-Demand capacity, it's configurable with Terraform (but obviously not compatible with the custom autoscaler). We've looked at On-Demand in addition to other streaming configurations (Firehose and AWS MSK) and determined that the Provisioned capacity with our autoscaler is the most affordable solution. By our estimates, On-Demand costs between 15x and 20x the cost of Provisioned with our autoscaler. |
Beta Was this translation helpful? Give feedback.
Hey @Bin-security 👋
Substation already supports Kinesis Data Streams' On-Demand capacity, it's configurable with Terraform (but obviously not compatible with the custom autoscaler).
We've looked at On-Demand in addition to other streaming configurations (Firehose and AWS MSK) and determined that the Provisioned capacity with our autoscaler is the most affordable solution. By our estimates, On-Demand costs between 15x and 20x the cost of Provisioned with our autoscaler.