[TT-12893]: Adding first implementation of streams API#6511

Merged

kofoworola merged 58 commits intomasterfrom feat/streams

Sep 24, 2024

+3,820-96

Commits on Sep 24, 2024

Streaming POC

buger
authored and
kofoworola
committed
Directly manage streams instead of benthos rest api

buger
authored and
kofoworola
committed
Add TYk integration

buger
authored and
kofoworola
committed
Add fan-out mechanism

buger
authored and
kofoworola
committed
Add support for redis streams

buger
authored and
kofoworola
committed
fixed panic where redis client wasn't ready when server came up

lonelycode
authored and
kofoworola
committed
fixd panic where if messages were still in redis stream when client disconnected would cause a send on closed channel

lonelycode
authored and
kofoworola
committed
Fix bugs

buger
authored and
kofoworola
committed
Add portal support

buger
authored and
kofoworola
committed
Fix router issue

buger
authored and
kofoworola
committed
Refactor streaming functionality to become a standard middleware

buger
authored and
kofoworola
committed
Fix consumer group and some panics

buger
authored and
kofoworola
committed
Add new Labs configuration option, and ensure that streaming runs only when

buger
authored and
kofoworola
committed
Fix linter

buger
authored and
kofoworola
committed
Do not load unsafe components

buger
authored and
kofoworola
committed
Fix gomod

buger
authored and
kofoworola
committed
Add mutex to unload function

buger
authored and
kofoworola
committed
refactor: Implement direct user-to-stream connections in streaming middleware

buger
authored and
kofoworola
committed
feat: initialize default consumer group manager in StreamingMiddleware

buger
authored and
kofoworola
committed
refactor: optimize streaming middleware request processing

buger
authored and
kofoworola
committed
Rename a few methods

buger
authored and
kofoworola
committed
refactor: update streaming implementation to use single Stream object

buger
authored and
kofoworola
committed
refactor: update Stream struct and methods in manager.go

buger
authored and
kofoworola
committed
refactor: optimize stream reset in StreamingMiddleware Unload method

buger
authored and
kofoworola
committed
refactor: update stream counting in StreamingMiddleware Unload method

buger
authored and
kofoworola
committed
refactor: improve stream stopping mechanism

buger
authored and
kofoworola
committed
feat: add time import to streaming manager

buger
authored and
kofoworola
committed
feat: enhance AsyncAPI test robustness and logging

buger
authored and
kofoworola
committed
feat: enhance AsyncAPI test with increased timeouts and logging

buger
authored and
kofoworola
committed
test: increase timeouts and add more logging in AsyncAPI test

buger
authored and
kofoworola
committed
feat: optimize AsyncAPI HTTP test for faster execution

buger
authored and
kofoworola
committed
refactor: simplify streaming middleware configuration

buger
authored and
kofoworola
committed
refactor: remove GC job and simplify resource management in streaming middleware

buger
authored and
kofoworola
committed
Small refactor

buger
authored and
kofoworola
committed
More unused constants

buger
authored and
kofoworola
committed
modified manager test
kofoworola
committed
nats stream
kofoworola
committed
fixed tests
kofoworola
committed
fixed syntax error
kofoworola
committed
gofmt run
kofoworola
committed
fixing stream manage
kofoworola
committed
added dry run logic
kofoworola
committed
fixed flaky tests
kofoworola
committed
fix schema
kofoworola
committed
reorg and add linting
kofoworola
committed
expose labs
kofoworola
committed
disable context var by default
kofoworola
committed
fix mod dep
kofoworola
committed
fix tests
kofoworola
committed
fix race condition
kofoworola
committed
fix for broken tests
kofoworola
committed
[TT-13036] A struct is needed to resemble the info section inside of x-tyk-streaming. (#6544 )

buraksezer
authored and
kofoworola
committed
[TT-12879] Replace Benthos with Bento (#6545 )

buraksezer
authored and
kofoworola
committed
Fix using broker (#6535 )

buger
and
kofoworola
committed
Feat/tt 13036/bring back changes (#6561 )

buraksezer
authored and
kofoworola
committed
[TT-13036] Fix bad streams config (#6562 )

buraksezer
authored and
kofoworola
committed
lint fixes
kofoworola
committed
lint fixes
kofoworola
committed