Skip to content

Conversation

@nosammai
Copy link

@nosammai nosammai commented Jul 7, 2025

Adds a 'record_pull_delay' config option to the kinesis consumer to set a minimum wait time between GetRecords calls. This allows connect to co-exist with other consumers on a stream without immediately hitting AWS rate limits.

closes #1209

Adds a 'record_pull_delay' config option to the kinesis consumer to set a minimum wait time between GetRecords calls.
This allows connect to co-exist with other consumers on a stream without immediately hitting AWS rate limits.

closes redpanda-data#1209
@CLAassistant
Copy link

CLAassistant commented Jul 7, 2025

CLA assistant check
All committers have signed the CLA.

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

aws_kinesis input hitting GetRecords API rate limit

2 participants