Skip to content

v0.10.2

Choose a tag to compare

@raphael raphael released this 29 Nov 20:53
· 8 commits to main since this release
74126f4

What's Changed

Rate Limiting Support

  • Add rate limiting error handling for Bedrock and OpenAI clients
  • Introduce isRateLimited function to identify rate limiting errors based on specific error codes and HTTP status
  • Add rate limiting middleware with cluster support for coordinated throttling
  • Enhanced Complete and Stream methods to wrap rate-limited errors with consistent messaging
  • Added model.ErrRateLimited for better error management

Other Improvements

  • Documentation updates for runtime
  • Various internal improvements

Full Changelog: v0.10.1...v0.10.2