[CELEBORN-2264] Support cancel shuffle when write bytes exceeds threshold

[yew1eb]

What changes were proposed in this pull request?

This patch adds configurable threshold check for shuffle write bytes.

Why are the changes needed?

Shuffle will be canceled automatically if write bytes exceed the threshold to avoid cluster resource exhaustion.

Does this PR resolve a correctness bug?

No.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

CI and Manual testing.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 66.91%. Comparing base (2dd1b7a) to head (d15feca).
⚠️ Report is 13 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3601      +/-   ##
==========================================
- Coverage   67.13%   66.91%   -0.22%     
==========================================
  Files         357      357              
  Lines       21860    21932      +72     
  Branches     1943     1949       +6     
==========================================
  Hits        14674    14674              
- Misses       6166     6244      +78     
+ Partials     1020     1014       -6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[eolivelli]

I have left one question about protocol compatibility

Can you please add some unit tests ?

[RexXiong]

Thanks, BTW when the configuration is changed, you should also execute UPDATE=1 build/mvn clean test -pl common -am -Dtest=none -DwildcardSuites=org.apache.celeborn.ConfigurationSuite