-
Notifications
You must be signed in to change notification settings - Fork 715
[feat][evaluation] third party evaluator #331
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
…rsion for backward compatibility
… SubmitExperimentRequest has already switched to identifying evaluator version with evaluator_id & version
…'s inner EvaluatorConf for env and runtime ext
Codecov Report❌ Patch coverage is ❌ Your patch check has failed because the patch coverage (76.34%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage. @@ Coverage Diff @@
## main #331 +/- ##
==========================================
+ Coverage 69.92% 69.93% +0.01%
==========================================
Files 610 610
Lines 56835 56940 +105
==========================================
+ Hits 39740 39822 +82
- Misses 14144 14163 +19
- Partials 2951 2955 +4
Flags with carried forward coverage won't be shown. Click here to find out more.
... and 2 files with indirect coverage changes Continue to review full report in Codecov by Sentry.
🚀 New features to boost your workflow:
|
What type of PR is this?
Check the PR title
(Optional) Translate the PR title into Chinese
(Optional) More detailed description for this PR(en: English/zh: Chinese)
en:
zh(optional):
(Optional) Which issue(s) this PR fixes