-
Notifications
You must be signed in to change notification settings - Fork 2.1k
Users/fabianm/spark scala2.13 #47492
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Users/fabianm/spark scala2.13 #47492
Conversation
…to users/fabianm/spark-scala2.13
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Pull request overview
This PR adds Scala 2.13 support for the Azure Cosmos DB Spark 3.5 connector by creating a new module azure-cosmos-spark_3-5_2-13. The changes include refactoring parent POMs to support parameterized Scala versions, adding CI/CD pipeline configurations for the new module, and creating documentation and configuration files for the Scala 2.13 variant.
Key Changes:
- New module
azure-cosmos-spark_3-5_2-13with Scala 2.13 support for Spark 3.5 - Parameterization of Scala version properties in parent POMs to support multiple Scala versions
- CI/CD pipeline updates to include the new module in build and test workflows
Reviewed changes
Copilot reviewed 20 out of 20 changed files in this pull request and generated 7 comments.
Show a summary per file
| File | Description |
|---|---|
| sdk/cosmos/spark.yml | Added new Databricks test configuration for Scala 2.13 variant |
| sdk/cosmos/spark.databricks.yml | Parameterized JAR_NAME to support multiple Spark/Scala versions |
| sdk/cosmos/pom.xml | Added azure-cosmos-spark_3-5_2-13 module to build |
| sdk/cosmos/ci.yml | Added new module to CI triggers, parameters, and artifacts list |
| sdk/cosmos/azure-cosmos-spark_3/pom.xml | Refactored to use parameterized Scala version properties |
| sdk/cosmos/azure-cosmos-spark_3-5_2-13/* | New module with POM, README, CONTRIBUTING, CHANGELOG, and config files |
| sdk/cosmos/azure-cosmos-spark_3-5_2-12/pom.xml | Added Scala version properties for consistency |
| sdk/cosmos/azure-cosmos-spark_3-5/pom.xml | Parameterized Scala dependencies |
| eng/versioning/version_client.txt | Added version entry for new module |
| eng/versioning/external_dependencies.txt | Added Scala 2.13 dependency entries |
| eng/.docsettings.yml | Added documentation settings for new module |
| .vscode/cspell.json | Added spelling exceptions for new module |
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
Co-authored-by: Copilot <[email protected]>
…to users/fabianm/spark-scala2.13
…bianMeiswinkel/azure-sdk-for-java into users/fabianm/spark-scala2.13
Description
Please add an informative description that covers that changes made by the pull request and link all relevant issues.
If an SDK is being regenerated based on a new swagger spec, a link to the pull request containing these swagger spec changes has been included above.
All SDK Contribution checklist:
General Guidelines and Best Practices
Testing Guidelines