Support SQLAlchemy 2

[bmritz]

Summary

Support SqlAlchemy version 2.X as a dependency.

Details

I'd like to be able to use the latest versions of SQLAlchemy with sqlalchemy-exasol.

Background & Context

Currently, when Installing sqlalchemy-exasol in an environment where there are other sqlalchemy tools, this library prevents the user from using the latest version of SQLAlchemy.

References

https://docs.sqlalchemy.org/en/20/changelog/whatsnew_20.html#

[Nicoretti]

Hi @bmritz,

Thanks for raising this issue! Internally, we've initiated discussions with our project management team regarding including this in our roadmap. We'll keep this issue updated as we make progress on the SQLAlchemy2 upgrade.

Lastly, I have a quick question: Are you planning to upgrade all code to SQLAlchemy2 once it's available, or are there systems/codes of yours that still will rely on 1.4.x?

Best,
Nico

[bmritz]

Thanks Nicola -- good to hear there's already some discussion! With this update we'd be set to upgrade everything in our monorepo to SQLAlchemy 2. We're on 1.4.X right now, and it appears that it still is supported by the SQLAlchemy team, and receives bugfixes, so it's not a huge issue for use now, but I anticipate it will become one at some point in the future. Thanks for the reply!

…

On Thu, Nov 30, 2023 at 2:24 AM Nicola Coretti ***@***.***> wrote: Hi @bmritz <https://github.com/bmritz>, Thanks for raising this issue! Internally, we've initiated discussions with our project management team regarding including this in our roadmap. We'll keep this issue updated as we make progress on the SQLAlchemy2 upgrade. Lastly, I have a quick question: Are you planning to upgrade all code to SQLAlchemy2 once it's available, or are there systems/codes of yours that still will rely on 1.4.x? Best, Nico — Reply to this email directly, view it on GitHub <#413 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AB3KKG7MGFGHWGRGSAYK64DYHAYDZAVCNFSM6AAAAAA77V3236VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMZTGIZTMMBYGQ> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[Nicoretti]

Note: To simplify the project's SQLA2 migration/support, deprecated dialects should be dropped first:

• 🔧 Remove turbodbc support #403
• 🔧 Remove pyodbc support #404

[danaut]

Hello,

May I ask if there are any updates on this issue?
It looks like SQLAlchemy 1.4.X does no receive any (security) updates anymore. Additionally, when used in combination with pandas read_sql(), I have to use pandas<2.2.0.

Best regards,
Daniel

[ArBridgeman]

@danaut Thanks for pinging us. I'll check with my PM for the status.

[niklaslorenzatalligator]

@ArBridgeman @danaut Any News or ETA on this one? We are also hitting a block using sqlalchemy-exasol 5.1.0 and dlthub because the ssl configuration can not be properly handled. From our point of view, sqlalchemy version 2 could be a solution because there is an additional parameter present in the ssl config.

[ArBridgeman]

@niklaslorenzatalligator , @danaut I'm elevating these concerns to our PM. It's on our foreseeable list.

[raayu83]

Hi,

we are also planning to evaluate sqlalchemy-exasol with dlt.
Is there any timeline for the upgrade to SQLAlchemy 2.x?

[ArBridgeman]

@raayu83 I'll elevate this to our PM. As written, it's on our foreseeable list.

[ThomasBestfleisch]

@raayu83 we plan to built a proper Exasol destination for dlt, so you don't need sqlalchemy. Can't tell you an ETA but it is on the near-term backlog.

[raayu83]

Hi @ThomasBestfleisch ,

that sounds great!
I was already worried because it felt like fewer and fewer of the more recent tools have Exasol support.
Nice to see a change in the right direction!

[raayu83]

One more question... will it be only a destination or also a source?
We have to move data between multiple database systems, so while a lot of data goes into Exasol, moving data out of Exasol is just as important to us.

[ThomasBestfleisch]

@raayu83 first we plan to implement the destination, but it's good to know that you also would like to use Exasol as a source.