Is the json override in airflow_local_settings.py still relevant?
#54387
Unanswered
kyungjunleeme
asked this question in
Ideas
Replies: 2 comments 1 reply
-
|
I don't even know why it's there. IMHO we should remove it - maybe you could track the history of it by git history and you will find more explanations and you can ask the right person who did it and why - because I doubt there is even a general knowledge that this paragraph is there. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I’ve looked into this and confirmed that this part is valid. Rather, I think it would be better to add an explanation in the documentation about where it can be used, so that users can understand it more easily. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello. I’m wondering if this approach
https://airflow.apache.org/docs/apache-airflow/stable/administration-and-deployment/dag-serialization.html#using-a-different-json-library
is still relevant or useful in real-world Airflow deployments.
Why it might have limited value
Limited scope – This override only affects Airflow components that import
jsonfromairflow_local_settings. Many operators, hooks, and provider packages import Python’s built-injsonmodule directly, so they wouldn’t be impacted.Minimal performance gains – In most Airflow environments, performance bottlenecks are related to I/O (e.g., DB queries, network calls, XCom storage) rather than JSON parsing speed. Switching to something like
ujsonmay not yield noticeable improvements.Compatibility risks – Alternative libraries can behave differently (e.g., handling of
datetime,Decimal,NaN), which might cause subtle bugs or inconsistencies, especially in XCom serialization.Questions for the community
I’d love to hear thoughts from the community and maintainers.
If the consensus is that this is no longer valuable, perhaps we could update the docs to reflect that.
Beta Was this translation helpful? Give feedback.
All reactions