Airflow Context in KubernetesPodOperator Callback

[gffryclrk]

Hi Airflow Community,

I'm new to the community and I have a question regarding KubernetesPodOperator Callbacks: is it possible to access the Airflow context from within these callback functions? I'd like to access task id, dag id & a few other context variables in the callback function but it seems that context isn't passed as an argument when the callbacks are called. This seems like a straightforward enough thing to add and I'm willing to create a PR but wanted to check and see if I was missing something first before doing so. Please let me know!

Thank you,

Geoffrey

[olivd4400]

Hello,

Did you get any news? I would also like to access context task instance to be able to push into xcom from those callbacks.

Regards,
Olivier

[gffryclrk]

Hi @olivd4400 , thank you for following up. I haven't heard any more about this but I think it would be useful. I'm going to look more into it in the coming weeks and will follow up on this thread when I have more information. Please let me know if you learn more. Thank you.

[perry2of5]

Looks like this is implemented in the latest versions:

https://github.com/apache/airflow/blob/main/providers/cncf/kubernetes/src/airflow/providers/cncf/kubernetes/operators/pod.py#L675

https://github.com/apache/airflow/blob/main/providers/cncf/kubernetes/src/airflow/providers/cncf/kubernetes/callbacks.py#L63

[gffryclrk]

Thank you @perry2of5 for pointing this out! It's very useful.

[gffryclrk]

Implemented. See above.