Reparsing of unmodified DAGs

[igorlovich]

Hello,
Would it make sense to have an option on the dag processor to skip unmodified files ? I have seen the issue 21089 and understand the justification given. In our usecase we have thousands (no real limit but today at around 10000) of DAGs that are static for the majority of the time. At "steady state"' new DAGs are added, existing DAGs are deleted or modified; however this represents a tiny fraction of the total number of DAGs.
We have adjusted the min_file_process_interval to be as high as is acceptable but would like to avoid the reparsing of the 99.99% of DAGS that have not changed. What are your thoughts ?

[potiuk]

Yes. It's planned in future versions.

[potiuk]

See options explained https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=294816356 -> and you are free to work on contributing it BTW.