Airflow 3 Metadata DB and Log Cleanup Jobs?

[saaifali]

HI,
As Airflow 3 now does not allow direct DB access, I have some DAGs in Airflow 2 which were used to cleanup the logs and the MEtadata DB periodically.

I tried converting my DAGS to run the CLI command : airflow db clean But it always returns some error :
sqlalchemy.exc.ArgumentError: Could not parse SQLAlchemy URL from string 'airflow-db-not-allowed:///'

Is the DAG the right way to go about setting up DB cleanups or is there another way recommended by Airflow which i seemed to have missed out on?

[potiuk]

Is the DAG the right way to go about setting up DB cleanups or is there another way recommended by Airflow which i seemed to have missed out on?

You can run regular cron or other way of scheduling simple jobs. There is no particular reason to mix scheduling of your Data pipelines with a cleanup of Airflow DB. Depending on your installation pretty much all installation methods have some form of regularly running "simple CLI command" without the complexity of Airflow DAG, dependencies, remote workers etc.

[saaifali]

Thanks a lot!