Or worse, airflow!

Airflow can be frustrating but when it works it is so satisfying.

I think mistaking Airflow for a mere "task scheduler" is part of that frustration.

After using Argo Workflows, I don't think I will ever return to Airflow. Kubernetes is not an easy system to manage, but managing an Airflow setup is somehow worse. The story around disaster recovery and scheduler redundancy was an absolute nightmare for me.

Argo workflows is much more painful for data processing than Airflow in my experience.

It’s a tradeoff. Ease of modeling the pipelines vs ease of managing the infrastructure. Im not really a fan of either syntax for defining DAGs, but they're the best options out there imo.