Search code examples
workflowairflowdata-pipeline

What's the difference between task and job in airflow

there

In the airflow meta database, a table named job, and there are lots of records in there. I know the difference between DAGRun and task, but what's the difference between task and job in airflow?

Thanks in advance.

Solution

  • The job table is managed by the BaseJob class and is extended by other classes (via SQLAlchemy inheritance) whose purpose is to represent the state of some process, notably the SchedulerJob class.