首先安装命令为:
pip install airflow
也可以:
pip install airflow[参数]
参数如下:
| subpackage | install command | enables |
|---|---|---|
| all |
pip install airflow[all]
|
All Airflow features known to man |
| all_dbs |
pip install airflow[all_dbs]
|
All databases integrations |
| async |
pip install airflow[async]
|
Async worker classes for gunicorn |
| devel |
pip install airflow[devel]
|
Minimum dev tools requirements |
| devel_hadoop |
pip install airflow[devel_hadoop]
|
Airflow + dependencies on the Hadoop stack |
| celery |
pip install airflow[celery]
|
CeleryExecutor |
| crypto |
pip install airflow[crypto]
|
Encrypt connection passwords in metadata db |
| druid |
pip install airflow[druid]
|
Druid.io related operators & hooks |
| gcp_api |
pip install airflow[gcp_api]
|
Google Cloud Platform hooks and operators (using google-api-python-client) |
| jdbc |
pip install airflow[jdbc]
|
JDBC hooks and operators |
| hdfs |
pip install airflow[hdfs]
|
HDFS hooks and operators |
| hive |
pip install airflow[hive]
|
All Hive related operators |
| kerberos |
pip install airflow[kerberos]
|
kerberos integration for kerberized hadoop |
| ldap |
pip install airflow[ldap]
|
ldap authentication for users |
| mssql |
pip install airflow[mssql]
|
Microsoft SQL operators and hook, support as an Airflow backend |
| mysql |
pip install airflow[mysql]
|
MySQL operators and hook, support as an Airflow backend |
| password |
pip install airflow[password]
|
Password Authentication for users |
| postgres |
pip install airflow[postgres]
|
Postgres operators and hook, support as an Airflow backend |
| qds |
pip install airflow[qds]
|
Enable QDS (qubole data services) support |
| rabbitmq |
pip install airflow[rabbitmq]
|
Rabbitmq support as a Celery backend |
| s3 |
pip install airflow[s3]
|
S3KeySensor, S3PrefixSensor
|
| samba |
pip install airflow[samba]
|
Hive2SambaOperator
|
| slack |
pip install airflow[slack]
|
SlackAPIPostOperator
|
| vertica |
pip install airflow[vertica]
|
Vertica hook support as an Airflow backend |
| cloudant |
pip install airflow[cloudant]
|
Cloudant hook |
可以直接使用：
pip install airflow[all]
这样就可以安装所有依赖的东西，
配置环境变量：
export AIRFLOW_HOME=~/airflow
配置mysql数据库存储airflow信息：
sql_alchemy_conn = mysql://user:[email protected]:port/airflow
初始化数据库：
airflow initdb
启动Web Server,指定端口:
airflow webserver –p 18080
安装成功界面：
后台显示：
OK，在默认的配置下可以玩了，如果需要将airflow的数据保存到数据库的话，就可以配置一下保存到数据库。