Skip to content

Bump Airflow version to 1.10.3#355

Merged
puckel merged 7 commits intopuckel:masterfrom
medmrgh:master
Jun 6, 2019
Merged

Bump Airflow version to 1.10.3#355
puckel merged 7 commits intopuckel:masterfrom
medmrgh:master

Conversation

@medmrgh
Copy link
Copy Markdown
Contributor

@medmrgh medmrgh commented Apr 12, 2019

This PR is about to bump airflow release to 1.10.3, changelog is available on : https://github.com/apache/airflow/blob/1.10.3/CHANGELOG.txt

The main changes are :

  • Implement new Airflow config file
  • Modify Dockerfile / entrypoint to meet airflow 1.10.3 requirements
  • Bump CI/CD check for airflow 1.10.3
@darshanvarabhi
Copy link
Copy Markdown

Hey people,

Any ETA on the merge of this Pull Request?

Copy link
Copy Markdown

@dostiharise dostiharise left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR. I have noticed a few changed to be made.

Hope this helps.

Cheers!

Comment thread script/entrypoint.sh Outdated
Comment thread script/entrypoint.sh Outdated
Comment thread config/airflow.cfg
Comment thread config/airflow.cfg Outdated
Comment thread Dockerfile
# Airflow
ARG AIRFLOW_VERSION=1.10.3
ARG AIRFLOW_HOME=/usr/local/airflow
ARG AIRFLOW_USER_HOME=/usr/local/airflow
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why change the arg name - you can (and often do) have the same ARG and ENV name.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In fact, Airflow user home (system) may be different than Airflow home dir(application). That's why i used two differents args.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's also useful to have the ENV AIRFLOW_HOME propagate into downstream Dockerfiles, which doesn't happen with an ARG.

@legal90 legal90 mentioned this pull request May 15, 2019
@enys
Copy link
Copy Markdown

enys commented May 29, 2019

Hi, thumbs up for the PR, any chance of seeing this go forward during this week ? Thanks

@puckel puckel merged commit 7007b37 into puckel:master Jun 6, 2019
stungkit referenced this pull request in stungkit/docker-airflow Jun 6, 2019
Bump Airflow version to 1.10.3 (#355)
vpavlin referenced this pull request in opendatahub-io-contrib/docker-airflow Apr 15, 2020
* Bump airflow version (#2) (#304)

* Bump Airflow Version to 1.10.2
* Fix CI

* Bump Airflow version to 1.10.3 (#355)

* Bump airflow 1 10 3 (#3)
* use the user home as airflow home
* remove unused var env
* set default config & remove duplicated line

* Pin Debian version to prevent unintended OS upgrade (#401)

* Bump to Airflow 1.10.4 and Python 3.7

* starting scheduler for SequentialExecutor (#359)

* Bump to Airflow 1.10.6

* circleci - remove docker_layer_caching

* remove circleci

* Create ci.yml

* Update README.md

* Fix bug with kubernetes executor (#470)

* Bump to Airflow 1.10.7

* FIX entrypoint.sh preventing regular and legitimate use-cases (#495)

This commit fixes the entrypoint.sh script in order to comply to the user provided
configurations. If they provided AIRFLOW__ environment variables, the entrypoint.sh
*must not* override them.

It also adds a new PostgreSQL configuration variable POSTGRES_EXTRAS in order to enable
TLS encryption. See the Airflow documentation "PostgreSQL Connection" about this.

It also adds two new Redis configuration variables REDIS_PROTO which was previously hardcoded
to redis:// (in order to prepare the possible use of rediss://), and REDIS_DBNUM which was
previously hardcoded to 1 (that prevents any use of a mutual broker between Airflow instances).

It also adds the corresponding documentation about PostgreSQL and Redis variables.

* Bump to Airflow 1.10.8

* Fix issue between flask-admin and werkzeug 1.0.0

* Bump to Airflow 1.10.9

* Debian base image - Move from 3.7-slim-stretch to 3.7-slim-buster

* user Airflow in group root

* user Airflow in group root

* user Airflow in group root

* testing entrypoint from barneys/docker-airflow

* change sql host to pc-base-sql

* bug fixes

* added ./profile to propogate db connection string

* Make load examples False

Co-authored-by: Med <medmrgh@users.noreply.github.com>
Co-authored-by: Jesus Abarca <jabas06@gmail.com>
Co-authored-by: Puckel_ <contact@puckel.fr>
Co-authored-by: nsepetys <noah@workmarket.com>
Co-authored-by: Kevin O'Riordan <koriordan@earnestresearch.com>
Co-authored-by: Noël Bardelot <noel@bardelot.fr>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

7 participants