Note: Follow @ApacheAirflow on Twitter for the latest news and announcements!

July 20, 2020

Airflow PMC welcomes Leah Cole (@leahecole) and Ry Walker (@ryw) as new Airflow Committers.

July 10, 2020

We’ve just released Airflow v1.10.11

PyPI - https://pypi.org/project/apache-airflow/1.10.11/

Docs - https://airflow.apache.org/docs/1.10.11/

ChangeLog - https://airflow.apache.org/docs/1.10.11/changelog.html

306 commits since 1.10.10 (12 New Features, 90 Improvements, 53 Bug Fixes, and several doc changes)

July 8, 2020

Airflow PMC welcomes Daniel Imberman (@dimberman), Tomek Turbaszek (@turbaszek), and Kamil Breguła (@mik-laj) as new PMC members, and QP Hou (@houqp) as a committer. Congrats!

July 6, 2020

The (virtual) Airflow Summit has begun – you can watch along at airflowsummit.org

Jun 24, 2020

We’ve just released Airflow Backport Provider Packages 2020.6.24

The Backport provider packages make it possible to easily use Airflow 2.0 Operators, Hooks, Sensors, Secrets, Transfers in Airflow 1.10. More stats below, but the Backport Provider packages increase the number of easily-available integrations for Airflow 1.10 users by a whopping 55%.

  • We have 58 backport packages in total. 599 classes (Operators, Hooks, Transfers, Sensors, Secrets)
  • We have 213 new (!) classes that have not been easily available to 1.10 users so far:
    • Operators: 150
    • Transfers: 12
    • Sensors: 14
    • Hooks: 37
    • Secrets: 0
  • We have 386 classes that were moved. Quite a number of those (hard to say exactly how many) got new features, options, parameters.
    • Operators: 204
    • Transfers: 36
    • Sensors: 46
    • Hooks: 96
    • Secrets: 4

List of the backport provider packages:

  1. Amazon
  2. Apache HDFS
  3. Apache Hive
  4. Apache Livy
  5. Apache Pig
  6. Apache Pinot
  7. Apache Spark
  8. Apache Sqoop
  9. Azure
  10. Cassandra
  11. Celery
  12. Cloudant
  13. Databricks
  14. Datadog
  15. Dingding
  16. Discord
  17. Docker
  18. Druid
  19. Elasticsearch
  20. Email
  21. Exasol
  22. Facebook
  23. FTP
  24. Google
  25. GRPC
  26. Hashicorp
  27. HTTP
  28. IMAP
  29. JDBC
  30. Jenkins
  31. JIRA
  32. Mongo
  33. MsSQL
  34. MySQL
  35. ODBC
  36. OpenFAAS
  37. OpsGenie
  38. Oracle
  39. PagerDuty
  40. Postgres
  41. Presto
  42. Qubole
  43. Redis
  44. Salesforce
  45. Samba
  46. Segment
  47. SFTP
  48. Singularity
  49. Slack
  50. Snowflake
  51. Sqlite
  52. SSH
  53. Vertica
  54. Winrm
  55. Yandex
  56. Zendesk

Apr 9, 2020

We’ve just released Airflow v1.10.10

PyPI - https://pypi.org/project/apache-airflow/1.10.10/

Docs - https://airflow.apache.org/docs/1.10.10/

Changelog - https://airflow.apache.org/docs/1.10.10/changelog.html

199 commits since 1.10.9 (11 New Features, 43 Improvements, 44 Bug Fixes, and several doc changes)

Mar 31, 2020

Airflow PMC welcomes Jiajie Zhong (@zhongjiajie) as its new committer. Congrats!

and

Second Warsaw Airflow Meetup is happening next week and it will be an online event!

Feb 7, 2020

We’ve just released Airflow v1.10.8

PyPI - https://pypi.org/project/apache-airflow/1.10.8/

Docs - https://airflow.apache.org/docs/1.10.8/

Changelog - http://airflow.apache.org/docs/1.10.8/changelog.html#airflow-1-10-8-2020-01-07

160 commits since 1.10.7 (4 new features, 42 improvements, 36 bug fixes, and several doc changes)

and

We’ve just released Airflow 1.10.9 (this one is a quick fix to work around the breaking release of Werkzeug 1.0)

PyPI - https://pypi.org/project/apache-airflow/1.10.9/

Docs - https://airflow.apache.org/docs/1.10.9/

2 commits since 1.10.8 :)

Dec 24, 2019

We’ve just released Airflow v1.10.7

PyPI - https://pypi.org/project/apache-airflow/1.10.7/

Docs - https://airflow.readthedocs.io/en/1.10.7/

Changelog - https://github.com/apache/airflow/blob/1.10.7/CHANGELOG.txt

217 commits since 1.10.6 including some Critical Bugfixes and Performance Improvements (17 new features, 57 improvements, 52 bug fixes, and several doc changes)

Dec 20, 2019

Airflow PMC welcomes Tomasz Urbaszek (@turbaszek) as its new committer. Congrats!

Nov 30, 2019

Airflow PMC welcomes Kengo Seki (@sekikn) to both its committer and PMC ranks. Congrats!

Nov 27, 2019

New website for Apache Airflow is live : https://airflow.apache.org

Same URL with more & better webpages

Nov 21, 2019

Airflow PMC has voted in & promoted Aizhamal Nurmamat kyzy (@Aizhamal) and Kevin Yang (@KevinYang21) to be a part of Airflow PMC.

Oct 28, 2019

We’ve just released ApacheAirflow v1.10.6

PyPI - https://pypi.org/project/apache-airflow/1.10.6/

Docs - https://airflow.apache.org/1.10.6/

168 commits since 1.10.5 (including 6 new features, 35 improvements, 38 bug fixes, and the usual swathe of doc fixes and CI improvements)

Oct 18, 2019

Airflow PMC has voted in & promoted Jarek Potiuk (@higrys) to be a PMC Member.

Jarek has been one of the most active community members and has spread the word about Airflow Well deserved Jarek, congratulations

Sep 24, 2019

What do you think of our new logo? #AirflowLogo #ApacheAirflow

Airflow

Sep 18, 2019

Two meetups are happening soon:

  1. Seattle, WA on Thursday 19th
  2. London, UK on Tuesday 24th

We’ll put links to any recordings here once they are available.

Sep 9, 2019

The PMC has just added two new Airflow Committers :

Sep 4, 2019

We’ve just released ApacheAirflow v1.10.5

PyPI - https://pypi.org/project/apache-airflow/1.10.5/

Docs - https://airflow.apache.org/1.10.5/

95 commits since 1.10.4 (including 3 new features, 17 improvements, 23 bug fixes, and lots more doc fixes and CI improvements)

Aug 6, 2019

We’ve just released ApacheAirflow v1.10.4

PyPI - https://pypi.org/project/apache-airflow/1.10.4/

Docs - https://airflow.apache.org/1.10.4/

377 commits since 1.10.3 (including 50 new features, 107 improvements, 91 bug fixes, and lots more doc fixes and CI improvements)

May 15, 2019

The community welcomes the latest Apache Airflow meetup group: The Melbourne Apache Airflow meetup. Stay tuned for its first meetup event!

May 2, 2019

The Apache Airflow PMC welcomes a slew of new committers to it ranks! The following contributors are now Airflow Committers:

Congratulations folks - Very well deserved.

Apr 10, 2019

New Apache Airflow release 1.10.3 is out!

Source, Binary “Sdist” & binary wheel release - https://www.apache.org/dist/airflow/1.10.3/

Pypi - https://pypi.org/project/apache-airflow/1.10.3/ (Run pip install apache-airflow)

Changelog - https://airflow.apache.org/1.10.3/changelog.html#airflow-1-10-3-2019-04-09

This release no longer needs the SLUGIFY_USES_TEXT_UNIDECODE/AIRFLOW_GPL_UNIDECODE environment variables at install time to avoid the GPL dependency!

Apr 3, 2019

The Apache Airflow NYC meetup is having its next meetup on April 29, 2019 – more details here.

If you are in or around NYC, please be sure to check it out!

Mar 18, 2019

The Apache Airflow PMC welcomes new committer, Daniel Imberman (@dimberman).

Mar 7, 2019

The Apache Airflow PMC welcomes new committer, Xiaodong Deng (XD-DENG)

Feb 14, 2019

We are pleased to announce our newest Meetup, this one in Portland, Oregon, USA.

Jan 22, 2019

New Apache Airflow release 1.10.2 is out!

Source & Binary “Sdist” release - https://dist.apache.org/repos/dist/release/airflow/1.10.2/

Pypi - https://pypi.python.org/pypi/apache-airflow (Run pip install apache-airflow)

Changelog - https://airflow.apache.org/changelog.html#airflow-1-10-2-2019-01-19

By default one of Airflow’s dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.

Jan 9, 2019

The Apache Airflow Paris meetup is having its second meetup on Feb 6, 2019 – more details here.

If you are in or around Paris, please be sure to check it out!

Jan 8, 2019

Apache Airflow graduates from the Incubator and is now a TLP!

Nov 21, 2018

New Apache Airflow release 1.10.1-incubating is out!

Source & Binary “Sdist” release - https://dist.apache.org/repos/dist/release/incubator/airflow/1.10.1-incubating/

Pypi - https://pypi.python.org/pypi/apache-airflow (Run pip install apache-airflow)

Changelog - https://github.com/apache/incubator-airflow/blob/v1-10-test/CHANGELOG.txt

By default one of Airflow’s dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.

Oct 16, 2018

We are excited to announce that the Paris Apache Airflow Meetup will be hosting its inaugural meetup on Nov 21

Speakers include Chauffeur Prive (event organizer). More to come soon!

Sept 17, 2018

The Singapore Big Data Meetup will host “Intro to Airflow” via @XD-DENG on Sept 27, 2018! Check it out! http://bit.ly/2PMgABT

Sept 10, 2018

We are excited to announce that the London Apache Airflow Meetup will be hosting its inaugural meetup on Sept 20.

Speakers include London committer Ash Berlin-Taylor & Ben Marengo from Just Eat!

Sept 9, 2018

The Bay Area Apache Airflow Meetup group will be hosting its next meetup at Google on Sept 24!.

Five 20-minute talks followed by 6 lightning sessions! Come one, come all!

Sept 8, 2018

We welcome the 7th & latest regional Apache Airflow Meetup, this one in Seattle.

Aug 26, 2018

The Apache Airflow Meetup group in Amsterdam will be hosting its 2nd meetup at GoDataDriven on Sep 12.

Aug 20, 2018

New Apache Airflow release 1.10.0-incubating is out!

Source & Binary “Sdist” release - https://dist.apache.org/repos/dist/release/incubator/airflow/1.10.0-incubating/

Pypi - https://pypi.python.org/pypi/apache-airflow (Run pip install apache-airflow)

Changelog - https://github.com/apache/incubator-airflow/blob/8100f1f/CHANGELOG.txt

By default one of Airflow’s dependencies installs a GPL dependency (unidecode). To avoid this dependency set SLUGIFY_USES_TEXT_UNIDECODE=yes in your environment when you install or upgrade Airflow. To force installing the GPL version set AIRFLOW_GPL_UNIDECODE. One of these two environment variables must be specified.

Aug 3, 2018

The Apache Airflow PPMC welcomes new committer and PPMC member, Tao Feng (@feng-tao)

Jun 1, 2018

We’re happy to welcome a new Apache Airflow Meetup group – this one in London, UK

May 23, 2018

We’re happy to welcome a new Apache Airflow Meetup group – this one in Chicago.

May 7, 2018

The Apache Airflow PPMC welcomes new committer and PPMC member, Kaxil Naik (@Kaxil)

Apr 9, 2018

The Bay Area Apache Airflow Meetup group will be hosting a meetup on April 11 at WePay.

Speakers from Slack, Google, and WePay will be presenting.

Feb 15, 2018

The Apache Airflow PPMC welcomes new committer and PPMC member, Ash Berlin-Taylor (@ashb)

Jan 2, 2018

New Apache Airflow release 1.9.0-incubating is out!

Source & Binary “Sdist” release - https://dist.apache.org/repos/dist/release/incubator/airflow/1.9.0-incubating/

Pypi - https://pypi.python.org/pypi/apache-airflow (Run pip install apache-airflow)

ReleaseNotes - https://github.com/apache/incubator-airflow/blob/master/CHANGELOG.txt

Special Thanks to Chris Riccomini (@criccomini) and Bolke de Bruin (@bolkedebruin) for tirelessly shepherding this release!

Nov 30, 2017

The Apache Airflow PPMC welcomes new committer and PPMC member, Joy Gao (@joygao)

Nov 27, 2017

The Apache Airflow Meetup group in Amsterdam will be hosting its 1st meetup (Heineken) on Dec 21.

Niels Zeilemaker from GoDataDriven will present Using Azure Container Instances as a cheap method to run Heineken data science workloads, and Daniel van der Ende from ING Wholesale banking Advanced Analytics will talk about Data Tests using Apache Airflow.

Nov 5, 2017

We”re happy to welcome a new Apache Airflow Meetup group in Amsterdam

Nov 1, 2017

Next Bay Area Airflow meet-up hosted by Airbnb this December (Dec 4)

Slides are available here.

Oct 1, 2017

The Apache Airflow PPMC welcomes new committer and PPMC member, Fokko Driespong (@fokko)

Sept 6, 2017

New Apache Airflow release 1.8.2-incubating is out!

Source & Binary “Sdist” release - https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.2-incubating/

Pypi - https://pypi.python.org/pypi/apache-airflow

Release Notes - http://bit.ly/2gH9QFx

Special Thanks to Maxime Beauchemin (@mistercrunch) for tirelessly shepherding this release!

April 12, 2017

We”re happy to welcome a new Apache Meetup group in Tokyo

Their first event is being held on May 11

Slides :

March 19, 2017

The first official Apache Airflow release (1.8.0-incubating) is out!

Git Tag: https://github.com/apache/incubator-airflow/releases/tag/1.8.0%2Bapache.incubating

Change log: 205 commits as shown in Changelog (1.8.0-incubating)

Tarball: https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0-incubating/

  • You can install via :

    pip install https://dist.apache.org/repos/dist/release/incubator/airflow/1.8.0-incubating/airflow-1.8.0+apache.incubating.tar.gz
    

PyPi: coming soon, check https://pypi.python.org/pypi/airflow

  • Once available, you can install via :

    pip install airflow --upgrade
    

Note: remember to run airflow upgradedb after installation

Thanks to everyone in the community that helped bring this about. A special thanks is due to Bolke de Bruin (@bolkedebruin) for valiantly shepherding this release!

Mar 14, 2017

The Apache Airflow PPMC welcomes new committer and PPMC member, Alex Guziel (@saguziel)

Feb 3, 2017

We”re happy to welcome a new Apache Meetup group in NYC

Feb 2, 2017

Next Bay Area Apache Airflow Meet-up (at PayPal) on Mar 14 : http://bit.ly/2knyNHv

Jan 30, 2017

Next New York Apache Airflow Meet-up (at Blue Apron) on Feb 1

Sign-up: https://docs.google.com/spreadsheets/d/1WmfgZeExSVdLf-u1uh3IleeHy8QTwaJ4BkkSkVM-X1E/edit#gid=0

Time: 6:30 - 9pm EST

Location: 40 W 23rd St. New York, NY 10010 (5th floor)

Nov 28, 2016

The Apache Airflow PPMC welcomes new committer and PPMC member, Alex Van Boxel (@alexvanboxel)

Video from the Nov 16 meet-up (at WePay) is now available at : https://wepayinc.app.box.com/s/1183ra3z8gxf8fridysu4wbjckg1s05v

Oct 12, 2016

New Apache Airflow Meet-up (at WePay) on Nov 16 : http://bit.ly/2dwKNls

Sept 21, 2016

New Apache Airflow Meet-up (at Stripe) on Sept 21 : http://www.meetup.com/Bay-Area-Apache-Airflow-Incubating-Meetup/events/233316814/

Sept 6, 2016

New Warsaw (Poland) Hadoop User Group Meet-up on Sept 14 : http://www.meetup.com/warsaw-hug/events/233912332/

August 19, 2016

The Apache Airflow PPMC welcomes new committer and PPMC member, Li Xuanji (@zodiac))

August 16, 2016

The Apache Airflow PPMC welcomes new committer and PPMC member, Sumit Maheshwari (@msumit)

June 15, 2016

Video of yesterday’s Apache Airflow Meet-up talk featuring talks from WePay, Agari, and Yahoo is now available at http://bit.ly/1S69hOr

May 27, 2016

The first-ever Airflow Contributor Meeting will take place at 11AM PST on June 1st.

https://airbnb.webex.com/join/gurer.kiratli

Agenda

  • Ways to mitigate risks when rolling out new Airflow releases into production
  • Clarifying the process for working on large efforts
  • Refreshing the current roadmap
  • Communicate about how Airbnb will share information about sprints and internal roadmap moving forward

May 20, 2016

Airflow 1.7.1.2 released: Pypi or via Git tag – 214 commits as per CHANGELOG.txt

  • To install via Pypi,

    • on a fresh install (e.g. fresh virtualenv install)

      pip install airflow (or pip install airflow==1.7.1.2)
      
    • or upgrade via

      pip install airflow --upgrade
      

Special thanks to Dan Davydov (@aoen) for tirelessly shepherding this release!

May 20, 2016

Steven Yvinec-Kruyk (@syvineckruyk) joins the Apache Airflow Committer and PPMC group today. Please give him a hearty welcome and of course.. ask him to review your PRs and answer any questions you may have :)

April 29, 2016

Want to keep abreast of new Apache Airflow updates (e.g. releases, meet-ups, new features, conference talks, etc… ), follow our newly-minted Twitter account : @ApacheAirflow

April 27, 2016

We are starting the migration to Apache Infrastructure (e.g. Github Issues –> Jira, Airbnb/Airflow Github to Apache/Airflow Github, Airbnb/Airflow Github Wiki to Apache Airflow Confluence Wiki)

  • The progress and migration status will be tracked on Migrating to Apache
  • We expect this to take roughly 1 week. On and after May 4, we expect to be using Apache infrastructure exclusively. To prepare for that day, start using the new Apache infrastructure and follow instructions on this JIRA ticket AIRFLOW-11 to set up your accounts.

April 22, 2016

Sid Anand (@r39132) will be speaking on July 23 at Data Day Seattle

  • If there is enough interest, I’d be happy to also speak at a meetup

April 12, 2016

A 1.7.1. lightweight tag was mistakenly pushed to master - we don’t yet have a viable 1.7.1 release candidate. On April 12, @r39132 deleted the tag on master

April 6, 2016

We now have an Apache Airflow meet-up group for folks in the Bay Area: Sign up today to get notified of upcoming meet-ups!

March 28, 2016

Folks, A new release (1.7.0) is out via Pypi and git tag

March 24, 2016

Folks, A new release candidate version of Airflow is ready for the community to try: 1.7.0rc1

  • Please check it out and report any issues that you see

March 19, 2016

This week, we applied for Airflow’s entry to the Apache Incubator

  • Airflow Proposal
  • We promoted several contributors to committers based on a proven track-record of contributions to the project and a strong commitment to improving the project going forward
  • We published a WIP Roadmap [ARCHIVED] and welcome comments and input from the community

March 1, 2016

Airbnb will be hosting the very first Airflow meetup at Airbnb HQ (888 Brannan, in SF) on March 28th.

We’re planning on doing this regularly, and want to put a good line up of food, drinks and talks for you all.

It should be pretty informal, but here’s a draft of the schedule for the night:

  • meet, geet and eat
  • updates on the project, roadmap & upcoming Airbnb sprints
  • present advanced/complex Airbnb Airflow use cases (A/B testing framework, anomaly detection or something of that nature)
  • Sid Anand will share about how they use Airflow at Agari
  • Q/A for the core project team
  • Community open mic, step up and make announcements if you’re recruiting, looking for help, planning on working on a feature, …
  • Define list of subjects of interest on a whiteboard for breaking into subject specific subgroups for discussion

Please RSVP here: https://www.airbnb.com/meetups/daywndmbd-airflow

We’re planning on starting to have Airflow meetups regularly, so stay tuned!