ETL Pipelines
-
LAB: Watch me write an Airflow DAG pipeline that analyzes web server log files
In this lab, I was required to write an Airflow DAG pipeline that analyzes web server log files, extracts the required lines and fields, transforms and loads the data to a compressed file.