Labs
-
LAB: Watch me use Apache Spark to analyze web search data and load a pre-trained sales forecasting machine learning model
In this lab, I was tasked with analyzing e-Commerce web search data using JupyterLab and PySpark. Additionally, I was required to load a pre-trained sales forecasting model to predict sales for 2023.
-
LAB: Watch me write an Airflow DAG pipeline that analyzes web server log files
In this lab, I was required to write an Airflow DAG pipeline that analyzes web server log files, extracts the required lines and fields, transforms and loads the data to a compressed file.
-
LAB: Watch me write a Python script that automates data synchronization between MySQL and DB2
In this lab, I was tasked with writing a Python script that automates the process of regularly synchronizing data between MySQL and DB2.