March 2024 – now Senior Data Engineer

• Leading ETL pipeline transformation projects using Python and PySpark on the Databricks platform, deploying to AWS clusters.
• Working across the organisation with a variety of stakeholders to deliver complex projects with strict financial constraints and timelines.
• Investing time into improving the Data Engineering function and taking an active role in developing best practices

Jan 2022 – Feb 2024 Data Engineer

• Delivering ETL pipelines using Python and PySpark on the Databricks platform, deploying to AWS clusters. Delivering efficient code for large datasets, focusing on test-based development.
• Working agile with multi-disciplinary teams and different specialties across the organisation.
• Developing using the Databricks IDE, Visual Studio Code, PyCharm, Git, Ubuntu and Docker.

July 2019 – Jan 2022 Associate Data Engineer

• Continuing to develop ETL pipelines within data engineering, with greater emphasis on leading projects in Agile and bigger responsibilities in customer requirement gathering.
• Developing technical knowledge on Python and Databricks by delivering projects on DPS.
• Contributing to the COVID-19 Shielded Patients List, helping millions of people nationwide.
• As a line manager, mentoring apprentices and new starters to succeed in the organisation.
• Taking on assessment duties, playing an active role in shaping futures of graduates & interns.

Dec 2017 – June 2019 Junior Data Engineer

• Worked to develop within the full life cycle of data engineering & data management, from asset & process development, maintenance, right through to delivery of data products.
• Used tools such as SQL Server 2016, Visual Studio 2017, SSIS, JIRA, TeamCity and Octopus to develop data warehouses and data pipelines in an agile framework to deliver continuous integration. Also worked on migrating SQL Server 2008 R2 Projects to SQL Server 2016

2014 – 2017 Various Data Analyst roles (non healthcare)