Senior Data Engineer

About this job

WPP is a trusted growth partner for the world's leading brands, uniting media intelligence, data solutions, creativity, and transformative enterprise solutions through its agentic marketing platform, WPP Open. As a Senior Data Engineer, you will join the growing data team to design, build, and optimize scalable data lakehouse platforms using Google BigQuery or Databricks. A normal day in this role involves developing and maintaining robust ETL and ELT pipelines, ingesting data from sources like GA4, implementing Medallion Architecture layers, optimizing query and Spark performance, ensuring data governance, and collaborating closely with analytics and business stakeholders across a multi-cloud environment spanning Azure, AWS, and GCP.

Responsibilities

• Design and build ETL/ELT pipelines using SQL, Python, PySpark, and Spark SQL within BigQuery or Databricks.
• Implement Medallion Architecture using Delta Lake or BigQuery datasets for progressive data refinement.
• Ingest data efficiently from sources like GA4 using native tools like BigQuery Data Transfer Service or Databricks Auto Loader.
• Develop and schedule complex data workflows using Cloud Composer, Airflow, or Databricks Workflows.
• Optimize BigQuery tables and Spark jobs for maximum performance and cost efficiency.
• Implement data governance, security, and lineage using Unity Catalog, Dataplex, or policy tags.
• Provide production support and collaborate with business teams to deliver reliable gold-layer datasets.

Requirements

• Minimum of a bachelor’s degree in computer science, Engineering, Mathematics, or a related technical field.
• 8+ years of relevant experience in data engineering with distributed systems.
• Deep expertise in Google BigQuery and/or Databricks lakehouse platforms.
• 5+ years of strong hands-on experience in Python, specifically with PySpark.
• 6+ years of advanced SQL experience including window functions and CTEs.
• 8+ years of hands-on experience across Azure, AWS, and GCP cloud environments.
• Experience with CI/CD pipelines, version control with Git, and data orchestration tools like Airflow.

Good to have

• Experience with Terraform for Infrastructure as Code.
• Familiarity with BI tools such as Looker or Power BI.
• Experience integrating Snowflake data warehouses.

Who should apply

This role suits experienced data engineers with a strong multi-cloud background and deep expertise in modern lakehouse platforms like BigQuery and Databricks. Candidates should possess extensive programming skills in Python and advanced SQL, along with a collaborative and open-minded working style suited for WPP's inclusive environment. Freshers should not apply, as this position requires significant senior-level industry experience.

Frequently asked questions