The Lead, Big Data Analytics & Engineering will oversee data engineering, analytics enablement, and collaboration across teams, focusing on high-quality data platforms and solutions.
Our Purpose
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead, Big Data Analytics & Engineering
Job Posting Title: Lead, Big Data Analytics & EngineeringAbout Mastercard
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere-by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact-inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.About the Role
The Lead, Big Data Analytics & Engineering role is a senior technical leadership position focused on data engineering, data unification, and large scale analytics enablement across enterprise data assets.
This role plays a critical part in building a single, trusted, and scalable view of data by integrating diverse internal and external data sources. The position directly supports the delivery of data driven products, platforms, and insights, particularly in the areas of Value Quantification, Cyber Intelligence, and Analytics led solutions.
As a technical lead, you will combine hands on engineering leadership with strong cross functional collaboration, partnering closely with Product Management, Data Science, Platform Strategy, and Technology teams to design and deliver high impact data solutions that generate measurable business value.Key Responsibilities
Data Engineering & Platform Leadership• Lead the ingestion, transformation, aggregation, and processing of large scale datasets to enable advanced analytics and downstream consumption.• Design, build, and maintain robust, scalable data pipelines across Hadoop and enterprise data platforms, ensuring high standards of data quality, reliability, performance, and availability.• Drive data unification initiatives, integrating multiple structured and semi structured data sources into a cohesive, governed analytical foundation.
Advanced Analytics Enablement• Manipulate and analyse high volume, high velocity, and high dimensional datasets using modern big data frameworks.• Analyse large volumes of transactional and product data to produce insights and actionable recommendations that support business growth and value realisation.• Apply metrics, measurement frameworks, and benchmarking techniques to evaluate solution effectiveness and drive continuous improvement.
Cross Functional Collaboration• Partner with Product Managers, Data Science, Platform Strategy, and Technology teams to understand analytical and data requirements and translate them into scalable engineering solutions.• Act as a technical bridge between business, analytical, and engineering teams, clearly articulating architecture decisions, trade offs, and implementation approaches.• Enable alignment across stakeholders to ensure data solutions are directly tied to business and customer outcomes.
Innovation & Value Creation• Identify innovation opportunities and deliver proofs of concept, prototypes, and pilot solutions aligned to near term and future business needs.• Integrate new and emerging data assets that enhance existing platforms, products, and services, strengthening overall value propositions.• Gather and synthesise feedback from clients, product, engineering, and sales teams to inform new solutions and product enhancements.
Technical Leadership & Mentorship• Provide technical leadership, guidance, and mentorship to data engineers and analysts, setting standards for engineering quality, scalability, performance, and maintainability.• Promote best practices in data modelling, pipeline design, performance optimisation, and data governance.• Influence engineering standards, architectural consistency, and long term platform sustainability.All About You
Technical Skills & Experience• Strong proficiency in Python, including Pandas, NumPy, PySpark, with hands on experience using Impala.• Proven experience working on Hadoop based platforms, performing large scale data extraction, transformation, and processing.• Strong SQL skills and experience working with both relational and distributed data stores.• Experience with enterprise data platforms and business intelligence ecosystems.• Hands on experience with ETL / ELT and data integration tools, such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.• Experience in data modelling, querying, data mining, and reporting over large volumes of granular data.• Exposure to machine learning concepts and analytical techniques used in advanced data solutions.• Experience with Graph Databases is a plus.• 8+ years of experience in data engineering, big data analytics, or enterprise data platforms, including 2+ years in a lead or technical leadership role.• Experience working with cloud based data platforms (Azure, AWS, or GCP), including data lakes, distributed compute, and storage services.• Experience implementing CI/CD pipelines and DevOps practices for data engineering workflows.
GenAI / LLM Skills (Preferred)• Experience enabling GenAI/AI products through scalable, reliable data ingestion and transformation pipelines (batch and streaming).• Exposure to unstructured and semi-structured data processing (documents/logs/text) and building curated datasets for downstream consumption.• Strong understanding of data governance, privacy, and security requirements when using enterprise data with AI (PII handling, access control, auditability).• Familiarity with operationalizing AI data workflows (monitoring, data quality checks, reproducibility, and cost-aware scaling in cloud environments).
Analytical & Business Acumen• Strong experience collecting, standardising, and summarising diverse datasets while identifying patterns, inconsistencies, and data quality issues.• Solid understanding of how analytics, metrics, and visualisation support business decision making.• Ability to comprehend complex operational systems and deliver scalable analytics and information products to a global user base.
Ways of Working• Comfortable operating in a fast paced, delivery driven environment, both as a hands on contributor and a technical leader.• Ability to move seamlessly between business, analytical, and technical contexts, communicating clearly with diverse audiences.• Demonstrates Mastercard's DQ values, with a collaborative, inclusive, and customer centric mindset.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.
Title and Summary
Lead, Big Data Analytics & Engineering
Job Posting Title: Lead, Big Data Analytics & EngineeringAbout Mastercard
Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere-by making transactions safe, simple, smart, and accessible. Through secure data, trusted networks, partnerships, and innovation, we enable individuals, financial institutions, governments, and businesses to realise their greatest potential.
Our culture is defined by our Decency Quotient (DQ), guiding how we work, collaborate, and create impact-inside and outside our company. With a presence across more than 210 countries and territories, we are building a sustainable world that unlocks priceless possibilities for all.About the Role
The Lead, Big Data Analytics & Engineering role is a senior technical leadership position focused on data engineering, data unification, and large scale analytics enablement across enterprise data assets.
This role plays a critical part in building a single, trusted, and scalable view of data by integrating diverse internal and external data sources. The position directly supports the delivery of data driven products, platforms, and insights, particularly in the areas of Value Quantification, Cyber Intelligence, and Analytics led solutions.
As a technical lead, you will combine hands on engineering leadership with strong cross functional collaboration, partnering closely with Product Management, Data Science, Platform Strategy, and Technology teams to design and deliver high impact data solutions that generate measurable business value.Key Responsibilities
Data Engineering & Platform Leadership• Lead the ingestion, transformation, aggregation, and processing of large scale datasets to enable advanced analytics and downstream consumption.• Design, build, and maintain robust, scalable data pipelines across Hadoop and enterprise data platforms, ensuring high standards of data quality, reliability, performance, and availability.• Drive data unification initiatives, integrating multiple structured and semi structured data sources into a cohesive, governed analytical foundation.
Advanced Analytics Enablement• Manipulate and analyse high volume, high velocity, and high dimensional datasets using modern big data frameworks.• Analyse large volumes of transactional and product data to produce insights and actionable recommendations that support business growth and value realisation.• Apply metrics, measurement frameworks, and benchmarking techniques to evaluate solution effectiveness and drive continuous improvement.
Cross Functional Collaboration• Partner with Product Managers, Data Science, Platform Strategy, and Technology teams to understand analytical and data requirements and translate them into scalable engineering solutions.• Act as a technical bridge between business, analytical, and engineering teams, clearly articulating architecture decisions, trade offs, and implementation approaches.• Enable alignment across stakeholders to ensure data solutions are directly tied to business and customer outcomes.
Innovation & Value Creation• Identify innovation opportunities and deliver proofs of concept, prototypes, and pilot solutions aligned to near term and future business needs.• Integrate new and emerging data assets that enhance existing platforms, products, and services, strengthening overall value propositions.• Gather and synthesise feedback from clients, product, engineering, and sales teams to inform new solutions and product enhancements.
Technical Leadership & Mentorship• Provide technical leadership, guidance, and mentorship to data engineers and analysts, setting standards for engineering quality, scalability, performance, and maintainability.• Promote best practices in data modelling, pipeline design, performance optimisation, and data governance.• Influence engineering standards, architectural consistency, and long term platform sustainability.All About You
Technical Skills & Experience• Strong proficiency in Python, including Pandas, NumPy, PySpark, with hands on experience using Impala.• Proven experience working on Hadoop based platforms, performing large scale data extraction, transformation, and processing.• Strong SQL skills and experience working with both relational and distributed data stores.• Experience with enterprise data platforms and business intelligence ecosystems.• Hands on experience with ETL / ELT and data integration tools, such as Apache Airflow, Apache NiFi, Azure Data Factory, Pentaho, or Talend.• Experience in data modelling, querying, data mining, and reporting over large volumes of granular data.• Exposure to machine learning concepts and analytical techniques used in advanced data solutions.• Experience with Graph Databases is a plus.• 8+ years of experience in data engineering, big data analytics, or enterprise data platforms, including 2+ years in a lead or technical leadership role.• Experience working with cloud based data platforms (Azure, AWS, or GCP), including data lakes, distributed compute, and storage services.• Experience implementing CI/CD pipelines and DevOps practices for data engineering workflows.
GenAI / LLM Skills (Preferred)• Experience enabling GenAI/AI products through scalable, reliable data ingestion and transformation pipelines (batch and streaming).• Exposure to unstructured and semi-structured data processing (documents/logs/text) and building curated datasets for downstream consumption.• Strong understanding of data governance, privacy, and security requirements when using enterprise data with AI (PII handling, access control, auditability).• Familiarity with operationalizing AI data workflows (monitoring, data quality checks, reproducibility, and cost-aware scaling in cloud environments).
Analytical & Business Acumen• Strong experience collecting, standardising, and summarising diverse datasets while identifying patterns, inconsistencies, and data quality issues.• Solid understanding of how analytics, metrics, and visualisation support business decision making.• Ability to comprehend complex operational systems and deliver scalable analytics and information products to a global user base.
Ways of Working• Comfortable operating in a fast paced, delivery driven environment, both as a hands on contributor and a technical leader.• Ability to move seamlessly between business, analytical, and technical contexts, communicating clearly with diverse audiences.• Demonstrates Mastercard's DQ values, with a collaborative, inclusive, and customer centric mindset.
Corporate Security Responsibility
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
- Abide by Mastercard's security policies and practices;
- Ensure the confidentiality and integrity of the information being accessed;
- Report any suspected information security violation or breach, and
- Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
Similar Jobs at Mastercard
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Responsible for designing and coordinating talent acquisition programs, developing candidate pipelines, and managing high-volume recruitment processes while ensuring diverse hiring strategies.
Top Skills:
JavaWorkday
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Director of Enterprise Operations leads network operations, incident management, and cross-team coordination, focusing on optimizing network performance and quick incident resolution.
Top Skills:
NetcoolPagerdutyServicenow
Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
The Sr. Data Engineer will design and implement scalable data pipelines, ensure data quality, collaborate with teams, and optimize performance.
Top Skills:
Apache AirflowApache HudiApache IcebergApache NifiAzureAzure Data FactoryDelta LakeHadoopImpalaOrcParquetPentahoPysparkPythonSparkSQLTalend
What you need to know about the Sydney Tech Scene
From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.
