Senior Big Data Engineer

RiskRecon

RiskRecon

Data Science
San Francisco, CA, USA
Posted 6+ months ago

Job Title:

Senior Data Engineer

Overview:

Overview

Are you passionate about building scalable, high-performance data platforms that power personalized experiences for millions of users? Do you thrive in a fast-paced environment where innovation and collaboration drive success? Join the Loyalty group at Mastercard, where we connect anonymized transaction data with a robust advertising network to deliver highly personalized card-linked offers.
We are looking for a Senior Data Engineer who brings deep technical expertise, a strong foundation in software engineering, and a passion for solving complex data challenges. You’ll work on mission-critical projects that shape the future of Mastercard’s offers platform, leveraging cutting-edge technologies in Big Data, cloud computing, and real-time processing.
This is an exciting opportunity to work with a collaborative, agile team that values creativity, continuous learning, and delivering high-quality software at scale.

In this role, you will:

• Design, develop, test, deploy, and maintain scalable Big Data solutions.
• Manage project priorities, deadlines, and deliverables across multiple initiatives.
• Build and optimize data pipelines using Spark and other distributed processing frameworks.
• Develop software using modern programming languages such as Java or Scala.
• Work with both relational (e.g., MySQL, Postgres) and NoSQL databases.
• Integrate and manage data workflows using tools like Hive, Impala, OOZIE, Airflow, NIFI, and Kafka.
• Write shell scripts and manage deployments in Linux/Unix environments.
• Collaborate with cross-functional teams in agile ceremonies including daily stand-ups, story pointing, and retrospectives.
• Mentor junior engineers and foster a culture of continuous improvement and technical excellence.

All About You:

• Extensive experience as a Big Data engineer, with expertise in cloud or on-premise data platforms.
• Proficient in at least one modern programming language (Java, Scala, or Python).
• Strong foundation in computer science principles including object-oriented design, data structures, algorithms, and complexity analysis.
• Deep experience with Spark and distributed data processing.
• Hands-on experience with both SQL and NoSQL databases.
• Familiarity with data orchestration and streaming tools (Kafka, Airflow, NIFI, etc.).
• Comfortable working in Linux/Unix environments with basic shell scripting skills.
• Proven ability to design and develop software systems at scale.
• • Strong understanding of Agile methodologies, with the ability to drive iterative delivery and cross-team collaboration.
• Strong communicator with the ability to explain complex concepts to both technical and non-technical audiences, and to influence stakeholders across product, engineering, and acquisition teams.
• Bachelor’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical experience.

#LI-DJ2