Senior Big Data Engineer
RiskRecon
This job is no longer accepting applications
See open jobs at RiskRecon.See open jobs similar to "Senior Big Data Engineer" Accel.Data Science
San Francisco, CA, USA
Posted 6+ months ago
Job Title:
Senior Data EngineerOverview:
OverviewAre you passionate about building scalable, high-performance data platforms that power personalized experiences for millions of users? Do you thrive in a fast-paced environment where innovation and collaboration drive success? Join the Loyalty group at Mastercard, where we connect anonymized transaction data with a robust advertising network to deliver highly personalized card-linked offers.
We are looking for a Senior Data Engineer who brings deep technical expertise, a strong foundation in software engineering, and a passion for solving complex data challenges. You’ll work on mission-critical projects that shape the future of Mastercard’s offers platform, leveraging cutting-edge technologies in Big Data, cloud computing, and real-time processing.
This is an exciting opportunity to work with a collaborative, agile team that values creativity, continuous learning, and delivering high-quality software at scale.
In this role, you will:
• Design, develop, test, deploy, and maintain scalable Big Data solutions.
• Manage project priorities, deadlines, and deliverables across multiple initiatives.
• Build and optimize data pipelines using Spark and other distributed processing frameworks.
• Develop software using modern programming languages such as Java or Scala.
• Work with both relational (e.g., MySQL, Postgres) and NoSQL databases.
• Integrate and manage data workflows using tools like Hive, Impala, OOZIE, Airflow, NIFI, and Kafka.
• Write shell scripts and manage deployments in Linux/Unix environments.
• Collaborate with cross-functional teams in agile ceremonies including daily stand-ups, story pointing, and retrospectives.
• Mentor junior engineers and foster a culture of continuous improvement and technical excellence.
All About You:
• Extensive experience as a Big Data engineer, with expertise in cloud or on-premise data platforms.
• Proficient in at least one modern programming language (Java, Scala, or Python).
• Strong foundation in computer science principles including object-oriented design, data structures, algorithms, and complexity analysis.
• Deep experience with Spark and distributed data processing.
• Hands-on experience with both SQL and NoSQL databases.
• Familiarity with data orchestration and streaming tools (Kafka, Airflow, NIFI, etc.).
• Comfortable working in Linux/Unix environments with basic shell scripting skills.
• Proven ability to design and develop software systems at scale.
• • Strong understanding of Agile methodologies, with the ability to drive iterative delivery and cross-team collaboration.
• Strong communicator with the ability to explain complex concepts to both technical and non-technical audiences, and to influence stakeholders across product, engineering, and acquisition teams.
• Bachelor’s degree in Computer Science, Data Analytics, Mathematics, Software Engineering, or a related field or equivalent practical experience.
#LI-DJ2
This job is no longer accepting applications
See open jobs at RiskRecon.See open jobs similar to "Senior Big Data Engineer" Accel.