Director, Data Engineering

Wizard

Wizard

Software Engineering, Data Science
United States · Remote
Posted on Oct 30, 2024

About Us

Wizard is revolutionizing the shopping experience using the power of generative AI and rich messaging technologies to build a personalized shopping assistant for every consumer. We scour the entire internet of products and ratings across brands and retailers to find the best products for every consumer’s personalized needs. Using an effortless text-based interface, Wizard AI is always just a text away. The future of shopping is here. Shop smarter with Wizard.

The Role

Reporting directly to the CTO, the Director of Data Engineering & Data Operations will spearhead developing, scaling, and managing our data infrastructure and operations. This pivotal role involves leading a team of Lead and Senior Data Engineers and Data Operations professionals, driving strategic data initiatives, ensuring data quality and accessibility, and fostering a culture of continuous improvement and innovation.

Key Responsibilities:

  • Leadership & Strategy:
    • Lead the data engineering and data operations teams, setting strategic direction and driving execution of data initiatives that align with company goals.
    • Cultivate a culture of excellence, innovation, and accountability.
  • Architecture & Scalability:
    • Design and implement scalable data engineering solutions to support growing data needs.
    • Ensure our data architecture is robust, efficient, and adaptable to new technologies and business requirements.
  • Data Governance & Operations:
    • Oversee data governance and data operations to ensure high data quality, reliability, and compliance with data privacy regulations.
    • Implement best practices for data management, including data ingestion, storage, processing, and security.
  • Operational Excellence:
    • Streamline data operations to support real-time data processing, analytics, and reporting needs.
    • Enhance operational workflows for data monitoring, incident management, and performance optimization.
  • Team Development & Mentorship:
    • Mentor and manage the data engineering and operations teams, fostering professional growth and building a cohesive unit.
    • Recruit and retain top talent to support our ambitious data goals.
  • Cross-functional collaboration:
    • Partner with product, engineering, AI/ML, and other departments to ensure data strategies and operations support overall business objectives.
    • Serve as a critical stakeholder in defining product and technology roadmaps.
  • Innovation & Continuous Learning:
    • Stay current on emerging data technologies, methodologies, and industry trends.
    • Advocate for adopting new tools and technologies to enhance our data capabilities and competitive edge.

You

  • Bachelor’s or Master’s in Computer Science, Data Science, Information Systems, or a related field.
  • Minimum of 10 years' experience in data engineering, with at least 4 years in a leadership role overseeing data engineering and data operations.
  • Proven experience in designing, implementing, and managing scalable data infrastructures and operations in a cloud environment (AWS, GCP, Azure).
  • Deep understanding of data governance, data quality management, and data security practices.
  • Experience with big data technologies (Hadoop, Spark), data pipeline and workflow management tools (Airflow, Kafka), and modern data storage solutions.
  • Proficiency in SQL, Python, or Scala, and familiarity with front-end technologies (JavaScript) for data visualization.
  • Demonstrated leadership skills with the ability to mentor, motivate, and lead teams toward achieving strategic objectives.
  • Strong analytical, problem-solving, and project management skills.
  • Excellent communication skills, capable of effectively articulating technical concepts to non-technical stakeholders.

The expected salary for this role is $235,000 - $260,000 depending on skills and experiences.