Job Description:
We are seeking a visionary Data Engineering Architect to lead the design and implementation of scalable, efficient, and robust data infrastructure that powers our machine learning and analytics platforms. As a key technical leader in the MLOps & Data Engineering department, you will define architecture standards, guide engineering teams, and ensure that data solutions meet the highest standards of performance, reliability, and security.
Key Responsibilities:
- Architect and design end-to-end data engineering solutions that support large-scale data processing, storage, and analytics.
- Develop strategies for data ingestion, transformation, and integration across diverse sources and formats.
- Establish and enforce best practices, design patterns, and standards for data pipeline development and maintenance.
- Collaborate closely with data scientists, ML engineers, and IT teams to ensure seamless data availability and accessibility.
- Lead the selection and implementation of data technologies, frameworks, and cloud services aligned with business objectives.
- Oversee performance tuning, scalability, and security of data systems.
- Mentor and provide technical leadership to data engineering teams.
- Evaluate emerging tools and technologies to continuously improve data infrastructure.
- Ensure compliance with data governance, privacy, and regulatory requirements.
- Work with stakeholders to align data architecture with organizational strategy and roadmap.
Requirement :
- Extensive experience (typically 7+ years) in data engineering, architecture, or related fields.
- Proven expertise in designing and deploying large-scale data pipelines and architectures.
- Strong proficiency with cloud platforms (AWS, Azure, GCP) and big data technologies (Spark, Hadoop, Kafka, etc.).
- Deep understanding of databases (SQL and NoSQL), data warehousing, and data lakes.
- Experience with infrastructure-as-code, automation, and orchestration tools.
- Strong software engineering background with proficiency in Python, Scala, or Java.
- Excellent leadership, communication, and stakeholder management skills.
- Advanced degree in Computer Science, Engineering, or related field preferred.