Job Description:
We are seeking an experienced Big Data Architect to design, build, and oversee scalable big data infrastructure and solutions that enable advanced analytics and data-driven decision-making. As a key technical leader, you will define the architecture and strategy for processing, storing, and analyzing massive datasets across the organization.
You will collaborate closely with data scientists, engineers, and business stakeholders to create efficient data pipelines and ensure the performance, security, and reliability of big data platforms.
Key Responsibilities:
- Design and implement end-to-end big data architectures that support batch and real-time data processing.
- Develop scalable data ingestion, transformation, and storage solutions using technologies like Hadoop, Spark, Kafka, and cloud-based platforms.
- Define data models, schemas, and metadata management practices aligned with business needs.
- Lead the evaluation and adoption of big data tools, frameworks, and best practices.
- Collaborate with data engineering and data science teams to optimize data pipelines and analytics workflows.
- Ensure data quality, governance, and security across big data environments.
- Provide technical leadership, mentorship, and guidance to junior architects and engineers.
- Troubleshoot and resolve performance bottlenecks and system issues in big data platforms.
- Stay updated with emerging trends and innovations in big data technologies and methodologies.
Requirements:
- Bachelor’s or Master’s degree in Computer Science , Engineering, Information Systems, or a related field.
- 7+ years of experience in big data architecture, data engineering, or related roles.
- Strong expertise with big data technologies such as Hadoop ecosystem (HDFS, MapReduce), Apache Spark, Kafka, Hive, HBase, and related tools.
- Proficient in cloud platforms like AWS, Azure, or Google Cloud, especially their big data services (e.g., EMR, Dataproc , Dataflow).
- Experience designing scalable data warehouses, lakes, and data marts.
- Solid understanding of data modeling, ETL/ELT processes, and database technologies (SQL and NoSQL).
- Knowledge of security best practices, data governance, and compliance frameworks.
- Excellent problem-solving and communication skills.
- Proven ability to lead complex technical projects and collaborate across teams.