- Designing end-to-end ETL/ELT pipelines using Python, SQL, Spark etc., to ingest data into scalable cloud infrastructure such as AWS S3 and Azure Synapse Analytics with optimized performance cost scalability usage
- Collaborating on efficient data modeling schema design enforcing quality through validation alert mechanisms ensuring accuracy reliability
Data Engineer II - Guerrero - Plexus Malaysia Sdn Bhd
Descripción
Job Description
The role of Data Engineer II involves designing robust data pipelines and infrastructure for cloud-based technologies.