Data Engineer II - Guerrero - Plexus Corp.

Descripción

Data Engineer II Position Overview

The Data Engineer II role involves designing, building, and maintaining scalable data pipelines and infrastructure to meet the organization's needs. This includes acquiring, transforming, and optimizing large datasets for analytics, reporting, machine learning initiatives.

Key Responsibilities:

• Lead development of end-to-end ETL/ELT pipelines using Python, SQL, Spark etc. to ingest data into cloud infrastructure including Data Lakes and Warehouses (AWS Azure or GCP).
• Collaborate on data modeling schema design enforcing quality through robust validation monitoring alerting mechanisms ensuring accuracy reliability.
• Evaluate tune improve performance scalability cost-efficiency of all data pipelines underlying cloud infrastructure.