Data Engineer, Digital Platform - Monterrey, México - DataArt

DataArt

Empresa verificada

Monterrey, México

hace 2 semanas

Publicado por:

Rodrigo Fernández

Reclutador de talento para beBee

Descripción

Position overview:
We are seeking a talented and experienced Senior Data Engineer to join our team. Senior Data Engineer will collaborate with our cross-functional team to deliver software solutions that drive business growth and success.

Technology stack:
Azure Cloud, SQL / T-SQL, Python, Kafka, SQL Server

Utilize strong Python development skills for ELT and ETL data transfers and extractions
Collaborate within agile development processes such as Scrum and Kanban
Implement CI/CD concepts to facilitate efficient development and deployment
Demonstrate proficiency in creating detailed technical documentation
Leverage Airflow and DAG development experience to orchestrate data workflows
Contribute to BI and Data Analysis initiatives in endtoend data platform development
Create highquality, fully tested code for Cloudbased ETL/ELT data pipelines
Coordinate with offshore teams and participate in the onsiteoffshore model based on prior experience
5+ years of development experience building data pipelines using Cloud technologies
5+ years of experience in the architecture of modern data warehousing platforms using technologies such as Snowflake or Redshift

Cloud experience

S3, step functions, Glue, Step functions, and Airflow
Good Python development skills in relation to data transformation and extraction (ELT and ETL)
Experience developing and deploying ETL solutions like Informatica or similar tools
Experience working within an Agile development process (Scrum, Kanban, etc.)
Familiarity with CI/CD concepts
Demonstrated proficiency in creating technical documentation
Airflow DAG development experience
Ability and experience in BI and Data Analysis and endtoend development in data platform environments
Write excellent, fully tested code to build ETL /ELT data pipelines
Good spoken English

Nice to have:

Experience working with SQL/T-SQL, Snowflake, Python, Pipeline Design, Azure (Functions and Services for Data Platform Development), Dbt, Kafka, SQL Server (2016 or above) with expertise in Execution Plan Understanding, Performance Tuning, Data Warehouse, Cube Knowledge, and SSIS.