Middle Data Engineer - Guadalajara, México - AgileEngine

AgileEngine

Empresa verificada

Guadalajara, México

hace 1 semana

Publicado por:

Rodrigo Fernández

Reclutador de talento para beBee

Descripción

ID: 12690

What you will do

Maintain an evergrowing Datalake with a diverse set of data sources and data consumers;
Help implement data governance initiative;
Maintenance, deprecation, and eventual migration of legacy ETL jobs into a LakeHouse solution.

Must haves

Airflow experience;
Worked with Spark/Glue;
IaC experience; CDK or Terraform;
Familiar with Datalake/Datawarehouse/Lakehouse;
Worked with Iceberg/Delta;
Experience with AWS tools;
Experience with data visualization tools;
Experience with creating software for retrieving, parsing, and processing structured and unstructured data;
Experience with building scalable ETL and ELT workflows for reporting and analytics;
Experience with creating solutions in a collaborative, crossfunctional team environment;
Ability to develop scripts and programs for converting various data types into usable formats, support project team to scale, and monitor and operate data platforms;
Ability to obtain a security clearance;
Bachelor's degree.

Nice to have

Lake Formation experience;
Worked with big data;
DynamoDB/DMS experience;
Experience with Python, SQL, Scala, or Java;
Experience with UNIX and Linux, including basic commands and Shell scripting;
Experience with AWS tools, including Quicksight and AWS Glue;
Experience with distributed data and computing tools, including Spark, Databricks, Hadoop, Hive, AWS EMR, or Kafka;
Experience with NoSQL implementation, including MongoDB or Cassandra;
Experience with data warehousing using AWS Redshift, MySQL, or Snowflake;
Experience with Agile engineering practices.

The benefits of joining us
-
Professional growth
Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
-
Competitive compensation
We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities
-
A selection of exciting projects
Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands
-
Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office - whatever makes you the happiest and most productive.

Job Types:
Contract, Full-time

Work Location:
In person