Dna Consulting - Miguel Hidalgo, México - EY
Descripción
EY-GDS- DnA Consulting - Data Engineer Azure-Snowflake (Batch)The opportunity
We are looking for Senior Data Engineer with expertise in developing and managing Kafka based data pipelines, implementing complex stored procedures and best practices with data warehouse and ETL concepts, deploy fully operational data warehouse solutions into production on Snowflake to join our GDS Mexico team.
This is a fantastic opportunity to be part of a leading firm whilst being instrumental in the growth of a new service offering.
Your key responsibilities- Design and Develop batch and streaming data processing
- Build data systems and pipelines.
- Evaluate business needs and objectives.
- Prepare data for prescriptive and predictive modeling.
- Build algorithms and prototypes.
- Combine raw information from different sources.
- Explore ways to enhance data quality and reliability.
- Identify opportunities for data acquisition.
- Monitor and optimize data storage and data processing
- Design and implement data security
- 35 years of experience on Apache Kafka, Kafka stream, AZURE Event Hub
- 35 years of experience on processing real time data.
- Advanced knowledge on processing large amounts of data (billions of records) in minutes.
- Deep knowledge on producers (ACK/NACK), consumers, and brokers.
- Deep knowledge on topics, partitions, and segments.
- 35 years of advanced knowledge on SQL, phyton programming, ETL and ELT Process.
- Advanced knowledge on data structures, MPP Databases, Blob Storage.
- 35 years of experience on AZURE data lake Storage (Teradata, Snowflake), AZURE cloud.
- Previous experience as a data engineer or in a similar role.
- Data engineering certification (AZURE Certified Data Engineer) is a plus.
- Flexible and adaptable; able to work in ambiguous situations.
- Able to work effectively at all levels in an organization.
- Must be a team player and able to work collaboratively with and through others.
- Must like to learn.
- Bachelor's in technology or engineering or similar.
- Experience working with Azure, Snowflake technologies.
- Familiarity with agile methodologies.
- Familiarity with software such as Jira or ADO.
- A Team of people with technical experience and enthusiasm to learn new things in this fastmoving environment
- Opportunities to work with EY GDS DnA Consulting practice globally with leading businesses across a range of industries
At EY, we're dedicated to helping our clients, from world's top companies — and the work we do with them is as varied as they are.
Plus, we offer:
- Support, coaching and feedback from some of the most engaging colleagues around
- Opportunities to develop new skills and progress your career
- The freedom and flexibility to handle your role in a way that's right for you
As a global leader in assurance, tax, transaction, and advisory services, we're using the finance products, expertise, and systems we've developed to build a better working world.
That starts with a culture that believes in giving you the training, opportunities, and creative freedom to make things better.
Whenever you join, however long you stay, the exceptional EY experience lasts a lifetime.And with a commitment to hiring and developing the most passionate people, we'll make our ambition to be the best employer by 2020 a reality.
If you can confidently demonstrate that you meet the criteria above, please contact us as soon as possible.Join us in building a better working world.
Más ofertas de trabajo de EY
-
Senior en El Área de Diversidad, Equidad e
Granada, México - hace 3 semanas
-
Consultor Junior de Finanzas
Ciudad de México - hace 3 semanas
-
GDS- Cybersecurity- Staff
Miguel Hidalgo, México - hace 2 semanas
-
Staff Gcr Mt
México - hace 1 semana
-
Mx-eymac-digital &emerging Technologies-senior 1
México - hace 1 semana
-
Consultor Senior Blue Yonder Warehousing
Ciudad de México - hace 3 días