Data Engineer - Monterrey, México - British American Tobacco

    Default job background
    Descripción

    BAT MEXICO IS LOOKING FOR A DATA ENGINEER*CAN THIS BE YOUR FUTURE ROLE?
    Are you able to work in a multifaceted, fast paced environment?Do you enjoy ambitious work and expansion of abilities?ACCOUNTABILITIES

    • We need to implement data ingestion pipelines from multiple data sources using Databricks and PySpark
    • Develop Big Data and non Big Data cloud based enterprise solutions in PySpark, SQL and related frameworks/libraries
    • Development and implementation of Machine Learning Operations (MLOps) frameworks
    • Develop scalable and re usage, self service frameworks for data ingestion, processing and MLOps
    • We need to integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data
    • Processing performance analysis and optimization
    • Bringing standard processes in the following areas: Design & Analysis, Automation, Testing, Monitoring, Documentation
    • Coordination with team members (internal and external) to ensure data needs are met.
    Experience Required
    - College degree in Computer Science- Excellent written and verbal communication skills in English- Experience with requirements gathering and implementation- Experience developing extract, transform, load (ETL) pipelines on large data sets- Experience with Databricks- Experience with PySpark- Experience with Cloud Computing technologies (preferably AWS)BENEFICIAL**Experience with Snowflake DatabasesExperience with AWS Redshift

    Work Location:
    In person
    Application Deadline: 30/09/2023