Sr. Data Engineer

hace 7 días

Quesada, Costa Rica Golabs A tiempo completo

**About the job Sr. Data Engineer (PySpark)**:
**Senior Data Engineer**

We are seeking a skilled Data Engineer with expertise in Python, PySpark, and Apache Airflow to join our team. This role requires proficiency in AWS services such as Redshift and Databricks, as well as strong SQL skills for data manipulation and querying.

**Responsibilities**:

- Design, develop, and maintain scalable data pipelines and workflows using Python and PySpark.
- Implement and optimize ETL processes within Apache Airflow for data ingestion, transformation, and loading.
- Utilize AWS services such as Redshift and Databricks for data storage, processing, and analysis.
- Write efficient SQL queries and optimize database performance for large-scale datasets.
- Implement version control and continuous integration using GitLab CI for maintaining codebase integrity.
- Follow Test-Driven Development (TDD) practices to ensure code reliability and maintainability.

**Requirements**:

- Bachelor's degree in Computer Science, Engineering, or a related field.
- 4 to 7 years of professional experience in data engineering or a related role.
- Proficiency in Python and PySpark for building data pipelines and processing large datasets.
- Hands-on experience with Apache Airflow for orchestrating complex workflows and scheduling tasks.
- Strong knowledge of AWS services, including Redshift and Databricks, for data storage and processing.
- Advanced SQL skills for data manipulation, querying, and optimization.
- Experience with version control systems like GitLab CI for managing codebase changes.
- Familiarity with Test-Driven Development (TDD) practices and writing unit tests for data pipelines.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills to work effectively within a team environment.
- Certification in AWS or related technologies is preferred but not required.

Open position only for people residing in Costa Rica, México, Argentina, and Brazil.

****English: B2+ proficiency required.

  • Senior Data Engineer

    hace 2 semanas

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior Data Engineer**: **The Role**: As a Data Engineer, you will play a crucial role in implementing, improving, and maintaining Looker across the company. This includes partnering and consulting with the business and engineering teams to provide guidance and assistance in creating and streamlining Looker reports and underlying ETL...

  • Senior Data Scientist

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior Data Scientist**: Do you love to create apps that facilitate other peoples lives? Apps that make you feel proud because they are simple to use and look good? Theres a great Android Team in Golabs where you can share knowledge, experiences and learn new ways to do things the best way! Our apps have been used by thousands of people in...

  • Senior PHP Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior PHP Software Engineer**: In Golabs you can find an engineering team who love these challenges. They are the kind of team who share their knowledge and experiences. The kind who always is learning newest ways to do things even better than in the past! Our apps have been used by thousands of people in companies worldwide, but hey! Thats...

  • Senior React Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior React Software Engineer**: Do you love to solve business problems with the ultimate cloud technologies? Do you love to put your hands on the cutting edge technology? In Golabs you will find an engineering team who loves working this way, They are the kind of team who is always learning something new and searching for the new around...

  • Middle Backend Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Middle Backend Software Engineer**: In Golabs you can find an engineering team who love these challenges. They are the kind of team who share their knowledge and experiences. The kind who always is learning newest ways to do things even better than in the past! Our apps have been used by thousands of people in companies worldwide, but hey!...

  • DevOps Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job DevOps Software Engineer**: Youll be managing, enhancing, and scaling the Client's platform, which turns supermarkets into an intelligent energy management service. You will bring our cutting-edge physical modeling, machine learning, and energy management algorithms to life, creating a real-world impact on the Client's customers energy...

  • Senior PHP Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior PHP Software Engineer**: Do you love to create apps that facilitate other peoples lives? Apps that make you feel proud because they are simple to use and look good? Theres a great Android Team in Golabs where you can share knowledge, experiences and learn new ways to do things the best way! Our apps have been used by thousands of...

  • Senior QA Automation Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Senior QA Automation Software Engineer**: Do you love to create apps that facilitate other peoples lives? Apps that make you feel proud because they are simple to use and look good? Theres a great Android Team in Golabs where you can share knowledge, experiences and learn new ways to do things the best way! Our apps have been used by...

  • Performance Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Performance Engineer**: **Load Testing Tools Proficiency**: - Proficiency in scripting and executing load tests using a variety of tools, including but not limited to: - JMeter / BlazeMeter - Locust / Grasshopper - CloudTest - Load Runner / Performance Center - Familiarity with managing JMX beans and utilizing tools like...

  • Middle Fullstack Software Engineer

    hace 2 días

    Quesada, Costa Rica Golabs A tiempo completo

    **About the job Middle Fullstack Software Engineer**: As a Full Stack React/NodeJs Senior Developer, you will be working on the development of mobile and web based boat dealers and traders solutions in the marine business, with state-of-the-art technologies such as React, and NodeJS. The team is growing and if you want to be part of it, please let's have a...