Data Engineer

hace 1 semana

Lagunilla, Costa Rica Ztek Consulting Inc A tiempo completo

**Title: Data Engineer**
**Location: Heredia, Costa Rica**
**Fulltime position**

**Responsibilities**:

- (The primary tasks, functions and deliverables of the role)_
- Design and build reusable components, frameworks and libraries at scale to support analytics products
- Design and implement product features in collaboration with business and Technology stakeholders
- Identify and solve issues concerning data management to improve data quality
- Clean, prepare and optimize data for ingestion and consumption
- Collaborate on the implementation of new data management projects and re-structure of the current data architecture
- Implement automated workflows and routines using workflow scheduling tools
- Build continuous integration, test-driven development and production deployment frameworks
- Collaboratively review design, code, test plans and dataset implementation performed by other data engineers in support of maintaining data engineering standards
- Analyze and profile data for designing scalable solutions
- Troubleshoot data issues and perform root cause analysis to proactively resolve product and operational issues

**Requirements**:
**Experience**:

- Strong understanding of data structures and algorithms
- Strong understanding of solution and technical design
- Has a strong problem solving and analytical mindset?
- Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
- Able to quickly pick up new programming languages, technologies, and frameworks
- Experience building cloud scalable, real time and high-performance data lake solutions
- In-depth understanding of micro service architecture
- Fair understanding of developing complex data solutions
- Experience working on end-to-end solution design
- Willing to learn new skills and technologies
- Has a passion for data solutions

Required and Preferred Skill Sets:

- Hands on experience in AWS - EMR [Hive, Pyspark], S3, Athena or any other equivalent cloud
- Hands-on experience Spark Batch Processing and some familiarity with Spark Structured Streaming
- Minimum 1 years’ experience working experience with Hadoop stack dealing huge volumes of data in a scalable fashion
- 1-2 years of hands-on experience with SQL, ETL, data transformation and analytics functions
- 1-2 years of hands-on Python experience including Batch scripting, data manipulation, distributable packages
- 1-2 years’ experience working with batch orchestration tools such as Apache Airflow or equivalent, preferable Airflow
- 1-2 years working with code versioning tools such as GitHub or BitBucket; expert level understanding of repo design and best practices
- Familiarity with deployment automation tools such as Jenkins
- 1-2 years of hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, data quality; hand on experience with API development; some exposure to Nifi or Kafka
- 1 -2 years designing and developing relational database objects; knowledgeable on logical and physical data modelling concepts; some experience with Snowflake
- Familiarity with Tableau or Cognos use cases
- Familiarity with Agile; working experience preferred

  • Senior Auditor

    hace 7 días

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    Exciting opportunities to join a fast-growing Internal Audit function at the prestigious London Stock Exchange Group (LSEG). LSEG is a diverse and truly global organisation which has grown materially in 2021, primarily through the acquisition of Refinitiv. As part of LSEG Internal Audit, you will have the opportunity to provide assurance and insights on the...

  • Full Stack Developer

    hace 5 días

    Lagunilla, Costa Rica TransUnion A tiempo completo

    TransUnion's Job Applicant Privacy Notice **What We'll Bring**: At TransUnion, we have a welcoming and energetic environment that encourages collaboration and innovation we’re - consistently exploring new technologies and tools to be agile. This environment gives our people the opportunity to hone current skills and build new capabilities, while...

  • Contributor Relations Analyst

    hace 2 semanas

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    Refinitiv CR is looking for Contributor Relations Analyst !! Role Purpose: The Contributor Relations Analyst will have two primary mandates: 1. Partnership with and support of the region's Contributor Relationship Managers to aid in the onboarding of new real time data contributions 2. Expert-level support of LSEG's existing content contributors. The...

  • Lead DevOps Engineer

    hace 2 días

    Lagunilla, Heredia, Costa Rica TransUnion A tiempo completo

    TransUnion's Job Applicant Privacy NoticeWhat We'll Bring:Job Description Summary• Bachelor's (B.S) or Master's (M.S) degree in Computer Science or related field• Minimum 10+ years of software development experience• Minimum 7+ years of object-oriented design and object-oriented programming experience• Solid understanding of RESTful systems and...

  • Research Analyst

    hace 1 semana

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    For over two decades the World-Check Risk Intelligence database has been delivering accurate and reliable information to help our clients make informed decisions. It has hundreds of specialist researchers and analysts across the globe, adhering to the most stringent research guidelines as they collate information from reliable and reputable sources - such as...

  • Technology Engineer – Integration Platforms Support

    hace 5 días

    CRI-Lagunilla de Heredia-Ultra, Costa Rica London Stock Exchange Group A tiempo completo

    We are seeking a skilled Technology Engineer to support and maintain enterprise Integration Platforms and Services including Boomi, Matillion, and Informatica. This role requires strong problem-solving skills, technical expertise in integration technologies, and a customer-focused approach to ensure the reliability and performance of integration...

  • Associate Market Analyst

    hace 7 días

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    ResponsibilitiesJudgmental - Assess and validate market color - Provide and follow through on process improvement or automaton ideas Pricing Production - Maintain money market yield curves - Update evaluated CDS levels - Update real-time mortgage-backed pricing model - Research terms and conditions on newly issued municipal bonds - Prepare custom files for...

  • Network Security Operations Engineer

    hace 2 semanas

    Lagunilla, Heredia, Costa Rica TransUnion A tiempo completo

    TransUnion's Job Applicant Privacy NoticeWhat We'll Bring:The Network Security Operations team is responsible for the evolution and implementation of our global enterprise security strategy in partnership with technology leaders across TransUnion. We work with teams across the organization to:• Ensure that TU security platforms and services are designed...

  • Lead Research Analyst

    hace 2 semanas

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    We are seeking for Research Analysts to join our Latam Specialist Threat Finance team, dedicated to the coverage of international sanctions notices and in-depth research of topics such as organised crime, terrorism, modern slavery, wildlife trafficking, cybercrime, corruption, and financial crimes, among others. **Responsibilities**: - Monitoring of...

  • Lead Research Analyst

    hace 2 semanas

    Lagunilla, Costa Rica LSEG (London Stock Exchange Group) A tiempo completo

    We are seeking for Research Analysts to join our Latam Specialist Threat Finance team, dedicated to the coverage of international sanctions notices and in-depth research of topics such as organised crime, terrorism, modern slavery, wildlife trafficking, cybercrime, corruption and financial crimes, among others. **Responsibilities**: - Monitoring of...