Data Engineer With Databricks

hace 4 semanas


San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

**Hitachi Solutions Ltd. Overview**

Hitachi Solutions Ltd. is a global Microsoft solutions integrator dedicated to developing and delivering industry-focused solutions that support our clients in achieving their business transformation goals. Our industry expertise, intellectual property, and strategic relationship with Microsoft set us apart. We have earned recognition for our achievements in teaming with clients to deliver innovative digital solutions and services.

A part of Hitachi, Ltd., our company has a long history of innovation, financial strength, and international presence as one of the world's largest companies. Since 1910, Hitachi, Ltd. has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure globally, with 303,000 employees in over 100 countries and across 864 companies.

**Job Requirements**

This is a full-time role in our product organization for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology. Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business-critical operations and large-scale analytics pipelines.

**Responsibilities**

  • Scope and execute together with team leadership, working with the team to understand platform capabilities and how to best improve and expand those capabilities.
  • Strong independence and autonomy.
  • Experience leading mid- and senior-level data engineers.
  • Support analytics, data science, and/or engineering teams and understand their unique needs and challenges.
  • Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
  • Embrace new concepts quickly to keep up with fast-moving data engineering technology.
  • Dedicate time to continuous learning to keep the team apprised of the latest developments in the space.
  • Commitment to developing technical maturity across the company.

**Qualifications**

  • 5+ years of Data Engineering experience, including 2+ years designing and building Databricks data pipelines, which is REQUIRED; Azure cloud is highly preferred, but AWS, GCP, or other cloud platform experience will be considered in lieu of.
  • Experience with conceptual, logical, and/or physical database designs is a plus.
  • 2+ years of hands-on Python/Pyspark/SparkSQL experience is REQUIRED; experience with Scala is a plus.
  • 2+ years of experience with Big Data pipelines or DAG Tools (Data Factory, dbt, Airflow, or similar) is REQUIRED.
  • 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is REQUIRED.
  • 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is REQUIRED.
  • 2+ years of experience with source control (git) on the command line is REQUIRED.
  • 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data, is HIGHLY DESIRED.
  • Data modeling/data profiling capabilities with Kimball/star schema methodology is HIGHLY DESIRED.
  • Professional experience with Kafka, or other live data streaming technology, is HIGHLY DESIRED.
  • Professional experience with database deployment pipelines (i.e., dacpac's or similar technology) is HIGHLY DESIRED.
  • Professional experience with one or more unit testing or data quality frameworks is HIGHLY DESIRED.

**Equal Opportunity Employer**

Hitachi Solutions Ltd. is an equal opportunity employer. All applicants will be considered for employment without attention to age, race, color, religion, sex, sexual orientation, gender identity, national origin, veteran, or disability status. All your information will be kept confidential according to EEO guidelines.


  • Databricks Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Fullstack Labs A tiempo completo

    We're looking for a skilled Data Engineer with expertise in Databricks to join our team at FullStack Labs. As a Data Engineer, you will work with our clients to design and build data solutions using Databricks.Key Responsibilities:- Design and implement data pipelines using Databricks notebooks and clusters.- Work with cloud platforms, preferably Azure...


  • San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Hitachi Solutions is a global Microsoft solutions integrator committed to delivering innovative digital solutions and services to our clients. Our industry focus and expertise set us apart, and we maintain a strategic relationship with Microsoft. We have a long history of innovation and financial strength, with a presence in over 100 countries.**Job...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    About the Role:Hitachi Solutions Ltd is seeking an experienced Data Engineer to join our Data & Analytics organization. As a key member of our team, you will be responsible for designing, developing, and maintaining complex data pipelines that manage business critical operations and large-scale analytics pipelines.Responsibilities:Collaborate with team...

  • Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **About the Role**Hitachi Solutions Ltd is seeking a highly experienced Data Engineer to join our Data & Analytics organization. As a Data Engineer, you will be responsible for designing, developing, and maintaining complex data pipelines and large-scale analytics pipelines using Databricks, Spark, and Python.**Key Responsibilities**Design and execute data...

  • Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Hitachi Solutions is a global Microsoft solutions integrator dedicated to delivering innovative digital solutions and services. With a strategic relationship with Microsoft and a long history of innovation, financial strength, and international presence, we are recognized for our achievements in teaming with clients to deliver innovative digital solutions...


  • San José, San José, Costa Rica Fullstack Labs A tiempo completo

    At FullStack Labs, we are committed to helping organizations achieve their digital transformation goals. As a leading software consultancy, we have partnered with top companies like Uber, GoDaddy, and Stanford University to build high-performing software development teams.We're proud of our achievements:Key Highlights:• Delivering life-changing career...


  • San José, San José, Costa Rica Fullstack Labs A tiempo completo

    We're looking for a skilled Cloud Engineer with Databricks expertise to join our team at FullStack Labs. As a Cloud Engineer, you will work with our incredible clients in one of two ways:Team Augmentation: You will integrate yourself directly into our client's team and work alongside their existing designers and engineers on a daily basis.Design & Build: You...

  • Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Hitachi Solutions Ltd.** is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.We are seeking a highly experienced Data Engineer to join our Data & Analytics organization (Azure DataWarehouse / DataLakehouse and Business...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    About Hitachi Solutions LtdHitachi Solutions Ltd is a global solutions integrator dedicated to designing, developing, and delivering cutting-edge cloud solutions to empower our clients' innovation across their entire business.We are passionate about helping our clients achieve their strategic business initiatives with distinguished engineering, hard work,...

  • Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a strategic relationship...

  • Senior Data Architect

    hace 5 días


    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Hitachi Solutions Ltd. is a global Microsoft solutions integrator with a passion for developing and delivering industry-focused solutions that support our clients in achieving their business transformation goals.We have a strategic relationship with Microsoft, earning us recognition year after year for our innovative digital solutions and services. As part...

  • Data Engineer Position

    hace 3 semanas


    San José, San José, Costa Rica Tmf Group A tiempo completo

    **Job Overview**Tmf Group is a leading provider of critical administrative services, helping clients invest and operate safely around the world. As a data engineer, you will be responsible for addressing business needs through requirements gathering and collaborating on solution reviews to develop end-to-end data solutions including data modeling, data...

  • Senior Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Encora A tiempo completo

    At Encora, we are seeking a highly skilled Senior Data Engineer to join our team. This role involves designing, building, and maintaining large-scale data systems and architectures.Key responsibilities include:Developing and implementing data engineering solutions using modern tools and technologies.Collaborating with cross-functional teams to ensure data...


  • San José, San José, Costa Rica Publicis Re:Sources Global A tiempo completo

    Job TitlePublicis Re:Sources Global is looking for a seasoned Data Scientist and Engineer to play a pivotal role in the development and application of data science algorithms and advanced analytics techniques.Build models over various datasets to analyze importance/centrality, similarity, and other key metrics.Design and analyze experiments across user...


  • San José, San José, Costa Rica Encora A tiempo completo

    **About the Role**:We are looking for an exceptional Senior Data Integration Engineer to join our team at Encora. In this role, you will be a part of a highly skilled technology and agile team, supporting and developing innovative solutions to meet our business requirements. Your key responsibility will be to accelerate our customers' business results by...


  • San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Job Title: Senior Data Engineer">About Hitachi Solutions">We are a leading provider of innovative solutions in data management and analytics. Our team is committed to delivering exceptional results and driving business growth through cutting-edge technology.">Estimated Salary: $140,000 - $170,000 per annum">About the Role">We are seeking an experienced...


  • San José, San José, Costa Rica Equifax A tiempo completo

    The Data and Visualization Team at Equifax is seeking a Data Engineer to collaborate with the Direct to Consumer Team in designing and implementing data visualizations that support strategic initiatives involving Performance, Operational, and Compliance reporting.**Key Responsibilities**Balance great-looking dashboards and visuals with meaningful and...


  • San José, San José, Costa Rica Publicis Re:Sources Global A tiempo completo

    Job Title: Machine Learning EngineerAt Publicis Re:Sources Global, we are seeking a highly skilled Machine Learning Engineer to join our team. As a key member of our data science team, you will play a critical role in the development and application of data science algorithms and advanced analytics techniques across a variety of use cases.Key...

  • Data Science Engineer

    hace 4 semanas


    San José, San José, Costa Rica Cornerstone Building Brands A tiempo completo

    **Job Title:** Data Science Engineer**Job Summary:** We are seeking a highly skilled Data Science Engineer to join our team at Cornerstone Building Brands. As a Data Science Engineer, you will play a key role in creating advanced data models, working with business stakeholders to understand their requirements, and delivering actionable insights to drive...

  • Data Engineer

    hace 3 semanas


    San José, San José, Costa Rica Neutrino Tech Systems, Llc A tiempo completo

    **Job Summary**The primary role of the Data Engineer at Neutrino Tech Systems, LLC is to support and expand the data platforms that process, store, and organize data critical for clients. This role will have expertise in data movement and database technologies that support data analytics and AI/ML capabilities.**Key Responsibilities**Develop BQ views per...