Databricks/data Engineer

hace 6 meses


San José, Costa Rica Hitachi Solutions A tiempo completo

Company Description

Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a strategic relationship with Microsoft. Recognized for our achievements - teaming with our clients to deliver innovative digital solutions and services - is how we have achieved year after year recognition.

A part of Hitachi, Ltd., our company has a long and rich history of innovation, financial strength, and international presence of one of the world’s largest companies. Since 1910, Hitachi, Ltd. has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure around the globe supported by 303,000 employees in over 100 countries and across 864 companies.

**Job Description**:
**_
Please note: _**Although our position is remote / virtual, you **MUST** live, and be authorized to work, in Costa Rica.

**DATA ENGINEER (DATABRICKS, PYTHON, SPARK)**

This is a full-time, well benefited, career opportunity in our Data & Analytics organization (Azure DataWarehouse / DataLakehouse and Business Intelligence) for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology.

Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business critical operations, and large-scale analytics pipelines. Qualified applicants will have a demonstrated capability to learn new concepts quickly, have a data engineering background, and/or have robust software engineering expertise.

**Responsibilities**
- Scope and execute together with team leadership. Work with the team to understand platform capabilities and how to best improve and expand those capabilities.
- Strong independence and autonomy.
- Experience leading mid
- and senior-level data engineers.
- Support analytics, data science and/or engineering teams and understand their unique needs and challenges.
- Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
- Embrace new concepts quickly to keep up with fast-moving data engineering technology.
- Dedicate time to continuous learning to keep the team appraised of the latest developments in the space.
- Commitment to developing technical maturity across the company.

**Qualifications**:

- 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is **REQUIRED**; Azure cloud is **_highly_** **_preferred_**, however will consider AWS, GCP or other cloud platform experience in lieu of
- Experience with conceptual, logical and/or physical database designs is **_a plus_**:

- 2+ years of hands-on Python/Pyspark/SparkSQL and/or Scala experience is **REQUIRED**:

- 2+ years of experience with Big Data pipelines or DAG Tools (Data Factory, Airflow, dbt, or similar) is **REQUIRED**:

- 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is **REQUIRED**:

- 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is **REQUIRED**:

- Experience with source control (git) on the command line is **REQUIRED**:

- 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is **_HIGHLY DESIRED_**:

- Data modeling / data profiling capabilities with Kimball/star schema methodology is **_a plus_**:

- Professional experience with Kafka, or other live data streaming technology, is **_HIGHLY DESIRED_**:

- Professional experience with database deployment pipelines (i.e., dacpac’s or similar technology) is **_HIGHLY DESIRED_**:

- Professional experience with one or more unit testing or data quality frameworks is **_HIGHLY DESIRED_**

**#LI-CA1**

**#REMOTE**

**#databricks**

**#dataengineer**

**#datawrangler**

**#spark**

**#python**

Additional Information

We are an equal opportunity employer. All applicants will be considered for employment without attention to age, race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

All your information will be kept confidential according to EEO guidelines.

**Beware of scams


  • Databricks Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Fullstack Labs A tiempo completo

    We're looking for a skilled Data Engineer with expertise in Databricks to join our team at FullStack Labs. As a Data Engineer, you will work with our clients to design and build data solutions using Databricks.Key Responsibilities:- Design and implement data pipelines using Databricks notebooks and clusters.- Work with cloud platforms, preferably Azure...

  • Data Engineer

    hace 2 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Summary:We are seeking a skilled Data Engineer to join our team as an Onboarding Specialist. In this role, you will work closely with customers to help them onboard and deploy Databricks in a production environment. As a Technical Customer Onboarding Specialist, you will be responsible for guiding customers through the onboarding process, ensuring a...

  • Data Engineer Associate

    hace 2 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    At Databricks, we are on a mission to empower our customers to solve complex data problems.We are seeking an experienced Data Engineer Associate to join our team and assist in customer onboarding and technical guidance.Key Responsibilities:Work closely with customers to onboard and deploy Databricks in a production environment.Develop and maintain a deep...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Role OverviewWe are seeking a highly skilled Senior Big Data Solutions Engineer to join our team at Databricks. As a member of our technical solutions team, you will be responsible for providing expert-level technical solutions for our customers’ most challenging issues related to Spark, ML, AI, Delta, Streaming, and Lakehouse.Troubleshoot and resolve...

  • Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **About the Role**Hitachi Solutions Ltd is seeking a highly experienced Data Engineer to join our Data & Analytics organization. As a Data Engineer, you will be responsible for designing, developing, and maintaining complex data pipelines and large-scale analytics pipelines using Databricks, Spark, and Python.**Key Responsibilities**Design and execute data...

  • Data Engineer

    hace 3 semanas


    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Hitachi Solutions is a global Microsoft solutions integrator dedicated to delivering innovative digital solutions and services. With a strategic relationship with Microsoft and a long history of innovation, financial strength, and international presence, we are recognized for our achievements in teaming with clients to deliver innovative digital solutions...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Deliver world-class technical training programs that empower the Databricks community to innovate and build next-generation data and AI solutions.About the RoleWe are seeking an experienced Technical Instructor to lead our training efforts. As a Sr. Technical Instructor, you will be responsible for designing, developing, and delivering comprehensive...

  • Data Analytics Engineer

    hace 1 semana


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job SummaryWe are seeking a highly skilled Data Analytics Engineer to join our team as an Onboarding Specialist. In this role, you will work closely with customers to onboard and deploy Databricks in a production environment.About the RoleThe ideal candidate will have 3+ years of experience in a customer-facing technical role in pre-sales, professional...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    As a Resident Solutions Architect at Databricks, you will have the opportunity to shape the future of big data technologies for leading Fortune 500 organizations.This senior-level customer-facing role requires deep expertise in Apache Spark, as well as a broad range of big data solution architecture experience.Main Responsibilities:Provide technical...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...

  • Data Architect Lead

    hace 1 semana


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    As a senior data engineer at Databricks, you will be responsible for advising customers on their onboarding journey and helping them deploy the Data Intelligence platform in their production environment.The impact you will have:You will ensure new customers have an excellent experience by providing technical assistance early in their journey.You will become...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleWe are seeking a talented Growth Architect to join our team at Databricks. This is an exciting opportunity for you to work with customers to onboard and deploy our Data Intelligence platform in their production environment.Key ResponsibilitiesProvide technical assistance to new customers during their onboarding journey, ensuring they have an...

  • Data Solutions Architect

    hace 1 semana


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About DatabricksDatabricks is a leading provider of data and AI solutions. The company has over 10,000 clients worldwide, including top brands like Comcast and Grammarly.Job Description:We are seeking an experienced Data Solutions Architect to join our team in Costa Rica. As a Technical Solutions Engineer, you will provide technical support for Databricks...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About DatabricksDatabricks is a leading data and AI company that empowers organizations to solve complex data problems. With over 10,000 customers worldwide, including Comcast, Condé Nast, and Grammarly, Databricks provides a unified data intelligence platform to democratize data, analytics, and AI.Job OverviewWe are seeking an experienced Associate...

  • Cloud Solutions Engineer

    hace 3 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Databricks Intelligence platform.As an Associate Customer Cloud Engineer, you will play a critical role during this customer journey. You will directly work with customers to help them onboard and deploy Databricks in a production...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    **Job Overview**We are seeking a skilled Data Engineer, Sales Operations Specialist to join our team at Databricks. This role will be responsible for driving the development of territory management processes, ensuring data integrity and executing ideal sales team account coverage models.**Key Responsibilities**The successful candidate will own data-driven...


  • San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Hitachi Solutions is a global Microsoft solutions integrator committed to delivering innovative digital solutions and services to our clients. Our industry focus and expertise set us apart, and we maintain a strategic relationship with Microsoft. We have a long history of innovation and financial strength, with a presence in over 100 countries.**Job...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Hitachi Solutions Ltd. Overview**Hitachi Solutions Ltd. is a global Microsoft solutions integrator dedicated to developing and delivering industry-focused solutions that support our clients in achieving their business transformation goals. Our industry expertise, intellectual property, and strategic relationship with Microsoft set us apart. We have earned...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** **Company Overview** Hitachi Solutions is a global solutions integrator passionate about designing, developing, and delivering cutting edge cloud solutions to help our clients innovative across their entire business. Our firm develops the business services and technology powering some of the products you use every day - and is...


  • San José, San José, Costa Rica Fullstack Labs A tiempo completo

    At FullStack Labs, we are committed to helping organizations achieve their digital transformation goals. As a leading software consultancy, we have partnered with top companies like Uber, GoDaddy, and Stanford University to build high-performing software development teams.We're proud of our achievements:Key Highlights:• Delivering life-changing career...