Data Engineer with Databricks

hace 4 meses


San José, Costa Rica Hitachi Solutions A tiempo completo

Company Description

Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a strategic relationship with Microsoft. Recognized for our achievements - teaming with our clients to deliver innovative digital solutions and services - is how we have achieved year after year recognition.

A part of Hitachi, Ltd., our company has a long and rich history of innovation, financial strength, and international presence of one of the world’s largest companies. Since 1910, Hitachi, Ltd. has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure around the globe supported by 303,000 employees in over 100 countries and across 864 companies.

**Job Description**:
**_
Please note: _**Although our position is remote/virtual, you **MUST** reside, and be authorized to work, in Costa Rica.

**SENIOR DATA ENGINEER (DATABRICKS, PYTHON, SPARK)**

This is a full-time role in our product organization for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology.

Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business critical operations, and large-scale analytics pipelines. Qualified applicants will have a demonstrated capability to learn new concepts quickly, have a data engineering background, and/or have robust software engineering expertise.

**Responsibilities**
- Scope and execute together with team leadership. Work with the team to understand platform capabilities and how to best improve and expand those capabilities.
- Strong independence and autonomy.
- Experience leading mid
- and senior-level data engineers.
- Support analytics, data science and/or engineering teams and understand their unique needs and challenges.
- Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
- Embrace new concepts quickly to keep up with fast-moving data engineering technology.
- Dedicate time to continuous learning to keep the team appraised of the latest developments in the space.
- Commitment to developing technical maturity across the company.

**Qualifications**:

- 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is **REQUIRED**; Azure cloud is **_highly_** **_preferred_**, however will consider AWS, GCP or other cloud platform experience in lieu of
- Experience with conceptual, logical and/or physical database designs is **_a plus_**:

- 2+ years of hands-on Python/Pyspark/SparkSQL experience is **REQUIRED; **experience with Scala _is a plus_
- 2+ years of experience with Big Data pipelines or DAG Tools (Data Factory, dbt, Airflow, or similar) is **REQUIRED**:

- 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is **REQUIRED**:

- 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is **REQUIRED**:

- 2+ years of experience with source control (git) on the command line is **REQUIRED**:

- 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is _HIGHLY DESIRED_
- Data modeling / data profiling capabilities with Kimball/star schema methodology is _HIGHLY DESIRED_
- Professional experience with Kafka, or other live data streaming technology, is _HIGHLY DESIRED_
- Professional experience with database deployment pipelines (i.e., dacpac’s or similar technology) is _HIGHLY DESIRED_
- Professional experience with one or more unit testing or data quality frameworks is _HIGHLY DESIRED_

**#LI-CA1**

**#remote**

**#databricks**

**#python**

**#spark**

**#bigdata**

**#dataengineer**

**#datawrangler**

Additional Information

We are an equal opportunity employer. All applicants will be considered for employment without attention to age, race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

All your information will be kept confidential according to EEO guidelines.

**Beware of scams



  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San José, Costa Rica Hitachi Solutions A tiempo completo

    Company Description Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the Role:We are seeking a highly skilled Technical Solutions Engineer to join our team at Databricks. As a Technical Solutions Engineer, you will play a critical role in providing technical support for Databricks Platform related issues and resolving complex challenges involving the Databricks unified analytics platform.Key...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San José, Costa Rica Hitachi Solutions A tiempo completo

    Company Description Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...


  • San Francisco, Costa Rica Databricks A tiempo completo

    As a Technical Solutions Engineer, you will provide technical support for Spark Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance and knowledge that they need to accomplish value and achieve their strategic goals...

  • Technical Account Manager

    hace 3 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the Role:Databricks is seeking an experienced Designated Support Engineer to join our team. As a key member of our support organization, you will be responsible for providing high-touch support to our largest strategic accounts.Key Responsibilities:Develop and maintain close relationships with strategic customersCoordinate and prioritize...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** **Company Overview** Hitachi Solutions is a global solutions integrator passionate about designing, developing, and delivering cutting edge cloud solutions to help our clients innovative across their entire business. Our firm develops the business services and technology powering some of the products you use every day - and is...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Transform Enterprise Data with DatabricksThis role requires 50% travel to Mexico and other Spanish-speaking countries in Central & South America.We seek an experienced pre-sales professional with a successful track record helping large enterprises become more data-driven. Working with the Account Executive (AE), the Solutions Architect defines and directs...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Unlock Business Potential with Data-Driven SolutionsWe're seeking an experienced professional to join our team as a Solutions Architect. As a key member of our pre-sales team, you'll work closely with Account Executives to develop and execute technical strategies for our largest and most important accounts.Your Impact:You'll be the primary technical voice...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Transforming Enterprises with Data-Driven SolutionsWe are seeking an experienced pre-sales professional to join our team at Databricks. As a Solutions Architect, you will work closely with our Account Executive to define and direct the technical strategy for our largest and most important accounts. Your expertise in value selling, technical account...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the Role:We are seeking a highly skilled Technical Solutions Engineer to join our team at Databricks. As a Technical Solutions Engineer, you will play a critical role in providing technical support for Databricks Platform related issues and resolving complex challenges involving the Databricks unified analytics platform.Your Key...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Title: Senior Technical Solutions EngineerAbout the Role:We are seeking a highly skilled Senior Technical Solutions Engineer to join our team at Databricks. As a Technical Solutions Engineer, you will play a critical role in providing technical support for Databricks Platform related issues and resolving complex challenges involving the Databricks...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleThis is a unique opportunity to join Databricks as a Solutions Architect, working closely with our Account Executive team to drive technical strategy for our largest and most important accounts. As a key member of our pre-sales team, you will be responsible for defining and directing the technical approach for these accounts, leading to...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleWe're seeking an experienced Network Operations Center engineer to join our team at Databricks. As a key member of our infrastructure team, you will be responsible for monitoring critical infrastructure, developing monitoring tools and alerting dashboards, and working closely with stakeholders to investigate and resolve incidents.Key...

  • Data Platform Architect

    hace 2 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleWe are seeking a highly skilled Data Platform Architect to join our team at Databricks. As a key member of our growth team, you will play a critical role in advising customers on their onboarding journey and ensuring a seamless deployment of our Data Intelligence platform in their production environment.Key ResponsibilitiesProvide technical...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Title: Designated Support EngineerDatabricks is seeking an experienced Designated Support Engineer to join our team. As a key member of our support organization, you will be responsible for providing high-touch support to our largest strategic customers.Key Responsibilities:Develop and maintain close relationships with strategic customersCoordinate and...

  • Data Analyst

    hace 3 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the Role: We are seeking a highly skilled Data Analyst to join our team at Databricks. As a Data Analyst, you will play a critical role in providing data-driven insights to support business decisions. Key Responsibilities: Data Analysis: You will be responsible for analyzing complex data sets to identify trends, patterns, and correlations. Reporting...

  • Customer Success Engineer

    hace 3 semanas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleWe are seeking an experienced Designated Support Engineer to join our team at Databricks. As a key member of our support organization, you will be responsible for providing high-touch support to our largest strategic accounts.Key ResponsibilitiesDevelop and maintain close relationships with a strategic group of customers, working closely with...