Data Engineer With Databricks

hace 8 horas


San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

**Company Description**

Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.
Our industry focus, expertise, and intellectual property is what truly sets us apart.
We have earned, and continue to maintain, a strategic relationship with Microsoft.
Recognized for our achievements - teaming with our clients to deliver innovative digital solutions and services - is how we have achieved year after year recognition.
A part of Hitachi, Ltd., our company has a long and rich history of innovation, financial strength, and international presence of one of the world's largest companies.
Since 1910, Hitachi, Ltd. has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure around the globe supported by 303,000 employees in over 100 countries and across 864 companies.
**Please note**:Although our position is remote / virtual, you
**MUST** reside, and be authorized to work, in Costa Rica.
**SENIOR DATA ENGINEER (DATABRICKS, PYTHON, SPARK)**

This is a full-time role in our product organization for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology.
Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business critical operations, and large-scale analytics pipelines.
Qualified applicants will have a demonstrated capability to learn new concepts quickly, have a data engineering background, and/or have robust software engineering expertise.
**Responsibilities**
- Scope and execute together with team leadership.
Work with the team to understand platform capabilities and how to best improve and expand those capabilities.
- Strong independence and autonomy.
- Experience leading mid
- and senior-level data engineers.
- Support analytics, data science and/or engineering teams and understand their unique needs and challenges.
- Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
- Embrace new concepts quickly to keep up with fast-moving data engineering technology.
- Dedicate time to continuous learning to keep the team appraised of the latest developments in the space.
- Commitment to developing technical maturity across the company.
**Qualifications**
- 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is **REQUIRED**; Azure cloud is **highly preferred**, however will consider AWS, GCP or other cloud platform experience in lieu of
- Experience with conceptual, logical and/or physical database designs is **a plus**:

- 2+ years of hands-on Python/Pyspark/SparkSQL experience is **REQUIRED; **experience with Scala is a plus
- 2+ years of experience with Big Data pipelines or DAG Tools (Airflow, Dbt, Data Factory, or similar) is **REQUIRED**:

- 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is **REQUIRED**:

- 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is **REQUIRED**:

- 2+ years of experience with source control (git) on the command line is **REQUIRED**:

- 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is HIGHLY DESIRED
- Data modeling / data profiling capabilities with Kimball/star schema methodology is HIGHLY DESIRED
- Professional experience with Kafka, or other live streaming technology, is HIGHLY DESIRED
- Professional experience with database deployment pipelines (i.e., dacpac's or similar technology) is HIGHLY DESIRED
- Professional experience with one or more unit testing or data quality frameworks is HIGHLY DESIRED

**#LI-CA1**

**#REMOTE**

**#DATABRICKS**

**Additional Information**

We are an equal opportunity employer.
All applicants will be considered for employment without attention to age, race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
All your information will be kept confidential according to EEO guidelines.
**Beware of scams



  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About Databricks">Databricks is a leading data and AI company that empowers organizations to unlock the full potential of their data. With over 10,000 customers worldwide, including Comcast, Condé Nast, Grammarly, and over 50% of the Fortune 500, we are trusted by some of the world's most innovative brands.">Our Culture">We pride ourselves on our inclusive...


  • San José, Costa Rica Hitachi Solutions A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...

  • Data Engineer

    hace 22 horas


    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the Role">This is a unique opportunity to join Databricks as a Customer Data Engineer, playing a critical role in customer onboarding and deployment of our platform. As part of this team, you will directly work with customers to help them onboard and deploy Databricks in a production environment.">Responsibilities:">">Onboard new customers to the...


  • San José, San José, Costa Rica Fullstack Labs A tiempo completo

    Job Title: Cloud Engineer with Databricks ExpertiseEstimated Salary: $120,000 - $180,000 per yearCompany OverviewFullStack Labs is the fastest-growing software consultancy in the Americas. We help organizations build distributed software development teams and deliver transformational digital solutions.We focus on hiring talented software designers and...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San José, Costa Rica Hitachi Solutions A tiempo completo

    Company Description Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San Francisco, Costa Rica Databricks A tiempo completo

    As a Technical Solutions Engineer, you will provide technical support for Spark Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance and knowledge that they need to accomplish value and achieve their strategic goals...


  • San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...


  • San José, Costa Rica Hitachi Solutions A tiempo completo

    Company Description Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Description:">Databricks is the leading platform for modern data architecture. As a Resident Solutions Architect, you will play a crucial role in shaping the future of big data solutions for Fortune 500 organizations.">About the Role:">You will provide technical leadership to strategic customers, guiding them through the design and implementation of big...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleDatabricks is seeking a highly motivated and experienced Full Stack Automation Engineer to join our Go-to-Market (GTM) Strategy & Operations team. As a key member of this team, you will play a crucial role in building Learning & Enablement strategy, providing strategic analyses, and driving a data-driven decision-making approach to our...

  • Databricks/Data Engineer

    hace 13 horas


    San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description**Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Company OverviewDatabricks is a leading provider of cloud-based data and analytics solutions. With over 9,000 organizations worldwide relying on our platform, we are committed to empowering data teams to solve the world's toughest problems.

  • Databricks/Data Engineer

    hace 12 horas


    San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description**Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Company OverviewDatabricks is the leading data and AI company, with over 9,000 organizations worldwide relying on its platform to unify their data, analytics, and AI.Founded by the original creators of Apache Spark, Delta Lake, and MLflow, Databricks is committed to helping data teams solve the world's toughest problems.


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    We are seeking an experienced Technical Data Solutions Architect to join our team at Databricks. As a key member of our organization, you will play a pivotal role in enabling the technical community with skills and knowledge to innovate and build next-generation data and AI solutions.**Estimated Salary:** $160,000 - $200,000 per year.The primary...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job Description:Databricks is seeking an experienced Technical Program Manager to lead process improvements and project management across engineering operations.This role involves running end-to-end processes, improving product lifecycle costs, and executing large-scale projects. The successful candidate will work closely with the R&D Operations team and...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    About the RoleDatabricks, a leading provider of data and AI solutions, is seeking an experienced Data Analyst to join its Sales Finance team in the FP&A organization. As a key member of this team, you will be responsible for maintaining the source of truth for sales metrics, supporting monthly/quarterly close and ad-hoc reporting.Key ResponsibilitiesExtract...


  • San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Pioneer a vibrant, Modern Data and AI Stack partner ecosystem with Databricks.As a Partner Technical Advisor, you will spearhead building strategic partnerships that drive innovation for our customers. With over a hundred Technology Partners already on board, Databricks accelerates time-to-value.Key Responsibilities:Become a technical expert on the full...