Azure/databricks Data Engineer

hace 3 semanas

San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

**Company Description**

**Company Overview**

Hitachi Solutions is a global solutions integrator passionate about designing, developing, and delivering cutting edge cloud solutions to help our clients innovative across their entire business. Our firm develops the business services and technology powering some of the products you use every day - and is closely aligned with Microsoft and other leaders in the cloud computing space.

What sets Hitachi Solutions apart is both our industry focus, and the intellectual property that we bring to our customers. Recognized for our achievements year after year, we strive to be the trusted advisor of large and medium sized enterprises alike - helping them move fast to achieve strategic business initiatives with distinguished engineering, hard work, and compassion. With over 3,000 team members across 14 countries, in our 18 years of focus our company has seen explosive growth and high customer satisfaction. This has allowed us to offer exceptionally compelling salaries, 401k match, family leave, and health benefits. And no - we will not make you come into an office or ask for an inflexible work schedule.

A part of Hitachi, Ltd., our company has a long and rich history of innovation, financial strength, and international presence of one of the world's largest companies. Since 1910, Hitachi, Ltd. has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure around the globe supported by 303,000 employees in over 100 countries and across 864 companies.

**New Product Development and Innovations Team**

This position in our company is housed in our New Product Development and Innovations team formed in 2021. Joining this team represents an opportunity to fast-track your career and to work with a team of fun and nerdy colleagues in a disruptive atmosphere: well-funded, focused on hypergrowth, moving quickly, and making mistakes in the furtherance of innovation and sound engineering.

Armed with an existing book of business, and a stable financial parent - it is the goal of this group to help our firm introduce products to enhance our already strong services business - ultimately making the cloud easier for our customers, and allowing us to hit our long term financial goals with greater-than linear scale.

**Please note**:Although our position is remote / virtual / work-from-home, you
**MUST** reside, and be authorized to work, in Costa Rica.

**DATA ENGINEER (DATABRICKS, PYTHON, SPARK)**

This is a full-time role in our product organization for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology.

Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business critical operations, and large-scale analytics pipelines. Qualified applicants will have a demonstrated capability to learn new concepts quickly, have a data engineering background, and/or have robust software engineering expertise.

**Responsibilities**
- Scope and execute together with team leadership. Work with the team to understand platform capabilities and how to best improve and expand those capabilities.
- Strong independence and autonomy.
- Experience leading mid
- and senior-level data engineers.
- Support analytics, data science and/or engineering teams and understand their unique needs and challenges.
- Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
- Embrace new concepts quickly to keep up with fast-moving data engineering technology.
- Dedicate time to continuous learning to keep the team appraised of the latest developments in the space.
- Commitment to developing technical maturity across the company.

**Qualifications**
- 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is **REQUIRED**; Azure cloud preferred, will consider AWS, GCP or other cloud platform experience in lieu of
- Experience with conceptual, logical and/or physical database designs is HIGHLY DESIRED
- 2+ years of hands-on Python/Pyspark/SparkSQL experience is **REQUIRED; **experience with Scala is a plus
- 2+ years of experience with Big Data pipelines or DAG Tools (Airflow, Dbt, Data Factory, or similar) is **REQUIRED**:

- 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is **REQUIRED**:

- 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is **REQUIRED**:

- 2+ years of experience with source control (git) on the command line is **REQUIRED**:

- 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is HIGHLY DESIRED
- Strong data modeling / data profiling capabilities with Kimball/star schema methodology is HIGHLY DESIRED
- Professional exp

  • Data Engineer

    hace 4 días

    San José, Costa Rica DXC Technology A tiempo completo

    **Responsibilities**: - Work as part of a team to develop Cloud Data and Analytics solutions - Participate in development of cloud data warehouses, data as a service, business intelligence solutions - Ability to provide solutions that are forward-thinking in data and analytics - Deliver a quality product - Coding complex Spark (Python), T-SQL - Developing...

  • Data Analytics Engineer

    hace 1 semana

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    At Databricks, we empower our customers to solve the world's toughest data problems using the Lakehouse platform.As a Customer Data Engineer, you will play a pivotal role in this customer journey. You will work closely with customers to onboard and deploy Databricks in production environments.You will be part of a team responsible for onboarding new...

  • Customer Data Engineer

    hace 1 semana

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    CSQ225R15At Databricks, we are on a mission to empower our customers to solve the world's toughest data problems by utilizing the Lakehouse platform.As a Customer Data Engineer, you will play a critical role during this customer journey.You will directly work with customers to help them onboard and deploy Databricks in a production environment.The impact you...

  • Data Engineer

    hace 2 días

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    The Data Engineer contributes in technological decisions for business teams' future data and analysis needs.You will support the business's daily operations inclusive of troubleshooting of the business's data warehouse environment and job monitoring.You will guide the business in identifying any new data needs and provide mechanisms for acquiring and...

  • Data Platform Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    We're hiring a highly skilled Senior Cloud Network Operations Engineer to join our team at Databricks.Databricks is a global leader in the data and AI space, and we're looking for talented individuals to help us drive innovation and excellence.As a Senior Cloud Network Operations Engineer, you'll play a critical role in ensuring the availability,...

  • Azure Data Engineer

    hace 4 semanas

    San José, Costa Rica Feuji A tiempo completo

    Design, architect and implement end to end data solutions in Azure (storage, integration, processing). The candidate must be well versed with Azure Dataverse, Azure Data Lake Store, Cosmos DB, Azure SQL, Azure Synapse SQL, Azure for Files, Blob, Queues & Tables, Azure Data Factory, Databricks, HD Insights, SSIS etc

  • Cloud Native Data Architect

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    We are seeking a Cloud Native Data Architect to join our team at Databricks.This role requires a deep understanding of cloud-native technologies, including AWS, Azure, and GCP.The ideal candidate will have a strong track record of designing and implementing scalable cloud-native big data solutions and be able to communicate complex technical concepts to...

  • Data Platform Professional

    hace 1 día

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job DescriptionWe are seeking an experienced Cloud Engineer to join our team as an Associate Customer Cloud Engineer.As a key member of our customer onboarding process, you will work closely with customers to deploy Databricks in a production environment.About UsDatabricks is the data and AI company. More than 10,000 organizations worldwide — including...

  • Data Engineer in Azure Cloud

    hace 1 semana

    San José, San José, Costa Rica Feuji A tiempo completo

    **Feuji Job Posting - Data Engineer in Azure Cloud**We are seeking a highly skilled Data Engineer to join our team. As a Data Engineer in Azure Cloud, you will be responsible for designing, implementing, and maintaining large-scale data solutions on Azure.The ideal candidate will have a strong background in data engineering, with experience in working with...

  • Databricks/Data Engineer

    hace 1 semana

    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description**Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...

  • Databricks/Data Engineer

    hace 22 horas

    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...

  • Technical Solutions Engineer

    hace 4 días

    San Francisco, Costa Rica Databricks A tiempo completo

    As a Technical Solutions Engineer, you will provide technical support for Spark Platform related issues and resolve any challenges involving the Databricks unified analytics platform. You will assist customers in their Databricks journey and provide them with the guidance and knowledge that they need to accomplish value and achieve their strategic goals...

  • Technical Solutions Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    As a Technical Solutions Engineer, you will provide technical support for Spark Platform related issues and resolve any challenges involving the Databricks unified analytics platform.You will assist customers in their Databricks journey and provide them with the guidance and knowledge that they need to accomplish value and achieve their strategic goals using...

  • Azure Data Engineer Lead

    hace 6 días

    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    At Hitachi Solutions, we deliver industry-focused solutions that drive business transformation. Our strategic partnership with Microsoft enables us to develop and deliver cutting-edge digital solutions. With a strong focus on innovation, we maintain a competitive edge in the market.Data Engineers play a critical role in our organization, collaborating with...

  • Cloud Data Engineer

    hace 5 días

    San Francisco, Heredia, Costa Rica Databricks A tiempo completo

    Job OverviewWe are seeking a highly skilled Cloud Data Engineer to join our team. In this role, you will be responsible for onboarding new customers to the Databricks platform and assisting them in utilizing its various features.

  • Azure Data Platform Specialist

    hace 1 día

    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Career OpportunitiesWe are seeking a talented Data Engineer to join our team and contribute to the design, development, and implementation of high-quality modern Azure data solutions.The ideal candidate will have a strong background in Data Engineering or Data Science, with expertise in Databricks, PySpark, Delta Lake, Streaming/Batch processing, MLflow, and...

  • Databricks/data Engineer

    hace 3 días

    San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description** Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain,...

  • Databricks/data Engineer

    hace 2 días

    San José, Costa Rica Hitachi Solutions A tiempo completo

    Company Description Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...

  • Data Engineer With Databricks

    hace 4 semanas

    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    **Company Description**Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...

  • Data Engineer With Databricks

    hace 4 semanas

    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...