Databricks/data Engineer

hace 2 semanas


San José, San José, Costa Rica Hitachi Solutions A tiempo completo
Company Description


Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.

Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a strategic relationship with Microsoft.

Recognized for our achievements - teaming with our clients to deliver innovative digital solutions and services - is how we have achieved year after year recognition.


A part of Hitachi, Ltd., our company has a long and rich history of innovation, financial strength, and international presence of one of the world's largest companies.

Since 1910, Hitachi, Ltd.

has been a leader in manufacturing innovative products and solutions that support industry and social infrastructure around the globe supported by 303,000 employees in over 100 countries and across 864 companies.


Job Description:

**_

Please note:
_
Although our position is remote / virtual, you MUST** reside, and be authorized to work, in Costa Rica.

DATA ENGINEER (DATABRICKS, PYTHON, SPARK)


This is a full-time role in our product organization for a highly experienced Data Engineer in Big Data systems design with skills in data architecture, especially Spark and Delta/Data Lake technology.


Individuals in this role will assist in the design, development, enhancement, and maintenance of complex data pipelines products that manage business critical operations, and large-scale analytics pipelines.

Qualified applicants will have a demonstrated capability to learn new concepts quickly, have a data engineering background, and/or have robust software engineering expertise.


Responsibilities

  • Scope and execute together with team leadership. Work with the team to understand platform capabilities and how to best improve and expand those capabilities.
  • Strong independence and autonomy.
  • Experience leading mid
- and senior-level data engineers.

  • Support analytics, data science and/or engineering teams and understand their unique needs and challenges.
  • Instill excellence into the processes, methodologies, standards, and technology choices embraced by the team.
  • Embrace new concepts quickly to keep up with fastmoving data engineering technology.
  • Dedicate time to continuous learning to keep the team appraised of the latest developments in the space.
  • Commitment to developing technical maturity across the company.

Qualifications:

  • 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is
    REQUIRED; Azure cloud is
    _highly_
    _preferred_, however will consider AWS, GCP or other cloud platform experience in lieu of
  • Experience with conceptual, logical and/or physical database designs is
    _a plus_:
  • 2+ years of hands-on Python/Pyspark/SparkSQL and/or Scala experience is
    REQUIRED:
  • 2+ years of experience with Big Data pipelines or DAG Tools (Airflow, dbt, Data Factory, or similar) is
    REQUIRED:
  • 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is
    REQUIRED:
  • 2+ years of handson experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is
    REQUIRED:
  • Experience with source control (git) on the command line is
    REQUIRED:
  • 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data is
    _HIGHLY DESIRED_:
  • Data modeling / data profiling capabilities with Kimball/star schema methodology is
    _a plus_:
  • Professional experience with Kafka, or other live data streaming technology, is
    _HIGHLY DESIRED_:
  • Professional experience with database deployment pipelines (i.e.
, dacpac's or similar technology) is
_HIGHLY DESIRED_:

  • Professional experience with one or more unit testing or data quality frameworks is
    _HIGHLY DESIRED_

#LI-CA1

#REMOTE

#databricks

#dataengineer

#datawrangler
Additional Information

We are an equal opportunity employer.

All applicants will be considered for employment without attention to age, race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

All your information will be kept confidential according to EEO guidelines.

**Beware of scams
  • Databricks/data Engineer

    hace 2 semanas


    San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...

  • Databricks/data Engineer

    hace 2 semanas


    San José, San José, Costa Rica Hitachi Solutions A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...

  • Procurement Analyst

    hace 2 semanas


    San José, San José, Costa Rica Databricks A tiempo completo

    This is a hands-on role with the unique opportunity to help further the Databricks Procurement function and grow our operations impact. You will support the Procurement function in all purchasing needs across Databricks departments and partners. You will support processes for spend management, metrics tracking and reporting, purchase requisitions, supplier...


  • San José, San José, Costa Rica Databricks A tiempo completo

    The Databricks web development team is looking for an experienced senior web developer to join the team responsible for Databricks' marketing websites. Your work will be the front and center to millions of our web users and you will shape and scale our digital experience.You are eager to learn; our tools are constantly evolving. We are looking for someone...

  • Sr. Staff Web Developer

    hace 2 semanas


    San José, San José, Costa Rica Databricks A tiempo completo

    The Databricks web development team is looking for an experienced web developer to join the team responsible for Databricks' marketing websites. Your work will be the front and center to millions of our web users and you will shape and scale our websites.You are eager to learn; our tools are constantly evolving. We are looking for someone who is open,...

  • Data Ops Engineer

    hace 2 semanas


    San José, San José, Costa Rica GSB A tiempo completo

    An important company is looking for a Data Ops Engineer Strong technical skills, including proficiency with databases, SQL skill is essential, and programming languages (Python, Shell script must have) Expertise in source control systems such as GitHub Proficiency in CD/CI processes and tools, with experience in Jenkins, CircleCI, GitLab, or GitHub Actions...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Company DescriptionHitachi Solutions is a global solutions integrator passionate about designing, developing, and delivering cutting edge cloud solutions to help our clients innovative across their entire business. Our firm develops the business services and technology powering some of the products you use every day - and is closely aligned with Microsoft...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Company DescriptionCompany OverviewHitachi Solutions is a global solutions integrator passionate about designing, developing, and delivering cutting edge cloud solutions to help our clients innovative across their entire business. Our firm develops the business services and technology powering some of the products you use every day - and is closely aligned...


  • San José, San José, Costa Rica Encora A tiempo completo

    At Encora we are looking for a great talent like you to join our team as the next _Senior Data Integration Engineer __(536__5)_Would you like to join our great team of engineers? Here we will tell you more about us and the roleAbout the role:As a _Senior Data Integration Engineer_ you will be part of a highly skilled technology and agile team by supporting...

  • Sr. Data Engineer

    hace 2 semanas


    San José, San José, Costa Rica Route A tiempo completo

    We are Route**Buying stuff online can get messy once you hit that "order" button. Managing dozens carrier tracking links, dealing with lost or damaged packages, and resolving issues with customer support can feel like a wild goose chase. That's why we created Route — to make the post-purchase experience for consumers like you, and the brands you love, as...


  • San José, San José, Costa Rica Encora A tiempo completo

    Important InformationExperience: + 5 yearsJob Mode: Full-timeWork Mode: HybridJob SummaryAs a_ Data Engineer Lead/Architect (8626)_, you will be part of a highly skilled technology and agile team by supporting and developing cutting-edge solutions to meet our business requirements. You will help us accelerate our customers' business results by innovating...


  • San José, San José, Costa Rica Encora A tiempo completo

    At Encora we are looking for a great talent like you to join our team as the next _Senior Data Curation Engineer (5367)_Would you like to join our great team of engineers? Here we will tell you more about us and the roleAbout the role:As a _Senior Data Curation Engineer_, you will be part of a highly skilled technology and agile team by supporting and...


  • San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo

    Company DescriptionHitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals. Our industry focus, expertise, and intellectual property is what truly sets us apart. We have earned, and continue to maintain, a...

  • Data Engineer

    hace 2 semanas


    San José, San José, Costa Rica Datasite A tiempo completo

    Job Description:Who We AreWe are looking for a Data Engineer who loves to work with data, develop data pipelines, make quality data available at scale and has experience sourcing and preparing data.Summary:You will be joining a team responsible for the sourcing and preparation of data for data science and AI/ML processes. As a Data Engineer, you will be...

  • Senior Data Engineer

    hace 4 semanas


    San José, San José, Costa Rica PGBPGNGLOBAL A tiempo completo

    Job Location: San JoséJob Description: Designs, develops, and implements data and analytics cloud-based platforms and pipelines that acquire, cleanse, transform, and publish data from various sources. Creates large, intricate data sets that meet business requirements. Collaborates with data asset managers, architects, and development leads to ensure...

  • Data Engineer

    hace 2 semanas


    San José, San José, Costa Rica TransPerfect A tiempo completo

    TransPerfect Is More Than Just a JobOur greatest asset is our people, and nothing is more important to us than ensuring that everyone knows that. Each of our 100+ offices has its own individual identity, and each also has its own unique rewards. TPC-ITDEV Data EngineerMarcus McKibben 10/23/202- TransPerfect was founded with a mission to help the world's...

  • Data Quality Analyst

    hace 2 semanas


    San José, San José, Costa Rica Catalina Marketing A tiempo completo

    Why Catalina?Catalina's personalized digital media connects shoppers to the brands we know they want. We do this by delivering only the most relevant ads and offers from their home to the aisle. And only Catalina knows the evolving purchase history and individual needs of more than three-quarters (280 million) of American shoppers. With the world's largest...

  • Mid Data Engineer

    hace 2 semanas


    San José, San José, Costa Rica CRG Solutions A tiempo completo

    We are looking for an experienced Mid Data Engineer to work with product teams to develop pipelines to ingest data into a central data platform.WHAT YOU WILL BE DOING: Work with local product teams to design optimal solutions to ingest large, complex data sets that meet business requirements. Work with our central platform team to ensure solutions...

  • Data Engineer

    hace 2 semanas


    San José, San José, Costa Rica Infutor A tiempo completo

    Company DescriptionWe help the world see new possibilities and inspire change for better tomorrows. Our analytic solutions bridge content, data, and analytics to help business, people, and society become stronger, more resilient, and sustainable.Job Description:As a Data Engineer at Verisk Marketing Solutions, you will be responsible for collecting,...