Data Engineer: Cloud Data Pipeline Architect
hace 5 días
Hitachi Solutions Ltd is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to achieve their business goals. Our expertise and intellectual property set us apart, and we maintain a strategic relationship with Microsoft.
We are a part of Hitachi, Ltd., a leader in manufacturing innovative products and solutions that support industry and social infrastructure globally. With over 303,000 employees in more than 100 countries across 864 companies, we have a rich history of innovation, financial strength, and international presence.
Note that while our position is remote, you must live and be authorized to work in Costa Rica.
Job Description
This full-time opportunity is well-benefited and a career path in our Data & Analytics organization (Azure DataWarehouse / DataLakehouse and Business Intelligence) for an experienced Data Engineer in Big Data systems design. You will assist in the design, development, enhancement, and maintenance of complex data pipelines products managing business-critical operations and large-scale analytics pipelines.
You will scope and execute projects together with team leadership, work with the team to understand platform capabilities, and improve and expand those capabilities. Strong independence and autonomy are expected, as well as experience leading mid- and senior-level data engineers. Support analytics, data science, and engineering teams and understand their unique needs and challenges. Instill excellence into processes, methodologies, standards, and technology choices embraced by the team. Embrace new concepts quickly to keep up with fast-moving data engineering technology. Dedicate time to continuous learning to keep the team appraised of the latest developments in the space. Commitment to developing technical maturity across the company.
Required Skills and Qualifications
- 5+ years of Data Engineering experience including 2+ years designing and building Databricks data pipelines is required; Azure cloud is highly preferred, but AWS, GCP, or other cloud platform experience will be considered in lieu of Azure. Experience with conceptual, logical, and/or physical database designs is a plus.
- 2+ years of hands-on Python/Pyspark/SparkSQL and/or Scala experience is required.
- 2+ years of experience with Big Data pipelines or DAG Tools (Data Factory, Airflow, dbt, or similar) is required.
- 2+ years of Spark experience (especially Databricks Spark and Delta Lake) is required.
- 2+ years of hands-on experience implementing Big Data solutions in a cloud ecosystem, including Data/Delta Lakes, is required.
- Experience with source control (git) on the command line is required.
- 2+ years of SQL experience, specifically to write complex, highly optimized queries across large volumes of data, is highly desired.
- Data modeling/data profiling capabilities with Kimball/star schema methodology is a plus.
- Professional experience with Kafka, or other live data streaming technology, is highly desired.
- Professional experience with database deployment pipelines (i.e., dacpac's or similar technology) is highly desired.
- Professional experience with one or more unit testing or data quality frameworks is highly desired.
Benefts
Hitachi Solutions Ltd offers a comprehensive benefits package, including competitive salary, opportunities for growth and professional development, and a collaborative work environment.
-
Python Data Pipeline Architect
hace 2 días
San José, San José, Costa Rica Datasite A tiempo completoDatasite is transforming the way companies do Mergers and Acquisitions (M&A), and we need your help to drive this transformation!We are seeking a highly skilled Junior Data Engineer to join our R&D team, who will be responsible for building scalable data pipelines and AI models that enable intelligent features in our products.About the TeamWe are a global...
-
Cloud Data Architect
hace 3 días
San José, San José, Costa Rica Modern Talent Hub Es A tiempo completo**Description of the Position**We are looking for a talented Data Architect to join our team at Modern Talent Hub. The successful candidate will be responsible for developing data engineering solutions using Microsoft Azure stack, establishing data pipeline patterns, and collaborating with cross-functional teams to achieve business objectives.The ideal...
-
Senior Data Pipeline Engineer
hace 7 días
San José, San José, Costa Rica Zm Financial Systems A tiempo completoAbout the Role:Zm Financial Systems is a leading provider of data solutions, and we are seeking a Senior Data Pipeline Engineer to join our global team.This role will focus on designing and implementing high-performance data pipelines using event streaming technologies such as Kafka, Confluent, and Redpanda. The successful candidate will work closely with...
-
Data Architect
hace 3 días
San José, San José, Costa Rica Appvance A tiempo completoAppvance.ai seeks a highly skilled Data Architect to develop and enhance ETL pipelines. As a key member of our technical team, you will be responsible for architecting, building, maintaining, scaling, monitoring, administering, and securing our AIQ platform. This is an exciting opportunity to work in a fast-paced environment with a multi-disciplinary team.We...
-
Senior Software Engineer
hace 7 días
San José, San José, Costa Rica Virtualmind A tiempo completoVirtualmind is a cutting-edge team of engineers looking for a skilled professional to help us drive our projects forward.We're seeking a senior software engineer with extensive experience in cloud computing and pipeline development.The ideal candidate will have:10+ years of experience in software development using JVM-based languagesProven expertise in...
-
Chief Data Architect
hace 3 días
San José, San José, Costa Rica Modern Talent Hub Es A tiempo completo**About the Role**At Modern Talent Hub, we are seeking a skilled Data Architect to join our team. This is a unique opportunity for a motivated professional to lead the development of data engineering solutions using Microsoft Azure stack.The ideal candidate will have a strong background in cloud computing, data architecture, and DevOps. They will be...
-
Cloud-Based Data Architect
hace 7 días
San José, San José, Costa Rica Virtualmind A tiempo completoWe are Virtualmind, an innovative engineering team ready to elevate projects with top companies.Our goal is to stay ahead of the curve.To achieve this, we're seeking a seasoned software engineer with:10+ years of experience using JVM-based languagesExpertise in developing cloud-based pipelines5+ years of hands-on experience with Spark and ScalaExperience in...
-
Senior Cloud Data Engineer
hace 2 días
San José, San José, Costa Rica Ex2 Outcoding A tiempo completoAt Ex2 Outcoding, we're seeking a highly skilled Snowflake Developer to join our team. This role involves designing and implementing effective data solutions using Snowflake and other cloud technologies.The successful candidate will have extensive experience in data integration, ETL processes, and working with large datasets. They will be responsible for...
-
San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completoHitachi Solutions Ltd, a leading global Microsoft solutions integrator, is seeking a highly experienced Senior Data Architect to join its product organization. The ideal candidate will have a strong background in designing and building complex data pipelines using Databricks and Big Data systems.The successful candidate will be responsible for assisting in...
-
Data Engineer
hace 4 semanas
San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo**Company Description**Hitachi Solutions is a global Microsoft solutions integrator passionate about developing and delivering industry-focused solutions that support our clients to deliver on their business transformation goals.Our industry focus, expertise, and intellectual property is what truly sets us apart.We have earned, and continue to maintain, a...
-
Data Engineer Specialist
hace 2 días
San José, San José, Costa Rica Datasite A tiempo completoDatasite is a global leader in the M&A technology space, providing innovative solutions for high-value transactions.We are seeking a highly skilled Junior Data Engineer to join our R&D team, who will be responsible for building scalable data pipelines and AI models that drive business growth.Key ResponsibilitiesDesign and develop efficient data pipelines...
-
Crm Data Architect
hace 1 semana
San José, San José, Costa Rica Netskope A tiempo completo**About Netskope**:Today, there's more data and users outside the enterprise than inside, causing the network perimeter as we know it to dissolve.We realized a new perimeter was needed, one that is built in the cloud and follows and protects data wherever it goes, so we started Netskope to redefine Cloud, Network and Data Security.**About the...
-
Data Engineer
hace 3 semanas
San José, San José, Costa Rica Bluelight Consulting A tiempo completoBluelight Consulting is a leading software consultancy seeking a skilled Data Engineer to join our fast-growing team.Our mission is to design and develop technology that improves the lives of its users while providing an exceptionally high level of service to our clients.We are looking for Data Engineer who want to be part of a fast-paced, dynamic...
-
Aws Data Architect
hace 4 semanas
San José, San José, Costa Rica Sofka A tiempo completoAre you a Data Engineering expert with a passion for building scalable and high-performance data solutions in the cloud?Do you thrive in a fully English-speaking, multicultural environment and enjoy working on exciting projects for international clients ?If so, we want you on our teamWe're looking for a Senior Data Engineer with AWS Architecture expertise to...
-
Enterprise Data Solutions Developer
hace 7 días
San José, San José, Costa Rica Zm Financial Systems A tiempo completoAs a senior cloud database architect at Zm Financial Systems, you will be responsible for designing cloud-infrastructure architecture options for our data pipelines and stores, and contributing to the development of innovative enterprise data solutions in a fast-paced environment.You will leverage tools such as JIRA and Confluence to track requirements and...
-
Software Data Engineer Ii
hace 3 semanas
San José, San José, Costa Rica Imprivata A tiempo completoCome join a winning teamHere at Imprivata, you'll see a dedicated group of professionals who care about improving healthcare.Our team thrives on collaboration and sharing ideas, whether in a cross-functional meeting or at one of our virtual team-building events.While we're diverse in our backgrounds and skills, we have much in common.A passion for our...
-
Senior Data Architect With Big Data Expertise
hace 7 días
San José, San José, Costa Rica Hitachi Solutions Ltd A tiempo completo**About Us**Hitachi Solutions Ltd is a global Microsoft solutions integrator dedicated to delivering industry-focused solutions that support our clients in achieving their business transformation goals. Our expertise and intellectual property set us apart, enabling us to maintain a strategic relationship with Microsoft.We are recognized for our achievements...
-
Cloud Event Streaming Architect
hace 7 días
San José, San José, Costa Rica Zm Financial Systems A tiempo completoJob Description:We are seeking a highly skilled Cloud Event Streaming Architect to join our team at Zm Financial Systems.The ideal candidate will have extensive experience with event-driven architecture, cloud-based systems, and data pipelines. They will be responsible for designing, implementing, and maintaining scalable and efficient data processing...
-
Operations Data Engineer
hace 4 semanas
San José, San José, Costa Rica Lightforce Ortho A tiempo completoOperations Data EngineerAt LightForce, we are seeking a motivated Operations Data Engineer to join our growing team of analysts. This role offers a high level of autonomy and flexibility, allowing you to take ownership of your projects and implement robust, scalable, and reliable data solutions across the business.Key Responsibilities:Expand and optimize our...
-
Cloud Database Architect Lead
hace 7 días
San José, San José, Costa Rica Zm Financial Systems A tiempo completoAt Zm Financial Systems, we are a team of passionate technologists who are pushing the limits on what is possible with advanced cloud technologies.We source information from hundreds of providers and our award-winning platforms deliver data and insights to thousands of customers around the world, across various industries covering over 400 million public and...