Data Engineer
hace 1 semana
Job Description:
Cloudera Data Engineers are focused on working internally on Cloudera’s Data Warehouse implementation for purposes of ingesting data for Business Operations and Analytics. A Data Engineer is responsible for the design and implementation of data pipelines, drawing on a range of Big Data technologies to support data ingestion and transformation workflows with varying complexity, requirements, and SLAs.
A Data Engineer at Cloudera will build on and develop fluency in Big Data ingest and transformation as well as being responsible for data quality and integrity for the pipelines.
Data Engineers are expected to deliver data pipelines that meet specifications developed by our Data Architects, while maintaining reusability and flexibility for changes over time - in an agile development environment. Data models from these pipelines will inform the daily actions of business groups across the Company.
Key Responsibilities
- Work with the Data Architects to understand the data needs of the lines-of-business.
- Work with the data owners to get access to data and ingest it into the data store in a reliable way.
- Build transformations primarily using SQL to enrich data, following the specifications and standards from the Data Architecture team.
- Create real-time data flows to meet the needs of operational systems.
- Monitor the flow of data to keep data services reliable.
**Requirements**:
- Strong written and oral communication skills required
- Comfortable coding in SQL, scripting languages, Java, Python
- Some experience with ETL, Business Intelligence, and Data Processing
- Proven ability to architect and implement reliable data pipelines
- Hands-on experience with Hadoop Technologies. At least one of Impala, Hive, Kafka, MapReduce, or Spark
- Experience monitoring critical data pipelines for correctness
- Debugging skills to address issues in data pipelines
Nice to have
- Experience with Airflow
- Experience optimizing data storage in HDFS/Parquet/Avro, Kudu, or HBase
- Experience with third party tools like Streamsets and Trifacta
- Experience with Cloudera Labs’ Envelope Spark Framework
-
Data Infrastructure Engineer
hace 1 semana
San Francisco, Heredia, Costa Rica Ntt Data A tiempo completoAbout the RoleThis Data Infrastructure Engineer position is crucial in ensuring the smooth operation of our storage systems. You will work closely with our IT teams to support databases, virtualization, and server environments.Responsibilities:Perform routine maintenance and upgrades on SAN/NAS systems.Troubleshoot storage-related issues, including...
-
Data Engineer
hace 3 horas
San Francisco, Heredia, Costa Rica Databricks A tiempo completoThe Data Engineer contributes in technological decisions for business teams' future data and analysis needs.You will support the business's daily operations inclusive of troubleshooting of the business's data warehouse environment and job monitoring.You will guide the business in identifying any new data needs and provide mechanisms for acquiring and...
-
Data Engineer
hace 3 semanas
San José, Costa Rica DXC Technology A tiempo completoWe are looking for Data Engineer working with Dev Team and Client to design & deliver Azure based customized calculation engine framework supporting Marketing and Trade Fund Management. The key objective is the successful deployment of the solution in the NA region for Global Customers. **Experience**: - Experience in all types of activities related to...
-
Data Engineer
hace 6 días
San José, San José, Costa Rica Cloudera A tiempo completoJob Description:Cloudera Data Engineers are focused on working internally on Cloudera's Data Warehouse implementation for purposes of ingesting data for Business Operations and Analytics.A Data Engineer is responsible for the design and implementation of data pipelines, drawing on a range of Big Data technologies to support data ingestion and transformation...
-
Senior Data Engineer
hace 1 semana
San José, Costa Rica Critical Mass A tiempo completoWe are looking for a Data Engineer for our team. The Data Engineer facilitates the flow of massive quantities of raw files from various disparate locations into well-harmonized tables. Much is made of the potential to use data to solve the world's problems - the data engineer knows that this "data" is useless unless it can be organized into analyzable...
-
Data Engineer
hace 1 semana
San José, Costa Rica DXC Technology A tiempo completoWe are looking for Data Engineer working with Dev Team and Client to design & deliver Azure based customized calculation engine framework supporting Marketing and Trade Fund Management. The key objective is the successful deployment of the solution in the NA region for Global Customers. **Experience**: - Experience in all types of activities related to...
-
Data Engineer
hace 2 semanas
San Francisco, Heredia, Costa Rica Sgf Global A tiempo completo**Data Engineer (Hybrid)****Heredia, Costa Rica**SGF Global is looking for a Data Engineer, for IT enterprise in Heredia, Costa Rica.**Requirements**:- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline-- Three or more years of experience with Hadoop, AWS, and data visualization/exploration...
-
Data Science Engineer
hace 6 días
San José, Costa Rica GoTo A tiempo completo**Job Description**: Where you’ll work: Hungary (CEST time zone) Engineering at LastPass We understand technology, security, and the digital world on a deep level. We simplify the complex world of digital passwords and safeguard our users’ digital life. And we get a kick out of it. When you work for a product team at LastPass, you’re redefining (and...
-
Data Engineer
hace 3 semanas
San José, Costa Rica Gracemark A tiempo completo**Data Engineer** **Job Details**: - Workstyle: Hybrid - Location: Heredia, CR. - Permanent Position **What you get to do in this role**: - Bachelors or Masters in Computer Science or related field with 5 - 10 years experience in a technical data organization - Experience in cloud technologies (snowflake/AWS) - Experience with a data warehousing...
-
Data Science Engineer
hace 3 semanas
San José, Costa Rica Cornerstone Building Brands A tiempo completo**Job Description**: The Data Science Engineer plays a key role in our company by taking various data sets and creating dashboards telling an impactful story for business leaders. A person in this role must be able to create data models, work with business on requirements, documentation and UAT testing, create stories using BI dashboards, and iterate work...
-
Field Services Engineer
hace 6 días
San Francisco, Heredia, Costa Rica Ntt Data A tiempo completoNTT DATA Services is looking for a highly motivated Field Services Engineer to join our team in Heredia, Costa Rica.As a Field Services Engineer, you will be responsible for providing technical support to customers on-site, including troubleshooting and repairing hardware and software issues. Your key responsibilities will include:Diagnosing and...
-
Data Engineer
hace 4 semanas
San Francisco, Heredia, Costa Rica Sgf Global A tiempo completo**Data Engineer (Remote)****Heredia, Costa Rica**SGF Global is looking for a Data Engineer, for IT enterprise in Heredia, Costa Rica.**Overview**:The Data Engineer will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment.In this role, you will act as...
-
Big Data Solutions Architect
hace 2 semanas
San Francisco, Heredia, Costa Rica Ntt Data A tiempo completoWe are looking for an experienced Data Engineer to join our team at Ntt Data Services.**Job Summary:**The successful candidate will design, build, and operate high-performance data-centric solutions using big data capabilities in the company's data platform environment.**Key Skills and Qualifications:**Bachelor's degree in a related field or equivalent...
-
Mid Data Engineer
hace 1 semana
San José, San José, Costa Rica Crg Solutions A tiempo completoWe are looking for an experienced Mid Data Engineer to work with product teams to develop pipelines to ingest data into a central data platform.WHAT YOU WILL BE DOING:- Work with local product teams to design optimal solutions to ingest large, complex data sets that meet business requirements.- Work with our central platform team to ensure solutions...
-
Cloud Data Engineer
hace 3 días
San José, San José, Costa Rica Crg Solutions A tiempo completoCrg Solutions is seeking a highly experienced Cloud Data Engineer to join our team. As a Cloud Data Engineer, you will be responsible for designing and developing cloud-based data processing software like databases.Your primary duties will include collaborating with company executives and other professionals to create unique data infrastructure, running...
-
Aws Data Engineer
hace 2 días
San José, San José, Costa Rica Sofka A tiempo completoAWS Data Engineer | Remote | LATAM Are you passionate about building scalable and efficient data pipelines in the cloud?Do you enjoy working in a fully English-speaking, multicultural environment on high-impact projects for international clients?If so, we want you on our teamWe're looking for a skilled AWS Data Engineer with strong experience in Python, SQL,...
-
Operations Data Engineer
hace 4 semanas
San José, Costa Rica LightForce Ortho A tiempo completo**Position** Operations Data Engineer **Location** Costa Rica **About LightForce** **Description** LightForce, the world's only provider of patient specific, 3D printed orthodontic braces is looking for a bright, motivated Operations Data Engineer. As an Operations Data Engineer at LightForce, you will join our growing team of analysts. Our Data Engineering...
-
Operations Data Engineer
hace 1 día
San José, Costa Rica LightForce Ortho A tiempo completo**Position** Operations Data Engineer **Location** Costa Rica **About LightForce** **Description** LightForce, the world's only provider of patient specific, 3D printed orthodontic braces is looking for a bright, motivated Operations Data Engineer. As an Operations Data Engineer at LightForce, you will join our growing team of analysts. Our Data Engineering...
-
Large Language Model Engineer
hace 6 días
San Francisco, Heredia, Costa Rica Ntt Data A tiempo completoWe are looking for a highly skilled Large Language Model Engineer to join our team at Ntt Data. In this role, you will be responsible for developing and implementing large language models to improve consumer experiences.Your key duties will include:Developing and fine-tuning models using OpenAI's ChatGPT API or similar LLMs.Implementing retrieval-augmented...
-
Data Science Engineer
hace 3 semanas
San José, San José, Costa Rica Cornerstone Building Brands A tiempo completoJob Description Job Purpose: The Data Science Engineer (BI Developer) plays a key role in our company by taking various data sets and creating dashboards telling an impactful story for business leaders.A person in this role must be able to create advanced data models, work with business on requirements, complete technical documentation, and testing, create...