Senior Data Infrastructure Engineer

hace 2 semanas

San Francisco, Heredia, Costa Rica IBM A tiempo completo

Introduction

Software Developers at IBM are the backbone of our strategic initiatives to design, code, test, and provide industry-leading solutions that make the world run today - planes and trains take off on time, bank transactions complete in the blink of an eye and the world remains safe because of the work our software developers do.

Whether you are working on projects internally or for a client, software development is critical to the success of IBM and our clients worldwide.

At IBM, you will use the latest software development tools, techniques and approaches and work with leading minds in the industry to build solutions you can be proud of.


Your Role and Responsibilities

We are currently seeking a talented data infrastructure engineer focused on infrastructure powering transformative AI/ML products reaching tens of millions of customers per day, feeding billions of customers worldwide.

The department covers data infrastructure, data pipelines, analysis, and performance optimization.

Responsibilities:

  • Architect and maintain the petabyte scale data lake, warehouse, pipelines, and query layers.
  • Architect, implement, and support multiregion data ingestion system from geographically distributed edge AI systems.
  • Develop and support AI research pipelines, training and evaluation pipelines, audio reencoding and scanning pipelines, and various analysis outputs for business users
  • Use pipelines to manage resilient idempotent coordination with external databases, APIs, and systems
  • Work with AI Speech and Audio engineers to support and codevelop heterogenous pipelines over large flows of conversation AI data to support and accelerate experimentation with new AI models and improvements
CRCW_22

Required Technical and Professional Expertise

  • 5+ Years Professional Python Experience.
  • 2+ Years PubSub Experience (Kafka, Kinesis, SQS, MQTT, etc).
  • 3+ Years working in petabyte scale data platforms.
  • 3+ Years working in AWS.
  • Experience building robust schemabased parsers using standard tooling in Python.
  • Experience developing with Apache Avro, Parquet Schemas, SQLAlchemy (or similar ORMs), and pySpark in Python
  • Fluent in English

Preferred Technical and Professional Expertise

  • Professional experience with conversational AI (chatbots, virtual assistants, etc.)
  • Graduate degree (MA/MS, PhD) in Computer Science, Linguistics, or related field.
  • Professional experience with Linux.
  • Fluent or native proficiency in Spanish

About Business Unit


Are you craving to learn more? Prepared to solve some of the world's most unique challenges? And ready to shape the future for millions of people? If so, then it's time to join us, express your individuality, unleash your curiosity and discover new possibilities.


Every IBMer, and potential ones like yourself, has a voice, carves their own path, and uses their expertise to help co-create and add to our story.

Together, we have the power to make meaningful change - to alter the fabric of our clients, of society and IBM itself, to create a truly positive impact and make the world work better for everyone.

It's time to define your career.

About IBM


Restlessly reinventing since 1911, we are not only one of the largest corporate organizations in the world, we're also one of the biggest technology and consulting employers, with many of the Fortune 50 companies relying on the IBM Cloud to run their business.

At IBM, we pride ourselves on being an early adopter of artificial intelligence, quantum computing and blockchain.

Now it's time for you to join us on our journey to being a responsible technology innovator and a force for good in the world.


Location Statement
IBM is committed to creating a diverse environment and is proud to be an equal opportunity employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.

IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.

  • Infrastructure Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica GFT Technologies SE A tiempo completo

    Infrastructure Engineer: Apr 1, 2023 Location: Heredia, CR, Working place: Remote GFT Technologies SEInfrastructure EngineerJob Description:Responsibilities: Troubleshoot, configure, monitor, and maintain existing infrastructure components while implementing and upgrading the production plant Build projects that will directly impact businesses Build secure...

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    Req ID: 269768We are currently seeking a Data Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).Lead Data Engineer Job DescriptionJOB PURPOSE AND IMPACTThe Lead Data Engineer will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment....

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).••Required skills and...

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).Lead Data Engineer Job DescriptionJOB...

  • Senior Cloud Infrastructure Software Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Moody's A tiempo completo

    Every company has legacy monolith architectures and Moody's is not unique in this. Many engineers have spent countless hours working to keep these systems running well beyond their intended lifespans. Rapidly occurring paradigm shifts in technology are exceedingly difficult to stay in step with and often due to limited bandwidth it can be difficult to...

  • Data Engineer

    hace 4 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).••Required skills and...

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).••Required skills and...

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    Job DescriptionJOB PURPOSE AND IMPACTThe Lead Data Engineer will design, build and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform environment. In this role, you will act as an authority for data access pathways and techniques working with analysts within the functional data...

  • Data Engineer and Business Analyst

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    Req ID: 248594We are currently seeking a Data Engineer and Business Analyst to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).Data Engineer Job DescriptionJOB PURPOSE AND IMPACTThe Data Engineer will design, build, and operate high performance data centric solutions utilizing the comprehensive big data capabilities for the company's data platform...

  • Infrastructure Solution Architect

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    Job DescriptionEach Infrastructure Solutions Architect is part of a diverse and dynamic team who applies seasoned knowledge to deliver designs for complex, multi-tier, and cross platform environments. In this role, the architect is responsible for interpreting non-functional requirements, reaching consensus on the end to end solution, and formalizing the...

  • Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica SGF Global A tiempo completo

    Data Engineer (Hybrid)Heredia, Costa RicaSGF Global is looking for a Data Engineer, for IT enterprise in Heredia, Costa Rica.Requirements: Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline Three or more years of experience with Hadoop, AWS, and data visualization/exploration tools Familiarity...

  • Infrastructure Solution Architect

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Infrastructure Solution Architect to join our team in Heredia, Heredia (CR-H), Costa Rica (CR).Infrastructure Solution...

  • IT Infrastructure Project Manager Junior

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA A tiempo completo

    We are currently seeking a IT Infrastructure Project Manager JR to join our team in Heredia, Costa Rica.- Job Description: Support Infrastructure project multicountry. Working in virtual teams, working remotely or for a remote manager. Support projects endtoend (planning, execution, monitoring and closure) Basic support in project financial management...

  • Senior Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Hangar Worldwide A tiempo completo

    Show the world what you can do.We are looking for a Data Engineer for our team. The Data Engineer facilitates the flow of massive quantities of raw files from various disparate locations into well-harmonized tables. Much is made of the potential to use data to solve the world's problems - the data engineer knows that this "data" is useless unless it can be...

  • Senior Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Encora A tiempo completo

    Our company:Encora is a global Software and Digital Engineering company that helps business overcome the Software Engineering Talent shortage and provides next-gen services and such as Predictive Analysis, Artificial Intelligence & Machine Learning, IoT, Cloud, and Test Automation. We count with 16 global offices and 25 innovation labs.Our Software...

  • Senior Data Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Encora A tiempo completo

    Our company:Encora is a global Software and Digital Engineering company that helps business overcome the Software Engineering Talent shortage and provides next-gen services and such as Predictive Analysis, Artificial Intelligence & Machine Learning, IoT, Cloud, and Test Automation. We count with 16 global offices and 25 innovation labs.Our Software...

  • Senior DevOps/automation Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Experian A tiempo completo

    Company DescriptionExperian is the world's leading global information services company. During life's big moments - from buying a home or a car, to sending a child to college, to growing a business by connecting with new customers - we empower consumers and our clients to manage their data with confidence. We help individuals to take financial control and...

  • Quality Engineer

    hace 2 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Quality Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR). Position overview:The Quality Engineer...

  • Quality Engineer

    hace 4 semanas

    San Francisco, Heredia, Costa Rica NTT DATA Services A tiempo completo

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Quality Engineer to join our team in Heredia, Heredia (CR-H), Costa Rica (CR). Position overview:The Quality Engineer...

  • Wintel Infrastructure Technology Analyst

    hace 2 semanas

    San Francisco, Heredia, Costa Rica Citi A tiempo completo

    The Infrastructure Senior Technology Analyst is an intermediate level role responsible for assisting with LAN / WAN and help desk administration activities, including network maintenance, technical guidance, and security in coordination with the Technology Infrastructure team. The overall objective is to use infrastructure technology knowledge and identified...