Data Engineer

Há 1 mês


Lisboa, Portugal Alter Solutions Group Tempo inteiro

We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and architectures that drive our data-driven decisions. You will work closely with cross-functional teams to ensure data availability, quality, and accessibility for various business needs.
Key Responsibilities Design, implement, and optimize large-scale data pipelines using PySpark.
Manage and maintain data in SQL-based big data columnar databases such as Apache Druid, Google BigQuery, Cassandra, SAP HANA, etc.
Leverage Google Cloud Platform (GCP) services like BigQuery, Firestore, and Pub/Sub to support data infrastructure.
Develop and orchestrate data workflows using Airflow, particularly within the GCP environment (Cloud Composer).
Collaborate with data scientists, analysts, and other stakeholders to ensure the availability and reliability of data.
Optimize and troubleshoot data systems for performance, scalability, and reliability.
Document data processes, architectures, and pipelines for maintenance and scalability.
Qualifications Requirements
PySpark: Strong experience and proficiency in building and optimizing data pipelines.
SQL-based Big Data Columnar Databases: Expertise in working with databases like Apache Druid, Google BigQuery, Cassandra, SAP HANA, etc.
Google Cloud Platform (GCP): Hands-on experience with BigQuery, Firestore, Pub/Sub.
Airflow: Proven experience with Airflow, specifically within GCP (Cloud Composer) for data orchestration.
Communication Skills: Excellent verbal and written communication skills, with the ability to collaborate effectively across teams.
Scala: (Nice to have) Familiarity or experience with Scala programming language.
Firebase: (Nice to have) Experience with Firebase services.
Qualifications
Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Minimum of 5+ years of experience in data engineering or a related field.
Proven track record of working with large-scale data processing and distributed systems.
Strong problem-solving skills and ability to work independently in a fast-paced environment.
Additional Information If you are a passionate Data Engineer with a strong background in big data technologies and are eager to take on new challenges, we would love to hear from you Apply now to join our team and contribute to cutting-edge data solutions.

#J-18808-Ljbffr


  • Data Engineer Senior

    2 meses atrás


    Lisboa, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer SeniorYou will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Data Engineer

    4 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW DAO is dedicated to safeguarding Ethereum users from the risks associated with DeFi. We achieve this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume, and MEV...

  • Data Engineer

    4 semanas atrás


    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ecf Data, Llc. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign and implement data models to support various use casesDevelop and maintain ETL/ELT processesOptimize data processes for improved...

  • Data Engineer

    4 semanas atrás


    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Job Title: Data EngineerAmgen is seeking a highly skilled Data Engineer to join our team in Lisbon, Portugal. As a Data Engineer, you will be responsible for designing, implementing, and maintaining the company's data infrastructure and architecture for Clinical Data Hub.Key Responsibilities:Collaborate with cross-functional teams to plan and deliver...

  • Data Engineer

    3 semanas atrás


    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Clinical Data Hub EngineerEcf Data, Llc is seeking a highly skilled Clinical Data Hub Engineer to join our team. As a Clinical Data Hub Engineer, you will be responsible for managing and optimizing the company's data infrastructure and architecture for Clinical Data Hub.Key Responsibilities:Collaborate with Product Owner, Product Management, Agile Team, and...

  • Data Engineer

    Há 5 dias


    Lisboa, Portugal Grupo Data Tempo inteiro

    Hi!We are DATA Group and we are searching for the best talent!Our goal is to simplify our clients' lives with innovative IT solutions.We operate at global scale and we are expanding to Portugal!If you are passionate and have the desire to make the difference, we want to get to know you!Join us to be part of this incredible adventure!Who are we looking...

  • Data Engineer

    4 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering organization in the Ethereum ecosystem, dedicated to protecting users from the risks associated with DeFi. By supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program, CoW Protocol is making a significant impact on...


  • Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    Job SummaryWe are seeking a highly skilled Senior Data Infrastructure Engineer to join our team at Grupo Data. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data infrastructure, including data warehouses, data lakes, and ETL processes.Key ResponsibilitiesDesign and develop data...

  • Data Engineer

    Há 3 dias


    Lisboa, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer | Azure

    4 semanas atrás


    Lisboa, Portugal Grupo Data Tempo inteiro

    Muito Gosto!Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais...

  • Software Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    As a Software Engineer at our company, you will be responsible for designing and implementing data analysis solutions that drive business growth. Your task will be to analyze complex data sets, identify trends and patterns, and develop actionable insights to inform our product strategy.Key responsibilities include:Designing and developing data analysis tools...

  • Data Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a global IT solutions provider seeking a talented Data Engineer to simplify our clients' lives. Our goal is to develop innovative solutions at scale, expanding our presence in Portugal and beyond.As a key member of our team, you will be responsible for:Uploading data to our Big Data PlatformPreparing data for specific use cases and...

  • Senior Data Engineer

    4 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering force in the Ethereum ecosystem, dedicated to safeguarding users from the risks associated with DeFi. By supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program, we're shaping the future of decentralized...

  • Data Systems Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a global IT solutions provider, aiming to simplify our clients' lives with innovative technologies.We are looking for a highly skilled Data Systems Engineer to join our team in Lisbon, Portugal.The ideal candidate will have a strong background in data engineering, with expertise in Apache Spark, Python, R, Scala, Java, and Kotlin.Key...

  • Data Engineer | Azure

    4 semanas atrás


    Lisboa, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais...

  • Data Engineer

    3 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    Job SummaryData Engineer - Legacy System EnhancementsWe are seeking a skilled Data Engineer to enhance our legacy data solutions by designing, developing, and implementing upgrades. The ideal candidate will have strong SQL skills and experience with ETL tooling such as DBT, SSIS, and Wharescape. Additionally, they should have knowledge of data structures,...

  • Data Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal diconium data Tempo inteiro

    Wir suchen in unserer data-driven Organisation einen erfahrenen Data Engineer, der uns bei der Entwicklung von Datenprodukten in verschiedenen Bereichen unterstützt.Die richtige Person für uns ist ein technischer Spezialist mit Erfahrung in der Datenverarbeitung und -analyse. Sie unterstützt unsere Kunden bei der Implementierung von Data-Pipelines und...

  • Data Engineer

    Há 1 mês


    Lisboa, Portugal Data Privacy Tempo inteiro

    .About CoW Protocol CoW DAO is on a mission to protect Ethereum users from the dangers of DeFi. It does this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, and by funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume and the first-largest...


  • Lisboa, Portugal Data Privacy Tempo inteiro

    .About CoW Protocol CoW DAO is on a mission to protect Ethereum users from the dangers of DeFi. It does this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, and by funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume and the first-largest...

  • Senior Data Engineer

    3 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering force in the Ethereum ecosystem, dedicated to safeguarding users from the risks associated with DeFi. Our mission is to support the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, while also funding values-aligned projects through the CoW Grants Program.Our ProductsCoW Protocol is the...