Data Engineer

Há 1 mês

Lisboa, Portugal Capgemini Tempo inteiro

Mid-Senior Data Engineer (Lisbon) At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same. 
YOUR ROLE We are looking for a Data Engineer with experience in data ingestion, processing, and management in cloud environments, especially within the Azure ecosystem. The ideal candidate should be proactive and able to work in agile teams using methodologies like Scrum.
Responsibilities:
• Develop and manage data pipelines with Azure Data Factory (ADF).
• Process, transform, and optimize data using Databricks.
• Collaborate with Product Owners and Tech Leaders to define and implement data solutions in agile sprints.
• Store and organize data in Azure Storage Accounts.
• Automate workflows and processes to optimize data ingestion and processing.
• Document processes and implement best practices throughout the data pipeline.
Skills:
• Ingest data using tools such as Informatica PowerCenter (PWC).
YOUR PROFILE Mandatory:
• Knowledge in Azure Data Factory (ADF) for orchestration and automation of data pipelines.
---> Proven experience in pipeline construction;
• Practice in Databricks with Python and SQL for processing and analyzing large volumes of data.
---> Proven experience in ETL development and generation of partitioned parquet files;
• Experience in working with SQL and selects in various formats.
---> Proven experience in developing more complex select's;
•Experience working with Resource Groups, Azure Storage Accounts, Containers, storing and reading files and database and data organization.
• Knowledge in data formats such as Parquet and experience in data transfer with SFTP.
• Ability to work in agile teams using methodologies such as Scrum.
•Experience working with Azure DevOps.
Nice to Have:
• Ingest data from SAP R/3 systems via IDocs.
• Knowledge of different data integration and automation tools.
• Experience in data security practices and data management in cloud environments.
• Experience with Informatica PowerCenter (PWC) for data integration and processing; though "nice to have," it will be essential for development.
• Familiarity with other storage and processing technologies in Azure environments.
• Experience with Jira, Confluence, WinSCP or FileZilla, Control-M.
Additional Skills:
• Clear communication and collaboration with cross-functional teams.
• Proactive in documenting and improving data workflows.
• Teamwork, commitment, and dedication.
• Bachelor in Informatic sciences
• English level B2
WHAT YOU'LL LOVE ABOUT WORKING HERE Join a multicultural and inclusive team environment. Enjoy a supportive atmosphere promoting work-life balance. Engage in exciting national and international projects. Hybrid work. Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities. Training and certifications programs. Health and life insurance. Referral program with bonuses for talent recommendations. Great office locations. ABOUT CAPGEMINI Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Apply now

  • Data Engineer Senior

    2 meses atrás

    Lisboa, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer SeniorYou will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW DAO is dedicated to safeguarding Ethereum users from the risks associated with DeFi. We achieve this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume, and MEV...

  • Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ecf Data, Llc. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign and implement data models to support various use casesDevelop and maintain ETL/ELT processesOptimize data processes for improved...

  • Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Job Title: Data EngineerAmgen is seeking a highly skilled Data Engineer to join our team in Lisbon, Portugal. As a Data Engineer, you will be responsible for designing, implementing, and maintaining the company's data infrastructure and architecture for Clinical Data Hub.Key Responsibilities:Collaborate with cross-functional teams to plan and deliver...

  • Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Clinical Data Hub EngineerEcf Data, Llc is seeking a highly skilled Clinical Data Hub Engineer to join our team. As a Clinical Data Hub Engineer, you will be responsible for managing and optimizing the company's data infrastructure and architecture for Clinical Data Hub.Key Responsibilities:Collaborate with Product Owner, Product Management, Agile Team, and...

  • Data Engineer

    Há 6 dias

    Lisboa, Portugal Grupo Data Tempo inteiro

    Hi!We are DATA Group and we are searching for the best talent!Our goal is to simplify our clients' lives with innovative IT solutions.We operate at global scale and we are expanding to Portugal!If you are passionate and have the desire to make the difference, we want to get to know you!Join us to be part of this incredible adventure!Who are we looking...

  • Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering organization in the Ethereum ecosystem, dedicated to protecting users from the risks associated with DeFi. By supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program, CoW Protocol is making a significant impact on...

  • Senior Data Infrastructure Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    Job SummaryWe are seeking a highly skilled Senior Data Infrastructure Engineer to join our team at Grupo Data. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our data infrastructure, including data warehouses, data lakes, and ETL processes.Key ResponsibilitiesDesign and develop data...

  • Data Engineer

    Há 3 dias

    Lisboa, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer | Azure

    Há 1 mês

    Lisboa, Portugal Grupo Data Tempo inteiro

    Muito Gosto!Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais...

  • Software Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    As a Software Engineer at our company, you will be responsible for designing and implementing data analysis solutions that drive business growth. Your task will be to analyze complex data sets, identify trends and patterns, and develop actionable insights to inform our product strategy.Key responsibilities include:Designing and developing data analysis tools...

  • Data Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a global IT solutions provider seeking a talented Data Engineer to simplify our clients' lives. Our goal is to develop innovative solutions at scale, expanding our presence in Portugal and beyond.As a key member of our team, you will be responsible for:Uploading data to our Big Data PlatformPreparing data for specific use cases and...

  • Senior Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering force in the Ethereum ecosystem, dedicated to safeguarding users from the risks associated with DeFi. By supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, as well as funding values-aligned projects through the CoW Grants Program, we're shaping the future of decentralized...

  • Data Systems Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a global IT solutions provider, aiming to simplify our clients' lives with innovative technologies.We are looking for a highly skilled Data Systems Engineer to join our team in Lisbon, Portugal.The ideal candidate will have a strong background in data engineering, with expertise in Apache Spark, Python, R, Scala, Java, and Kotlin.Key...

  • Data Engineer | Azure

    4 semanas atrás

    Lisboa, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais...

  • Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    Job SummaryData Engineer - Legacy System EnhancementsWe are seeking a skilled Data Engineer to enhance our legacy data solutions by designing, developing, and implementing upgrades. The ideal candidate will have strong SQL skills and experience with ETL tooling such as DBT, SSIS, and Wharescape. Additionally, they should have knowledge of data structures,...

  • Data Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal diconium data Tempo inteiro

    Wir suchen in unserer data-driven Organisation einen erfahrenen Data Engineer, der uns bei der Entwicklung von Datenprodukten in verschiedenen Bereichen unterstützt.Die richtige Person für uns ist ein technischer Spezialist mit Erfahrung in der Datenverarbeitung und -analyse. Sie unterstützt unsere Kunden bei der Implementierung von Data-Pipelines und...

  • Data Engineer

    Há 1 mês

    Lisboa, Portugal Data Privacy Tempo inteiro

    .About CoW Protocol CoW DAO is on a mission to protect Ethereum users from the dangers of DeFi. It does this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, and by funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume and the first-largest...

  • Senior Data Engineer

    2 meses atrás

    Lisboa, Portugal Data Privacy Tempo inteiro

    .About CoW Protocol CoW DAO is on a mission to protect Ethereum users from the dangers of DeFi. It does this by supporting the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, and by funding values-aligned projects through the CoW Grants Program. CoW Protocol is the second-largest DEX aggregator by monthly volume and the first-largest...

  • Senior Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    About CoW ProtocolCoW Protocol is a pioneering force in the Ethereum ecosystem, dedicated to safeguarding users from the risks associated with DeFi. Our mission is to support the development of CoW Protocol, CoW Swap, MEV Blocker, and CoW AMM, while also funding values-aligned projects through the CoW Grants Program.Our ProductsCoW Protocol is the...