Big Data Pipeline Architect

2 semanas atrás


Lisboa, Lisboa, Portugal Capgemini Tempo inteiro

About Us
At Capgemini Engineering, we bring together a global team of engineers, scientists, and architects to help innovative companies unleash their potential.
We provide unique R&D and engineering services across all industries, from autonomous cars to life-saving robots. Our digital and software technology experts think outside the box to deliver cutting-edge solutions.

Your Role
We seek a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for developing, maintaining, and optimizing our data pipeline architecture while ensuring the availability and performance of critical data workflows.
You will design, build, and maintain scalable, efficient, and reliable data pipelines to support data processing and analytics;
Implement best practices in Big Data tools and frameworks, ensuring data integrity and performance;
Collaborate with cross-functional teams to integrate new data sources and optimize data pipelines;
Work with complex datasets, ensuring data quality, transformation, and storage in BigQuery;
Troubleshoot data pipeline issues and implement long-term solutions to improve system stability;
Write and optimize complex SQL queries for data extraction and analysis;
Utilize Kafka for real-time data streaming and event-driven architecture;
Implement solutions using Python for data processing and ETL workflows;
Perform code reviews and maintain high-quality code standards.

Your Profile
To succeed in this role, you should have:
Proficiency in BigQuery with 3+ years of experience;
3+ years of experience in Spark for large-scale data processing;
3+ years of experience in SQL for writing and optimizing complex queries;
Advanced proficiency in Python with 4+ years of experience in scripting and automation;
2+ years of experience in Kafka for real-time data streaming;
Effective communication in English, both verbal and written.

What We Offer
Join our multicultural and inclusive team environment;
Enjoy a supportive atmosphere promoting work-life balance;
Engage in exciting national and international projects;
Hybrid work arrangements;
Opportunities for career growth through training and certifications programs;
A referral program with bonuses for talent recommendations;
Great office locations and a competitive salary of $110,000 - $140,000 per year, based on your qualifications and experience.


  • Big Data Architect

    Há 4 dias


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    Join Our Team as a Big Data EngineerWe are Grupo Data, a global IT solutions provider, seeking a talented Data Engineer to simplify our clients' lives with innovative technologies.As a key member of our team, you will be responsible for designing and developing ready-to-use data pipelines, uploading data to the Big Data Platform, and coordinating service...

  • Data Pipelines Architect

    1 semana atrás


    Lisboa, Lisboa, Portugal Prozis Tempo inteiro

    About UsProzis is a dynamic product development company that has been revolutionizing the industry since 2007. Our commitment to innovation and quality has earned us a reputation as a leader in our field.Job SummaryWe are seeking an experienced Data Pipelines Architect to join our Prozis Tech division. As a key member of our team, you will be responsible for...

  • Data Architect

    3 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    Job Title: Data ArchitectAt Grupo Data, we're looking for a skilled Data Architect to join our team. Our goal is to simplify our clients' lives with innovative IT solutions. We operate at a global scale and are expanding to Portugal.We're seeking someone who is passionate about data and has the desire to make a difference. You will be responsible for...

  • Big Data Solutions Architect

    2 semanas atrás


    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    **Job Overview**Vodafone is seeking an experienced Big Data Solutions Architect to support the strategy and deliverables related to Cloud Platform and Data Engineering.The ideal candidate will be a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, providing...

  • Data Pipeline Architect

    3 semanas atrás


    Lisboa, Lisboa, Portugal Sword Tempo inteiro

    About Our Team:Sword is looking for an experienced Data Pipeline Architect to join our team. As a key member of our team, you will be responsible for designing, building, and maintaining our complex data warehouse.Your Responsibilities:Design and implement ETL/ELT data pipelines that ingest data from multiple sources, including MySQL, BigQuery, Cloud...

  • Big Data Innovator

    Há 3 dias


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    Join Grupo Data as a Bigdata EngineerWe are seeking a highly skilled Bigdata Engineer to simplify our clients' lives with innovative IT solutions.We operate at a global scale and are expanding to Portugal, offering an exciting opportunity for the right candidate to make a meaningful impact.Data Analysis and Preparation: Design and implement data processing...


  • Lisboa, Lisboa, Portugal Askblue Tempo inteiro

    We are a technology company that has been providing services since 2013.As we continue to grow, we need a skilled professional to join our team in Porto or Lisbon as a Data Pipeline Architect.Main Responsibilities:Main ResponsibilitiesDevelop and design efficient data pipelines and ETL processes using Python.Automate industrial processes to enhance...

  • Big Data Solutions Architect

    2 semanas atrás


    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Big Data Engineer RoleSummaryIn this role, you will play a key part in the Digital Engineering team at Vodafone by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. As a core member of the agile teams delivering data pipelines and capabilities, you will be responsible for building and automating data flows and providing...

  • Big Data Solutions Architect

    4 semanas atrás


    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job OverviewThe Big Data Engineer plays a key role in Digital Engineering team by driving strategy and deliverables related to Cloud Platform and Data Engineering. The role involves designing, developing, and integrating ETL/ELT data pipelines for various sources, as well as building applications that utilize large volumes of data to generate incremental...

  • Big Data Solutions Architect

    3 semanas atrás


    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    About this roleThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. This role is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides specialist...


  • Lisboa, Lisboa, Portugal Passio Consulting Tempo inteiro

    At Passio Consulting, we are looking for a skilled Big Data Solutions Architect to join our team.We are seeking an experienced professional with expertise in data modeling, data ingestion and processing to work closely with clients, understand their needs, and offer the best solution following best practices.The ideal candidate will have experience in...

  • Data Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a company dedicated to simplifying our clients' lives with innovative IT solutions. Our goal is to operate at a global scale and expand our presence in Portugal.If you're passionate about making a difference, we'd like to get to know you better. Our team is looking for talented professionals who can help us achieve our objectives.The job...

  • Data Engineer

    3 semanas atrás


    Lisboa, Lisboa, Portugal Capgemini Tempo inteiro

    Career Opportunity: We are seeking a skilled Data Engineer to join our team and develop, maintain, and optimize our data pipeline architecture.About the Role:As a Data Engineer, you will be responsible for designing, building, and maintaining scalable, efficient, and reliable data pipelines to support data processing and analytics. You will implement best...

  • Senior Big Data Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    At Grupo Data, we are seeking an experienced Senior Big Data Engineer to join our team in Lisbon, Portugal. This role is a fantastic opportunity for individuals who are passionate about data and want to make a real impact.About the Role:We are looking for a skilled engineer to design, develop, and maintain large-scale big data pipelines using technologies...

  • Data Pipeline Architect

    2 semanas atrás


    Lisboa, Lisboa, Portugal Bonapolia Tempo inteiro

    About BonapoliaWe are a leading gateway for exciting career opportunities and a fulfilling work environment.Our mission is to transform lives through the right job, and we're committed to making that happen for you.Job DescriptionWe're seeking an experienced Data Engineer to lead efforts in designing, implementing, and maintaining robust data pipelines and...

  • Senior Data Engineer

    2 semanas atrás


    Lisboa, Lisboa, Portugal ALTER SOLUTIONS Tempo inteiro

    Job Title: Senior Data Engineer - Data ArchitectWe are seeking an experienced Senior Data Engineer - Data Architect to design, build, and maintain robust data pipelines and architectures that drive our data-driven decisions. As a key member of our team, you will work closely with cross-functional teams to ensure data availability, quality, and accessibility...

  • Data Solutions Architect

    4 semanas atrás


    Lisboa, Lisboa, Portugal Data Privacy Tempo inteiro

    Data Solutions ArchitectTeya is a software solutions provider for small and growing businesses in Europe. As a Data Solutions Architect, you will be responsible for enhancing legacy data solutions by designing, developing, and implementing upgrades. Your key responsibilities will include maintaining and improving ETL flows, ensuring data reliability, and...

  • Big Data Engineer

    Há 1 mês


    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job SummaryThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Cloud Data Architect

    4 semanas atrás


    Lisboa, Lisboa, Portugal Phiture Tempo inteiro

    About HakkodaWe are a modern data consultancy empowering data-driven organizations to unlock the full value of the Snowflake Data Cloud. Our team provides consulting and managed services in data architecture, data engineering, analytics, and data science.What We're Looking ForWe are seeking a talented Cloud Data Architect to join our growing team of experts....

  • Data Solutions Architect

    1 semana atrás


    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a global IT solutions provider. Our mission is to simplify our clients' lives with innovative technology.Our team in Lisbon is expanding, and we're looking for a talented Data Engineer. If you have a passion for data processing and innovative solutions, we want to get to know you.The ideal candidate will have:Proficiency in programming...