Big Data Engineer

Há 22 horas

Lisboa, Portugal Vodafone Tempo inteiro

.The Big Data Engineer plays a key role in the Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data Engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides specialised guidance and delivers through self and others to:Design, develop, and integrate ETL/ELT data pipelines for the necessary data from several sources for analysis and for Technology actions; Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value; Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines, and support) to speed up delivery in the Big Data Programme, assuring quality, performance, and alignment to the technology blueprint and patterns; Support stakeholders andfunctions in obtaining business value from the operational data; Design and produce high-performing stable end-to-end data applications to perform cost-efficient and complex processing of batch and streaming massive volumes of data in a multi-tenancy big data platform in the cloud; Ingest and automate the necessary data from local and group sources onto the GCP platform; Accountable for ensuringthe delivery of solution & use case enablement, GCP project & resource enablement, data source ingestion for Networks sources, application production rollouts, and code/execution optimisation for big data solutions; Work with key stakeholders such as the Group Big Data/Neuron team, ADS, ACoE, local market IT, and Big Data teams to define the strategy for evolving the Big Data capability, including solution architectural decisions aligned with the platform architecture; Investigate and drive new technologies adoption to identify where they can bring benefits; Ensure common data architecture, structure and definition, data cleaning, and data integrity; Support data security & privacy, and thorough documentation processes.Who you areDegree in Computer Science or related field3 years of hands-on Big Data Engineering experience, ideally over a Cloud computing environment3 years of experience in working with Big Data technologies such as Hadoop, Spark, Hive/Impala, HBase, etc.Google Cloud Professional certificationProven hands-on experience with Cloud computing, preferably Google Cloud Platform (particular focus on GCS, Big Query, & various GCP database solutions such as Composer, Dataflow, Data Fusion, Cloud Functions, Pub/Sub, Dataproc, Data Catalogue, Kubernetes Engine, Cloud Build, Cloud Run) is mandatoryKnowledge of other cloud providers such as AWS or Azure is desirableHands-on expertise with Apache Nifi, Apache Kafka, CDAP, Apache Airflow is mandatoryHands-on expertise developing and optimising Apache Spark. Skilled in Python development, SQL, and bash scripting mandatory

  • Big Data Engineer

    2 meses atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering.The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    Há 1 mês

    Lisboa, Portugal Vodafone Tempo inteiro

    What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    2 meses atrás

    Lisboa, Portugal Sportserve Tempo inteiro

    Sportserve forms part of a remarkable group of B2C sports betting and B2B sportsbook technology companies, focused on delivering first class sports betting experiences and casino products for our users worldwide.Along with Sportion, TechSpirit, Standard Focus and Sportelligent, we are the driving force behind the world renowned sports betting company and our...

  • Data Engineer Senior

    2 semanas atrás

    Lisboa, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer SeniorYou will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Data Engineer Senior

    2 semanas atrás

    Lisboa, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer Senior You will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Data Engineer Senior

    3 semanas atrás

    Lisboa, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer Senior  you will be responsible for designing, developing, and maintaining our data infrastructure.You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure.You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Senior Big Data Developer

    4 semanas atrás

    Lisboa, Portugal Symphonyai Tempo inteiro

    Introduction JOIN US!We are seeking a skilled Senior Big Data Developer to join our London team and play an integral role in shaping the data infrastructure required for actionable investment insights and high-performance trading decisions.Job Description The Senior Big Data Developer will be responsible for crafting, deploying, and maintaining the data...

  • Data Engineer

    Há 1 mês

    Lisboa, Portugal Landing.Jobs Tempo inteiro

    At Company on Technology industry (Contractor), in Oeiras, Portugal Expires at: 2024-08-23 Remote policy: Partial remote Data Engineer We are seeking a skilled a Data Engineer to join our dynamic team.The ideal candidate will have a strong background in cloud computing, with specific expertise in Azure, Microsoft Fabric, and Spark.You will be responsible for...

  • Data Engineer

    Há 1 mês

    Lisboa, Portugal Company On Technology Industry Tempo inteiro

    At Company on Technology industry (Contractor), in Oeiras, Portugal Expires at: ******** Remote policy: Partial remote Data Engineer We are seeking a skilled a Data Engineer to join our dynamic team. The ideal candidate will have a strong background in cloud computing, with specific expertise in Azure, Microsoft Fabric, and Spark. You will be responsible...

  • Data Engineer

    Há 1 mês

    Lisboa, Portugal Noesis Portugal Tempo inteiro

    Noesis is looking for professionals with the following profile: Bachelor's degree or higher in Information Technology or Computer Engineering or related field; Minimum 4 years of experience as a Data Engineer; Previous experience working with Python (developing data-related Python frameworks is a plus); Knowledge in Big Data technology such as PySpark,...

  • Google Cloud Data Engineer

    2 meses atrás

    Lisboa, Portugal DRAM Consultoria Tempo inteiro

    Para reforçar nossos quadros, estamos a contratar Analista Google Cloud Data Engineer (junior/sénior) Requisitos: Google Cloud experience in Data Engineering Big query Cloud Workflows Cloud Storage Cloud Functions – Dataform – Data Catalog – DataPlex – IAM – Vertix AI – Looker Core Experiência em building DataProducts Projectos de longa...

  • Data Engineer

    4 semanas atrás

    Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Dellent is a consulting company focused in System Information and Telecommunications. Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations.In this project you will be able to contact with one of the key players in banking in the EU and around the world. Thus, you...

  • Data Engineer

    4 semanas atrás

    Lisboa, Portugal Ecf Data, Llc Tempo inteiro

    Dellent is a consulting company focused in System Information and Telecommunications. Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations.In this project you will be able to contact with one of the key players in banking in the EU and around the world. Thus, you...

  • Data Engineer

    2 semanas atrás

    Lisboa, Portugal Growin Tempo inteiro

    Data Engineer Lisboa or Porto, Portugal Department: Business & Analytics Type: Full Time WE DEVELOP PEOPLE WHO DEVELOP TECHNOLOGY And we want to develop you! At Growin, people always come first. Why? Because we believe happy, talented people are the ones who can change the world: one code line at a time. We have several projects waiting for you all over...

  • Data Engineer

    4 semanas atrás

    Lisboa, Portugal Truphone Tempo inteiro

    .1GLOBAL creates better connections between people, businesses and things. Since 2006, we have built state-of-the-art SIM software, intuitive management platforms, in-network call recording and a powerful global mobile network.We are looking for a talented Data Engineer to join our DevOps team.This role and the team will be located in Lisbon (hybrid &...

  • Senior Data Engineer

    3 semanas atrás

    Lisboa, Portugal Noesis Portugal Tempo inteiro

    A Noesis procura candidatos com o seguinte perfil:Tarefas:Desenvolver e manter pipelines de dados robustos e eficientes usando Apache NiFi.Projetar e implementar soluções de integração de dados para integrar, transformar e distribuir dados.Otimizar e monitorar fluxos de dados para garantir alta disponibilidade e performance.Implementar práticas de...

  • Data Engineer

    4 semanas atrás

    Lisboa, Portugal Truphone Tempo inteiro

    1GLOBAL creates better connections between people, businesses and things. Since 2006, we have built state-of-the-art SIM software, intuitive management platforms, in-network call recording and a powerful global mobile network.We are looking for a talented Data Engineer to join our DevOps team.This role and the team will be located in Lisbon (hybrid &...

  • Data Engineer

    3 meses atrás

    Lisboa, Portugal Truphone Tempo inteiro

    .1GLOBAL creates better connections between people, businesses and things. Since 2006, we have built state-of-the-art SIM software, intuitive management platforms, in-network call recording and a powerful global mobile network.We are looking for a talented Data Engineer to join our DevOps team. This role and the team will be located in Lisbon (hybrid &...

  • Data Engineer

    Há 1 mês

    Lisboa, Portugal Flix Se Tempo inteiro

    .The Commercial Intelligence Team within the Revenue Management & Commercial Excellence department (RMCE) is looking for a motivated and driven Data Engineer who will help us shape our team, drive the company to the next level, and have the most direct influence on our success. Who We Are The Revenue Management & Commercial Excellence (RMCE) department...

  • Data Engineer

    2 semanas atrás

    Lisboa, Portugal Flix Se Tempo inteiro

    .The Commercial Intelligence Team within the Revenue Management & Commercial Excellence department (RMCE) is looking for a motivated and driven Data Engineer (m/f/d) who will help us shape our team, drive the company to the next level, and have the most direct influence on our success.Who We AreThe Revenue Management & Commercial Excellence (RMCE) department...