Big Data Engineer

4 meses atrás

Lisboa, Portugal Vodafone Tempo inteiro

What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering.
The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides specialised guidance and delivers through self and others to:Design, Develop and Integrate ETL/ELT data pipelines for the necessary data from several sources for analysis and for Technology actions;Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value;Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up delivery in the Big Data Programme, assuring quality, performance and alignment to the technology blueprint and patterns;Support stakeholders and functions in obtaining benefiting business value from the operational data;Designing and producing high performing stable end-to-end data applications to perform cost efficient and complex processing of batch and streaming massive volumes of data in a multi-tenancy big data platform in the cloud;Ingest and automation the necessary data from local and group sources onto GCP platform;Accountable to ensure delivery of solution & use case enablement, GCP project & resource enablement, data source ingestion for Networks sources, application production rollouts and code/execution optimisation for big data solutions;Working with key stakeholders such as the Group Big Data/Neuron team, ADS, ACoE, local market IT and Big Data teams to define the strategy for evolving the Big Data capability, including solution architectural decisions aligned with the platform architecture;Investigating and driving new technologies adoption to identify where they can bring benefits;Ensuring common data architecture, structure and definition, data cleanings and data integrity;Support data security & privacy, and thorough documentation processes.Who you areDegree in Computer Science or related field3 years of hands on Big Data Engineering experience, ideally over a Cloud computing environment3 years of experience in working with Big Data technologies such as Hadoop, Spark, Hive/Impala, HBase, etc.Google Cloud Professional certificationProven hands experience on Cloud computing, preferable Google Cloud Platform (particular focus on GCS, Big Query, & various GCP database solutions Composer, Dataflow, Data Fusion, Cloud Functions, Pub/Sub, Dataproc, Data Catalogue, Kubernetes Engine, Cloud Build, Cloud Run) is mandatoryKnowledge of other cloud providers such as AWS or Azure is desirableHands on expertise on Apache Nifi, Apache Kafka, CDAP, Apache Airflow is mandatoryHands on expertise developing and optimising Apache Spark.
Skilled python development background, SQL and bash scripting mandatory.
Additional development languages desired, Scala, JavaHands on experience in implementing large-scale batch and streaming based Big Data solutionsDeep understanding of big data eco systems and tools like Hadoop, Spark, Airflow, NiFi, Kafka, various data formats, etcBackground in telecommunication networks and its related data sources, its strengths, weaknesses, semantics, and formats is desirablePortuguese/English language proficiency.

  • Data Engineer

    Há 17 horas

    Lisboa, Lisboa, Portugal Grupo Data Tempo inteiro

    We are Grupo Data, a company dedicated to simplifying our clients' lives with innovative IT solutions. Our goal is to operate at a global scale and expand our presence in Portugal.If you're passionate about making a difference, we'd like to get to know you better. Our team is looking for talented professionals who can help us achieve our objectives.The job...

  • Big Data Engineer

    4 semanas atrás

    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job Title: Big Data EngineerAbout the RoleThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering.The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    2 meses atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    .The Big Data Engineer plays a key role in the Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data Engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    2 meses atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    .The Big Data Engineer plays a key role in the Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data Engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job SummaryThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job Title: Big Data EngineerThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering.Key Responsibilities:Design, develop, and integrate ETL/ELT data pipelines for analysis and technology actions.Build applications and products that utilize large...

  • Big Data Engineer

    2 semanas atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    2 meses atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    The Big Data Engineer plays a key role in the Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data Engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    3 meses atrás

    Lisboa, Portugal Vodafone Tempo inteiro

    What you'll doThe Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides...

  • Big Data Engineer

    2 semanas atrás

    Lisboa, Portugal Movilges Tempo inteiro

    We are recruiting a Big Data Engineer (m/f) to strengthen our team, with the possibility of working remotely.What we are looking for:Bachelor's degree in Engineering, Information Technology, Computer Science, or a related field;At least 3 years of relevant experience;Strong knowledge of and experience with statistics;Programming experience (Python, Kafka, or...

  • Big Data Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Movilges Intersoft Tempo inteiro

    We are seeking a highly skilled Big Data Engineer to join our team at Movilges Intersoft. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and implement data pipelines using Hadoop and SparkDevelop and maintain large-scale data processing...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Movilges Tempo inteiro

    We are seeking a highly skilled Big Data Engineer to strengthen our team, with the possibility of working remotely. This role is ideal for a professional with a strong background in data engineering and a passion for innovative technologies.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using Hadoop, Spark, and other...

  • Big Data Engineer

    7 meses atrás

    Lisboa, Portugal Landskill Tempo inteiro

    We are Landskill and we are looking for new members to join our team. If you're reading this, you already know you want to change your professional life and you have landed in the right place.  What are we looking for? People who love technology and, above all, love to learn. And we get it - keeping our team motivated and happy is the key to staying...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Job SummaryWe are seeking a highly skilled Cloud Data Specialist to join our team at Vodafone. As a key member of our Digital Engineering team, you will play a crucial role in supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering.Key Responsibilities:Design, develop, and integrate ETL/ELT data pipelines for analysis...

  • Big Data Engineer

    3 semanas atrás

    Lisboa, Portugal Movilges Tempo inteiro

    We are recruiting a Big Data Engineer (m/f)  to strengthen our team, with the possibility of working remotely.What we are looking for: Bachelors degree in Engineering, Information Technology, Computer Science, or a related field; At least 3 years of relevant experience; Strong knowledge of and experience with statistics; Programming experience (Python,...

  • Big Data Engineer

    2 semanas atrás

    Lisboa, Portugal Movilges Intersoft Tempo inteiro

    We are recruiting a Big Data Engineer (m/f) to strengthen our team, with the possibility of working remotely.What we are looking for:Bachelors degree in Engineering, Information Technology, Computer Science, or a related field;At least 3 years of relevant experience;Strong knowledge of and experience with statistics;Programming experience (Python, Kafka, or...

  • Big Data Solutions Architect

    Há 17 horas

    Lisboa, Lisboa, Portugal Vodafone Tempo inteiro

    Big Data Engineer RoleSummaryIn this role, you will play a key part in the Digital Engineering team at Vodafone by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. As a core member of the agile teams delivering data pipelines and capabilities, you will be responsible for building and automating data flows and providing...

  • Big Data Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Movilges Tempo inteiro

    We are seeking a highly skilled Big Data Engineer to strengthen our team at Movilges. The ideal candidate will have a strong background in engineering, information technology, or computer science, with at least 3 years of relevant experience.Key Responsibilities:Design and develop scalable data processing systems using Hadoop, MapReduce, and HDFS.Implement...

  • Data Engineer

    Há 2 dias

    Lisboa, Portugal Grupo Data Tempo inteiro

    Hi!We are DATA Group and we are searching for the best talent!Our goal is to simplify our clients' lives with innovative IT solutions.We operate at global scale and we are expanding to Portugal!If you are passionate and have the desire to make the difference, we want to get to know you!Join us to be part of this incredible adventure!Who are we looking...