Big Data Engineer
4 meses atrás
What you’ll do
The Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and provides specialised guidance and delivers through self and others to:
Design, Develop and Integrate ETL/ELT data pipelines for the necessary data from several sources for analysis and for Technology actions; Build applications and products that make use of large volumes of data and generate outputs that allow actions that generate incremental value; Deliver and implement core capabilities (frameworks, platform, development infrastructure, documentation, guidelines and support) to speed up delivery in the Big Data Programme, assuring quality, performance and alignment to the technology blueprint and patterns; Support stakeholders and functions in obtaining benefiting business value from the operational data; Designing and producing high performing stable end-to-end data applications to perform cost efficient and complex processing of batch and streaming massive volumes of data in a multi-tenancy big data platform in the cloud; Ingest and automation the necessary data from local and group sources onto GCP platform; Accountable to ensure delivery of solution & use case enablement, GCP project & resource enablement, data source ingestion for Networks sources, application production rollouts and code/execution optimisation for big data solutions; Working with key stakeholders such as the Group Big Data/Neuron team, ADS, ACoE, local market IT and Big Data teams to define the strategy for evolving the Big Data capability, including solution architectural decisions aligned with the platform architecture; Investigating and driving new technologies adoption to identify where they can bring benefits; Ensuring common data architecture, structure and definition, data cleanings and data integrity; Support data security & privacy, and thorough documentation processes.
Who you are
Degree in Computer Science or related field 3 years of hands on Big Data Engineering experience, ideally over a Cloud computing environment. 3 years of experience in working with Big Data technologies such as Hadoop, Spark, Hive/Impala, HBase, etc. Google Cloud Professional certification Proven hands experience on Cloud computing, preferable Google Cloud Platform (particular focus on GCS, Big Query, & various GCP database solutions Composer, Dataflow, Data Fusion, Cloud Functions, Pub/Sub, Dataproc, Data Catalogue, Kubernetes Engine, Cloud Build, Cloud Run) is mandatory. Knowledge of other cloud providers such as AWS or Azure is desirable. Hands on expertise on Apache Nifi, Apache Kafka, CDAP, Apache Airflow is mandatory. Hands on expertise developing and optimising Apache Spark. Skilled python development background, SQL and bash scripting mandatory. Additional development languages desired, Scala, Java. Hands on experience in implementing large-scale batch and streaming based Big Data solutions. Deep understanding of big data eco systems and tools like Hadoop, Spark, Airflow, NiFi, Kafka, various data formats, etc. Background in telecommunication networks and its related data sources, its strengths, weaknesses, semantics, and formats is desirable. Portuguese/English language proficiency.-
Big Data Engineer
3 semanas atrás
Lisbon, Portugal Movilges Tempo inteiroWe are recruiting a Big Data Engineer (m/f) to strengthen our team, with the possibility of working remotely. What we are looking for:Bachelors degree in Engineering, Information Technology, Computer Science, or a related field;At least 3 years of relevant experience;Strong knowledge of and experience with statistics;Programming experience (Python, Kafka,...
-
Data Engineer
1 dia atrás
Lisbon, Portugal Grupo Data Tempo inteiroHi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...
-
Data Engineer Senior
2 meses atrás
Lisbon, Portugal Grupo Data Tempo inteiroPosition: Data Engineer Senior you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...
-
Data Engineer
Há 7 dias
Lisbon, Portugal Grupo Data Tempo inteiroHi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...
-
Data Engineer | Azure
4 semanas atrás
Lisbon, Portugal Grupo Data Tempo inteiroMuito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....
-
Data Engineer
Há 1 mês
Lisbon, Portugal ComplyAdvantage Tempo inteiroWhat you will be doing : We are looking for talented Data Engineers to help us build our internal Platform solutions as well as provide insights to our customers. By giving our customers actionable insights, we enable them to be agile with their compliance operations, iterating on how they tune their search and transaction monitoring parameters. You will...
-
Data Engineer
3 meses atrás
Lisbon, Portugal ALTER SOLUTIONS Tempo inteiroJob Description We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this role, you will be responsible for designing, building, and maintaining robust data pipelines and architectures that drive our data-driven decisions. You will work closely with cross-functional teams to ensure data availability,...
-
Software & Data Engineer
3 meses atrás
Lisbon, Portugal LOAD Tempo inteiroWe are seeking a professional passionate about innovation and excellence. We value transparency, team spirit, and commitment. If you enjoy working in a dynamic and cheerful environment, this could be the perfect opportunity for you!!The role aims to: Optimize data storage solutions for easy access and retrieval Ensure data accuracy and reliability through...
-
Data Engineer
1 semana atrás
Lisbon, Portugal NTT DATA Tempo inteiroJob Description We are a multinational Business and Technology consultancy that reinvents and transforms organizations through innovation and have been ranked by Gartner as one of the top 10 IT services companies in the world. At NTTDATA we are Digital Lovers. We love technology, work with passion, with enthusiasm, in a creative and collaborative...
-
Big Data Developer
2 semanas atrás
Lisbon, Portugal Talan Tempo inteiroJob DescriptionWhat you will be doing?As a Backend Spark Developer, you'll play a key role in bringing technical and functional visions to life. You'll work closely with Solution Designers, Business Architects, and Business Analysts to develop, test, and deploy high-quality solutions that meet and exceed internal standards. Your work will be essential in...
-
Data Engineer
5 meses atrás
Lisbon, Portugal SOWIN Tempo inteiroData Engineer Remoto A nossa paixão coloca-nos no lugar certo. A CodeWin nasceu da fusão de duas empresas líderes no setor tecnológico: De code e So win . Unimos a nossa paixão, os nossos talentos, conhecimentos e experiências para levar até às nossas pessoas e parceiros as melhores soluções em transformação digital e consultoria. A...
-
GCP Data Engineer
1 semana atrás
Lisbon, Portugal NTT DATA Tempo inteiroJob Description Somos uma consultora multinacional de Negócios e Tecnologia que reinventa e transforma as organizações através da inovação e fomos considerados pela Gartner como uma das 10 maiores empresas de serviços de TI do mundo. Na NTTDATA somos Digital Lovers.Amamos a tecnologia, trabalhamos com paixão, com entusiasmo, num ambiente criativo e...
-
Senior Data Engineer
2 meses atrás
Lisbon, Portugal ALTER SOLUTIONS Tempo inteiroDescrição da empresa A Alter Solutions Portugal é uma empresa de Consultoria em Tecnologia da Informação, catalisadora da Transformação Digital, integrante do grupo Alter Solutions criado em 2006, em Paris. Em 2022, a Alter Solutions integrou o grupo act digital, constituindo uma comunidade global de talento em Tecnologia, com presença em doze...
-
Data Analyst/ Data Engineer
5 meses atrás
Lisbon, Portugal Equação IT Tempo inteiroData Analyst/ Data Engineer Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners. We are looking for a Data Analyst/ Data Engineer with the following...
-
Data Engineer
5 meses atrás
Lisbon, Portugal Equação IT Tempo inteiroData Engineer Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners. We are looking for a Data Engineer with the following requirements: Requirements: •...
-
Junior Data Engineer
3 meses atrás
Lisbon, Portugal Capgemini Tempo inteiroJunior Data EngineerAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide...
-
Data Driven | Data Engineer
2 meses atrás
Lisbon, Portugal Devoteam Portugal Tempo inteiroJob DescriptionWe are looking for a Data Engineer with experience in Python and ETL processes to deliver high quality data tools and support the business, with the following main responsibilities:Develop and design data pipelines/ETL in Python.Industrialize processes for full automation Assess client needs, understand the business and deliver a proper...
-
Data Driven | Data Engineer
4 semanas atrás
Lisbon, Portugal Devoteam Portugal Tempo inteiroJob DescriptionWe are looking for a Data Engineer with experience in Python and ETL processes to deliver high quality data tools and support the business.Key Responsibilities:Develop and design data pipelines/ETL in Python.Industrialize processes for full automation Assess client needs, understand the business and deliver a proper solution Build and design...
-
Data Engineer_L3
3 semanas atrás
Lisbon, Portugal Grupo Data Tempo inteiroHi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...
-
Senior Data Engineer
4 meses atrás
Lisbon, Portugal Pestana Group Tempo inteiroJob Title: Senior Data Engineer- Business Intelligence Location: Lisbon, Portugal About Us Pestana Hotel Group is the largest multinational hotel group of Portuguese origin. With over 100 hotels and present in 16 countries. The BI team mission is to provide data-driven insights and support to help our organization make informed decisions,...