Data Engineer
Guarde esta oferta e mantenha a sua pesquisa organizada
Crie uma conta gratuita para guardar ofertas, criar alertas e voltar a este anúncio a partir do seu painel.
Ao continuar, aceita os nossos Termos & Política de Privacidade.
Over 30 years providing HR solutions to clients and candidates Type:
Full-time, long-term
We are looking for an experienced
Data Engineer
to join our growing data team and contribute to the design, optimization, and operation of scalable data platforms. You will work with modern data technologies, supporting complex business use cases and ensuring high-performance, reliable data pipelines.
Databricks & Spark
Optimize slow-running Spark jobs to improve performance and cost efficiency.
Implement storage optimization using
Delta Lake
features such as Z-ordering and partitioning.
Manage and fine‐tune Databricks cluster configurations.
Install and manage libraries across environments.
Apply and maintain
Medallion Architecture
(Bronze, Silver, Gold layers).
Translate complex business requirements into efficient data processing logic.
PySpark & SQL
Apply partitioning and bucketing strategies for performance optimization.
Handle skewed data and optimize large‐scale joins.
Develop complex joins, advanced SQL queries, and window functions.
Use broadcast joins and repartitioning where appropriate.
Work with
CTEs
and structured/semi‐structured data, including
JSON
formats.
Perform detailed requirement analysis for complex business processes.
Develop, debug, and optimize ADF pipelines.
Implement event‐based triggers and incremental data loading strategies.
Create and manage
EDF pipelines
and orchestrate multiple dependent pipelines.
Design reusable and generic ADF pipelines to support multiple use cases.
Airflow
Develop and maintain Airflow DAGs.
Write custom operators and sensors.
Handle task retries, failure scenarios, and recovery strategies.
Use
XComs
for inter‐task data sharing.
Proven experience as a
Data Engineer
working with large‐scale data platforms.
Strong hands‐on experience with
Databricks, Spark, and PySpark .
Solid knowledge of
Delta Lake
and data lake best practices.
Experience with
Azure Data Factory
for pipeline orchestration.
Strong experience with
Apache Airflow .
Advanced SQL skills and strong understanding of data modeling.
Ability to analyze complex business requirements and translate them into technical solutions.
Strong problem‐solving skills and attention to performance optimization.
Nice to Have
Experience with cloud platforms (Azure preferred).
Knowledge of CI/CD for data pipelines.
Experience working in Agile environments.
Familiarity with data governance and data quality frameworks.
What We Offer
Opportunity to work on complex, high‐impact data projects.
Modern data stack and exposure to best‐in‐class technologies.
Competitive salary and benefits package.
Career growth, continuous learning, and technical development.
Hybrid or remote working model (depending on location).
Send your CV to
jobs@optiwisers.com
Subject:
Data Engineer (Banking)
Referrals increase your chances of interviewing at Optiwisers by 2x.
Seniority Level Mid‐Senior level
Employment Type Full-time
Job Function Information Technology and Consulting
Industries Banking
-
Data Engineer
Há 2 dias
lisbon, lisbon, Portugal Kiion Tempo integralWe are seeking a Data Engineer to execute the full lifecycle of the data products development, by programming well-designed, efficient, and testable code that meets specifications.Responsibilities- Develop new capabilities and re-architect parts of an existing system. - Take part in test-driven, iterative development, prototyping, and reviews with a team of...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal IT House - Global Business Solutions Tempo integralIT House is recruiting a Data Engineer for a client in the logistics sector, based in Lisbon.RESPONSIBILITIES- Design, build, and operate enterprise-grade ETL and ELT pipelines for AI, analytics, reporting, and agentic workflow use cases; - Create clean, documented, reusable data products from operational, customer, logistics, sales, and other enterprise...
-
Data Engineer
Há 2 dias
lisbon, lisbon, Portugal Optiwisers Tempo integralOver 30 years providing HR solutions to clients and candidatesType: Full-time, long-termWe are looking for an experienced Data Engineer to join our growing data team and contribute to the design, optimization, and operation of scalable data platforms. You will work with modern data technologies, supporting complex business use cases and ensuring...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal Hexa Consulting Tempo integralNa Hexa Consulting, promovemos a transparência e apoiamos percursos profissionais diversos no setor tecnológico. Com sede em Portugal, respondemos à crescente procura no setor de IT.A nossa missão passa por construir relações sólidas, ser um parceiro de referência através de uma abordagem diferenciadora na consultoria em IT e contribuir para o...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal Integer Consulting Tempo integralA Integer Consulting é uma empresa portuguesa de consultoria em tecnologias de informação. Somos especialistas em serviços de IT outsourcing, software, projetos de nearshore e desenvolvimento à medida. Somos parceiros dos principais players tecnológicos a nível mundial e trabalhamos com empresas nacionais e multinacionais de diversos setores de...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal AgileEngine Tempo integralWe are looking for aData Engineerto execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.The mandatory requirements are3+ years of Python , advanced SQL, Snowflake modeling, Airflow, Kafka, Spark/PySpark,Iceberg ,Parquet ,AWS S3 , testing/debugging, 2+ years with large-scale Airflow/Spark data, overlap until12 PM...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal Egor Group Tempo integralEgor Group, through its IT House partner, is seeking a Data Engineer for a logistics client in Lisbon. The role is hybrid, based in Lisbon with cross-team collaboration.You will design and operate enterprise-grade ETL/ELT pipelines, integrate Azure and AWS data services, and work with Snowflake to deliver trustworthy data products. Fluent English is...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal Next Engineering Tempo integralAt Next Engineering, we don’t wait for the future. We build it.We believe that innovation comes through knowledge and that every project is an opportunity to push boundaries.We also believe that the next step is yours.- Strong experience with Python, SQL, data modelling, ETL/ELT development, and production data pipelines; - Experience with cloud-native...
-
Data Engineer
Há 1 dia
lisbon, lisbon, Portugal Bee Engineering ICT Tempo integralSomos uma consultora de tecnologias de informação com foco em projetos de Engenharia associados às Tecnologias da Informação. Atuamos em dois eixos principais: OTS e DxSpark, concentrando o que fazemos de melhor em cada um deles. Contamos com uma equipa diversa, de cerca de 200 profissionais, apaixonados e comprometidos em transformar desafios em...
-
Data engineer
Há 1 dia
lisbon, lisbon, Portugal Mozantech Tempo integralОписаниеMozantech is a Tech Company from Porto specialized in Web Digital Experiences. Our team is able to deliver high-tech solutions, consulting, turn-key projects and nearshoring. We develop projects for different markets such as banking, finance, insurance, industry, networks, telecommunications, services, utilities and distribution. We are...