Data Engineer
Há 8 horas
Introduction & Summary:
We are seeking a Data Engineer who has experience building, optimizing, and maintaining data pipelines (ETL/ELT), as well as strong knowledge of technologies such as Spark, SQL, and Python. This role is fundamental to ensuring the reliability, security, and efficiency of data handling processes, with a focus on innovation and continuous system evolution.
Main Responsibilities:
- The Data Engineer will be responsible for technical and data architecture;
- Building, optimizing, and maintaining data pipelines;
- Defining pipeline architecture and governance standards;
- Coordinating the technical deployment of pipelines;
- Ensuring technical execution, performance, and code reliability;
- Balancing technical and product vision, acting as a bridge between stakeholders;
- Implementing data tests and validations, handling errors and corrupted data;
- Automating and monitoring processes for continuous improvement;
- Evaluating and proposing new architectural approaches;
- Stimulating innovation and promoting new solutions.
Key Requirements:
- Experience in building and maintaining data pipelines (ETL/ELT);
- Proficiency in Spark, SQL, and Python;
- Knowledge of Delta Lake and data architecture;
- Experience with Azure Fabric;
- Ability to implement tests and ensure data quality;
- Ability to define and follow security standards and access policies.
Nice to Have:
- Experience with tools for data automation and monitoring.
- Knowledge of big data frameworks.
- Skills in data analysis and visualization.
- Experience in promoting Proof of Concepts (POCs) and the adoption of new technologies.
Other Details:
This is a hybrid working model job, long-term position.
-
Lisbon
2 semanas atrás
Lisboa, Lisboa, Portugal Automation Engineer Tempo inteiro 30 000 € - 60 000 € por anoJob DescriptionAutomation Engineer - SDET - LisbonOverview#TEamCandour are seeking a talented and motivated Automation Engineer - SDET - to join our thriving, global enterprise client working out of their expanding Lisbon tech hub. This position is being offered on a hybrid basis and will required 2 days attendance per week at the office in Central Lisbon.As...
-
Senior Software Engineer
2 semanas atrás
Lisboa, Lisboa, Portugal Soda Data Tempo inteiroSoda - creators of the Soda Core - are looking for a Senior Software Engineer (Data and Backend) to help improve our Open Source and Cloud products. We're moving in an exciting new direction, and we need your help. If you're a software engineer who thrives on tackling large-scale challenges and wants to build the future of Fully Automated Data Quality, we'd...
-
Senior Software Engineer
1 semana atrás
Lisboa, Lisboa, Portugal Soda Data Tempo inteiroSoda - creators of the Soda Core - are looking for a Senior Software Engineer (Data and Backend) to help improve our Open Source and Cloud products.We're moving in an exciting new direction, and we need your help. If you're a software engineer who thrives on tackling large-scale challenges and wants to build the future of Fully Automated Data Quality, we'd...
-
data engineer
2 semanas atrás
Lisboa, Lisboa, Portugal iTRecruiter Tempo inteiroDATA ENGINEER / PYTHON – ETL (HYBRID LISBON or PORTO)Portuguese company hires for hybrid positionLocation:Lisbon or Porto, Portugal Candidates must already live in Portugal Language Requirements: Fluent in English Experience Levels: 3-6 years of experience Setor: Banca Instructions: Please send your CVs in English and make sure to include all skills and...
-
Data Engineer
Há 2 dias
Lisboa, Lisboa, Portugal InnoWave Tempo inteiroWe are seeking a Data Engineer with experience in Google Cloud Platform (GCP) to join our team in Lisbon. The ideal candidate will design, develop, and optimize data pipelines, ensuring secure, reliable, and scalable data processing across our cloud environment. This role involves close collaboration with data analysts, data scientists, and business...
-
Data Engineer
Há 2 dias
Lisboa, Lisboa, Portugal log - Impactful Tech Solutions Tempo inteiroOportunidade deData Engineer Lisboa (regime híbrido– 2x/semana) Inglês fluente Requisitos:Formação académica em Engenharia Informática, Eletrotécnica, Gestão de Sistemas de Informação ou áreas similares;Mais de 3 anos de experiência enquanto Data Engineer;Experiência sólida e prática com: Databricks (obrigatório) e Devops...
-
Data Engineer
1 semana atrás
Lisboa, Lisboa, Portugal FULLVENUE Tempo inteiroAtFULLVENUE, we're on a mission to help brands make smarter marketing decisions throughdata, AI, and automation. We build tools that turn first-party data into intelligence and we need someone to help us power that engine.We're looking for ahands-on Data Engineerwho loves solving complex data problems, building efficient pipelines, and shaping scalable...
-
Data Engineer
2 semanas atrás
Lisboa, Lisboa, Portugal Timestamp Tempo inteiro 60 000 € - 120 000 € por anoResponsibilities:10 years of experience in the Data field, especially as a Data Engineer.Participation in data migration projects to the Cloud (primarily Azure).Design and implement data pipelines (dbt, Trino, Spark, Python).Perform dimensional modelling and data transformation.Develop dashboards and reports (Power BI as a plus).Write SQL queries and Python...
-
Data Engineer
Há 2 dias
Lisboa, Lisboa, Portugal Fyld Tempo inteiroFyld is a Portuguese consulting company specializing in IT services. We bring high-performance professionals into the field across various technological areas.Inspired by sports management philosophy, we strive to achieve peak performance with each of our consultants. We focus on training and excellence.Join us for the next gameWe are looking for our next...
-
Data Engineer
1 semana atrás
Lisboa, Lisboa, Portugal Ytech Tempo inteiroWe like to solve problems, and we can't go a day without looking for innovative solutions. Ytech is a technological start-up focused on IT and Telecommunications that operates in two main areas: national project development and remote international projects. Ready to join us, Data Engineer?Do you have the skills?Proven experience as a Data Engineer or in a...