Cloud Data Engineer

2 semanas atrás

Porto, Portugal Olisipo Tempo inteiro

1 day ago Be among the first 25 applicants

We are recognized for our talents as an Excellent Company to Work For. Join a team that values people, invests in continuous development, and lives technology with passion

We are looking for a Cloud Data Engineer with proven experience in data engineering in a cloud environment to join a project in the financial sector.

Hybrid project - Porto

Requirements:

- At least 3 years of experience in developing and implementing data pipelines on public cloud platforms;

- At least 1 year of experience in architecture, design, development, and support of data solutions, demonstrating the ability to design scalable and efficient structures;

- Solid knowledge of database architecture, ETL processes, business intelligence, big data, machine learning, and advanced analytics;

- Practical experience with the Spark ecosystem, with proficiency in Hadoop considered a plus;

- Knowledge of pipeline orchestration tools, such as Airflow, Step Functions, or AWS Workflow, ensuring the automation and monitoring of data processes;

- Mastery of Lakehouse architecture implementation, with a focus on Iceberg, with knowledge of Hudi and Delta, as well as optimization techniques (Compaction, Z-Order, etc.);

- Proficiency in Python and SQL, applying best practices in development, automation, and continuous integration (CI/CD);

- Experience with containers (Docker) and infrastructure as code, using tools such as AWS CloudFormation and Terraform to automate the creation and maintenance of cloud resources;

- Have in-depth knowledge of key AWS services, including Lambda, Glue, Crawlers, Step Functions, DynamoDB, and AWS Batch;

- Fluency in English.

Responsibilities:

- Advise on strategy, architecture, and data implementation in a cloud environment;

- Design and develop data pipelines in AWS (and other public clouds when applicable);

- Implement and optimize Lakehouse architectures (preferably Iceberg, with Hudi and Delta being an added value);

- Build, automate, and maintain ETL processes, workflows, and orchestration (Airflow, Step Functions, AWS Workflow);

- Ensure reliability, automation, security, and maintenance of all delivered solutions;

- Support incident resolution, root cause analysis, and preventive actions;

- Share best practices and knowledge with internal teams;

- Collaborate with Delivery Managers, Architects, PMs, Developers, and Business Analysts in an agile and collaborative environment.

We offer:

- Health insurance;

- Free online training through the Udemy platform;

- On-site and remote training at Olisipo's Learning Center;

- Free certifications (after passing the exam);

- Discounts at Olisipo Partners (in the areas of health and well-being, fitness, travel, among others);

- Free psychological consultations;

- Possibility of a salary advance, without commissions.

Apply and get to know about this project

Seniority level

- Mid-Senior level

Employment type

- Full-time

Job function

- Information Technology

Industries

- IT Services and IT Consulting

Referrals increase your chances of interviewing at Olisipo by 2x

Get notified about new Data Engineer jobs in Porto, Portugal.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

#J-18808-Ljbffr

  • Cloud Engineer

    1 semana atrás

    Porto, Portugal Grupo Data Tempo inteiro

    Hi! We are Group DATA and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looknig...

  • Cloud Engineer

    Há 5 dias

    Porto, Portugal Grupo Data Tempo inteiro

    Hi! We are Group DATA and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looknig...

  • Cloud Engineer

    Há 7 dias

    Porto, Portugal Grupo Data Tempo inteiro

    Hi! We are Group DATA and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looknig...

  • Cloud Engineer

    Há 22 horas

    Porto, Portugal Grupo Data Tempo inteiro

    Hi We are Group DATA and we are searching for the best talent Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal If you are passionate and have the desire to make the difference, we want to get to know you Join us to be part of this incredible adventure Who are we looknig for?...

  • Cloud Engineer

    2 semanas atrás

    Porto, Portugal Grupo Data Tempo inteiro

    Hi! We are Group DATA and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looknig...

  • Cloud Engineer

    1 semana atrás

    Porto, Porto, Portugal Grupo Data Tempo inteiro

    Hi We are Group DATA and we are searching for the best talent Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal If you are passionate and have the desire to make the difference, we want to get to know you Join us to be part of this incredible adventure Who are we looknig...

  • Cloud Engineer

    2 semanas atrás

    Porto, Porto, Portugal Grupo Data Tempo inteiro

    Hi We are Group DATA and we are searching for the best talent Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to PortugalIf you are passionate and have the desire to make the difference, we want to get to know you Join us to be part of this incredible adventureWho are we looknig...

  • Cloud Data Engineer

    Há 6 dias

    Porto, Portugal KCS iT Tempo inteiro

    1 day ago Be among the first 25 applicantsWe are recognized for our talents as an Excellent Company to Work For. Join a team that values people, invests in continuous development, and lives technology with passion!We are looking for a Cloud Data Engineer with proven experience in data engineering in a cloud environment to join a project in the financial...

  • Distributed Cloud | GCP Data Engineer

    Há 10 horas

    Porto, Portugal Devoteam Tempo inteiro

    Company DescriptionAt Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of...

  • Data Engineer | Cloud-based

    2 semanas atrás

    Porto, Portugal Reach IT Tempo inteiro

    Reach IT - Nearshore Solution! Our nearshore expertise sets us apart. We specialize in on-demand, scalable solutions, and operational excellence. By bridging the talent gap, we deliver results that drive your business forward. We are looking for a Data Engineer | Cloud Data Platforms (Azure/AWS)