Data Engineering Lead

Há 5 dias


Porto, Porto, Portugal Devexperts Llc Tempo inteiro

Devexperts Llc is a leading provider of software solutions for the financial industry.

Salary:$170,000 - $220,000 per year

Job Description

We are looking for a highly skilled Data Engineer to join our Research & Development Team.

The successful candidate will be responsible for designing, developing, and maintaining robust data pipelines using Java within AWS infrastructure.

This includes implementing scalable solutions for data analysis and transformation using Apache Spark and PySpark, utilising Airflow for efficient workflow orchestration in complex data processing tasks, and ensuring fast and interactive querying capabilities through the use of Presto.

Manage Infrastructure

The ideal candidate will have experience with containerisation using Docker for streamlined deployment and scaling, orchestrating and managing containers effectively with Kubernetes in production environments, and implementing infrastructure as code using Terraform for provisioning and managing AWS resources.

Collaborate and Communicate

They will collaborate with cross-functional teams to understand data requirements and architect scalable solutions aligned with business goals.

Ensuring data quality and reliability through robust testing methodologies and monitoring solutions is also crucial.

The successful candidate will stay updated with emerging technologies and industry trends to continuously enhance the data engineering ecosystem.

Qualifications
  • Bachelor's degree in Computer Science, Engineering, or related field
  • Minimum 5 years of hands-on experience in Java / Scala / Python development, emphasising object-oriented principles
  • Proficiency in Apache Spark or PySpark for large-scale data processing
  • Experience with Airflow for workflow orchestration in production environments
  • Familiarity with Docker for containerisation and Kubernetes for container orchestration
  • Experience managing AWS services such as S3, EMR, Glue, Athena, and Redshift
  • Strong background in SQL and relational databases
  • Excellent English language communication skills, both verbal and written
  • Ability to collaborate effectively with technical and non-technical stakeholders
Benefits

We offer a dynamic and supportive work environment, opportunities for professional growth and development, and a competitive salary package.



  • Porto, Porto, Portugal Synopsys, Inc. Tempo inteiro

    Job Title: Data Engineering LeadAbout the Role:Synopsys, Inc. is seeking a talented Data Engineering Lead to accelerate our Product Operations data flows definition, implementation, and compliance.Main Responsibilities:

  • Data Engineering Team Lead

    3 semanas atrás


    Porto, Porto, Portugal SWORD Health, Inc Tempo inteiro

    Data Engineering Team Lead Job DescriptionJob SummarySword Health is seeking a highly skilled Data Engineering Team Lead to lead a team of data engineers in developing and implementing data solutions using dbt and SQL. The ideal candidate will have a strong technical background, excellent leadership skills, and experience in agile methodologies.About the...


  • Porto, Porto, Portugal Sword Health Tempo inteiro

    Job Title: Data Engineering Team LeadAbout the Role:We are seeking a highly skilled Data Engineering Team Lead to join our Data Team at Sword Health. As a Data Engineering Team Lead, you will be responsible for leading a team of data engineers, focusing on developing and implementing data solutions using dbt and SQL. You will participate in sprint planning,...

  • Data Engineering Team Lead

    3 semanas atrás


    Porto, Porto, Portugal Sword Health Tempo inteiro

    About This RoleSword Health is seeking a highly skilled Data Team Lead to join our Data Team. As a Data Team Lead, you will be responsible for leading a team of data engineers and focusing on developing and implementing data solutions using dbt and SQL.Key ResponsibilitiesLead and mentor a team of data engineers, fostering a collaborative and growth-oriented...


  • Porto, Porto, Portugal SWORD Health, Inc Tempo inteiro

    About the RoleSword Health is seeking a highly skilled Data Engineering Team Lead to join our Data Team. As a key member of our team, you will be responsible for leading a team of data engineers, focusing on developing and implementing data solutions using dbt and SQL. You will participate in sprint planning, roadmap estimations, and approvals to ensure...

  • Software Engineering Lead

    2 semanas atrás


    Porto, Porto, Portugal Capgemini Engineering Tempo inteiro

    At Capgemini Engineering, we're seeking a highly skilled Software Engineering Lead to spearhead our software development efforts.Salary: Estimated annual salary $120,000 - $170,000 based on national averages and industry standards in the United States.About the RoleThis is an exciting opportunity to join our team as a Software Engineering Lead. You will be...


  • Porto, Porto, Portugal Swordhealth Tempo inteiro

    About UsSword Health is a pioneering healthcare technology company dedicated to revolutionizing patient care through data-driven insights.We're seeking an experienced Data Engineering Team Lead to spearhead our data engineering efforts, ensuring the delivery of high-quality data solutions that drive business growth and improve patient outcomes.Job...


  • Porto, Porto, Portugal Sword Health Tempo inteiro

    About the RoleSword Health is seeking a highly skilled Data Engineering Team Lead to lead a team of data engineers in developing and implementing data solutions using dbt and SQL. The ideal candidate will have a proven track record in data engineering leadership, with strong proficiency in dbt and SQL, and experience with Apache Airflow and Python. Key...

  • Chief Data Engineering Lead

    2 semanas atrás


    Porto, Porto, Portugal Sword Health, Inc Tempo inteiro

    **About Sword Health, Inc.**We are a high-tech startup company that is changing the future of healthcare with our innovative solution.**Job Title: Chief Data Engineering Lead**Estimated salary: $170,000 - $220,000 per year (dependent on experience and location)**Job Description**Sword Health, Inc. is looking for an experienced Senior Data Engineer to join...

  • Data Engineering Team Lead

    3 semanas atrás


    Porto, Porto, Portugal Siemens Gas And Power Gmbh & Co. Kg Tempo inteiro

    About the RoleWe are seeking a talented Data Engineering Team Lead to join our team at Siemens Energy. As a key member of our organization, you will be responsible for leading a team of data engineers focused on leveraging data and information across the SE to improve data-related operations and gain risk-related insights.Key ResponsibilitiesLead a team of...


  • Porto, Porto, Portugal Mindera Tempo inteiro

    Job DescriptionWe are seeking a highly skilled Data Quality Engineering Lead to join our team at Mindera. This is an excellent opportunity for a talented professional to take on a leadership role in ensuring the highest quality data solutions for our clients.About the Role:Lead the development of data quality engineering practices, behaviors, and ways of...

  • Project Manager Lead

    2 semanas atrás


    Porto, Porto, Portugal Noesis Portugal Tempo inteiro

    About Noesis PortugalWe are looking for a skilled Project Manager Lead - Data Engineering to join our team in Portugal. This is an exciting opportunity to lead data engineering projects and contribute to the growth of our innovative organization.About the RoleWe offer a competitive salary, with estimated earnings of €80,000 per year, depending on...


  • Porto, Porto, Portugal Buscojobs Portugal Tempo inteiro

    About the Company: Buscojobs Portugal is a leading organization in the industry, committed to innovation and excellence.Salary Information: The estimated salary for this position is between €70,000 - €100,000 per year, depending on experience and qualifications.Job Description: As a Data Engineering Project Lead, you will be responsible for delivering...


  • Porto, Porto, Portugal Swordhealth Tempo inteiro

    Sword Health is a pioneering healthcare company that leverages data engineering expertise to revolutionize patient outcomes. As a Data Engineering Team Lead, you will be responsible for driving the development and implementation of cutting-edge data solutions using dbt and SQL.This role offers a unique opportunity to spearhead innovation and growth within...


  • Porto, Porto, Portugal Siemens Gas And Power Gmbh & Co. Kg Tempo inteiro

    About Siemens EnergySiemens Energy is a leading provider of innovative solutions for the energy transition. Our mission is to help our customers achieve their targets by providing best-in-class services and solutions in various areas.Job SummaryWe are seeking an experienced Data Engineering Team Lead to join our Data & Analytics organization. As a key member...


  • Porto, Porto, Portugal Swordhealth Tempo inteiro

    Senior Data Solutions ArchitectWe are seeking an experienced Senior Data Solutions Architect to lead our data engineering team and drive the development of innovative data solutions using dbt and SQL.


  • Porto, Porto, Portugal Phiture Tempo inteiro

    We are seeking a skilled Technical Lead for Data Engineering to join our team at Phiture. This role offers an exceptional opportunity for growth and professional development, with a focus on complex data pipelines orchestration, cloud environments, and agile methodologies.Company Overview:We Are META is a forward-thinking company that specializes in finding...


  • Porto, Porto, Portugal Mindera Tempo inteiro

    About the RoleOwning the end-to-end delivery of work across the ambitious Strategic Data Platform Programme, enabling us to provide a single version of truth across the business.Key ResponsibilitiesLeading on the planning and execution of work from our 2-year road maps via quarterly planning and 2-week development iterations.Working with fellow Data Tribe...


  • Porto, Porto, Portugal SWORD Health, Inc Tempo inteiro

    Job DescriptionSWORD Health, Inc is seeking a highly skilled Senior Data Engineering Team Lead to lead our cloud data solutions team. As a key member of our engineering team, you will be responsible for overseeing the development and implementation of data solutions using dbt and SQL.About the RoleWe are looking for an experienced leader who can foster a...

  • Data Engineering Director

    3 semanas atrás


    Porto, Porto, Portugal Planet Tempo inteiro

    About UsPlanet is a leading technology company that's transforming the payments industry by putting customer experience first. We help our clients deliver a better experience for customers everywhere by combining software and payment technology. Our goal is to create a world of connected commerce that makes payments feel good.Role PurposeThe Senior Data...