Data Engineering Leader for Large-Scale Trading Platforms

1 semana atrás


Porto, Porto, Portugal Devexperts Tempo inteiro
Senior Data Engineer Position Overview

We are seeking a highly skilled Senior Data Engineer to join our Research & Development Team at Devexperts. This is an exciting opportunity to work on large-scale trading platforms, delivering cutting-edge solutions for financial institutions. As a Senior Data Engineer, you will play a crucial role in designing and developing robust data pipelines, ensuring the scalability and reliability of our systems.

About the Role

We are looking for an experienced Senior Data Engineer with a strong background in Java / Scala / Python development. You will be responsible for developing data pipelines using Apache Spark and PySpark, implementing scalable solutions for data analysis and transformation, and utilizing Airflow for efficient workflow orchestration. Additionally, you will ensure fast and interactive querying capabilities through the use of Presto.

The ideal candidate will have a minimum of 5 years of hands-on experience in Java / Scala / Python development, emphasizing object-oriented principles. They will also possess technical proficiency in Apache Spark or PySpark, experience with Airflow, Docker, and Kubernetes, as well as strong background in SQL and relational databases. Excellent English language communication skills and ability to collaborate effectively with technical and non-technical stakeholders are essential.

Key Responsibilities

- Develop data pipelines using Apache Spark and PySpark
- Implement scalable solutions for data analysis and transformation
- Utilize Airflow for efficient workflow orchestration
- Ensure fast and interactive querying capabilities through the use of Presto

Requirements

- Bachelor's degree in Computer Science, Engineering, or related field
- Minimum 5 years of hands-on experience in Java / Scala / Python development, emphasizing object-oriented principles
- Technical proficiency in Apache Spark or PySpark, experience with Airflow, Docker, and Kubernetes, and strong background in SQL and relational databases
- Excellent English language communication skills and ability to collaborate effectively with technical and non-technical stakeholders

Salary Estimate

$120,000 - $160,000 per annum, depending on location and experience.

About Devexperts

Devexperts is a leading provider of trading platforms and brokerage automation solutions for financial institutions. Our company focuses on delivering cutting-edge products and tailor-made solutions that meet the evolving needs of our clients. We pride ourselves on our expertise in complex software development projects, market data products, and IT consulting services.
  • Data Engineering Leader

    2 semanas atrás


    Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    Devexperts LLC, a leading provider of trading platforms and brokerage automation solutions, is seeking an experienced Data Engineering Leader to join their Research & Development Team. With a strong background in Java / Scala / Python development and a passion for data-driven solutions, this individual will play a key role in designing, developing, and...


  • Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    **About Devexperts LLC**Devexperts is a renowned consulting and development company serving the financial industry for nearly two decades. Our teams work together to create innovative software solutions that address complex technological challenges faced by leading financial institutions worldwide.**Job Overview**We are seeking an experienced Native iOS...

  • Data Engineering Expert

    2 semanas atrás


    Porto, Porto, Portugal Devexperts Tempo inteiro

    Company OverviewDevexperts is a leading provider of trading platforms and brokerage automation services to top financial institutions.Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our Research & Development Team.The ideal candidate will have a strong background in Java, Scala, or Python development, with a focus on object-oriented...

  • Senior Project Manager

    4 semanas atrás


    Porto, Porto, Portugal Solenis Portuguesa Tempo inteiro

    Job Title: Senior Project Manager - Large Scale ConstructionLocation: PortugalAbout the Role:We are seeking a highly experienced Senior Project Manager to lead the delivery of our new project in Portugal. This role requires a dynamic leader with a proven track record in large-scale construction projects within the chemical or related industries.Key...


  • Porto, Porto, Portugal TUI Tempo inteiro

    About TUI GroupTUI Group is a leading global tourism company that offers unique travel experiences to customers around the world.Job Title: Cloud Engineering Leader for Data Science PlatformSalary: €120,000 - €150,000 per annum, depending on location and experienceWe are seeking an experienced Cloud Engineering Leader to lead our Data Science platform...


  • Porto, Porto, Portugal Solenis Portuguesa Tempo inteiro

    Job Title: Senior Project Manager (Mechanically Qualified)Location: PortugalAbout the Role:We are seeking a highly experienced and mechanically qualified Senior Project Manager to lead the delivery of our new project in Portugal. This role requires a dynamic leader with a proven track record in large-scale construction projects within the chemical or related...


  • Porto, Porto, Portugal Tui Group Tempo inteiro

    Tui Group is seeking a highly skilled Digital Data Engineering Leader to drive the transformation of our digital apps. This role will play a critical part in shaping the data landscape for our digital products, enabling product and analytics teams to harness data effectively for actionable insights.About the CompanyTui Group is a leading travel company that...

  • Senior Data Engineer

    4 semanas atrás


    Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    Job Title: Senior Data Engineer - Java/Scala/Python ExpertJob Description:We are seeking a highly skilled Senior Data Engineer with expertise in Java, Scala, and Python to join our Research & Development Team. As a key member of our team, you will be responsible for designing, developing, and maintaining robust data pipelines using Java within AWS...

  • Software Engineer

    3 semanas atrás


    Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    Devexperts LLC is a consulting and development company that specializes in the financial industry. Our team is dedicated to solving complex technological challenges facing top financial institutions worldwide. We foster a growth mindset and actively seek out-of-the-box ideas to improve our services. Our teams work together to create next-generation financial...


  • Porto, Porto, Portugal Five9 Tempo inteiro

    About the RoleWe are seeking a skilled Senior Test Automation Engineer to join our team in San Francisco Bay Area. As a key member of our engineering team, you will be responsible for designing and implementing large-scale automation frameworks for our VoIP product.


  • Porto, Porto, Portugal Solenis Tempo inteiro

    About SolenisSolenis is a leading global producer of specialty chemicals dedicated to delivering sustainable solutions for water-intensive industries. Our technologies enhance operational efficiencies, improve product quality, protect plant assets, and minimize environmental impact across diverse markets.Job Title: Senior Project Manager (Mechanically...

  • Senior Data Engineer

    3 semanas atrás


    Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    Company OverviewDevexperts has been working for nearly two decades in the financial industry, providing consulting and development services to top financial institutions worldwide.As a company, we value growth mindset, diversity, and inclusivity. Our teams work together to create innovative software solutions for the financial sector.Job DescriptionWe are...

  • Android Software Engineer

    1 semana atrás


    Porto, Porto, Portugal Devexperts Tempo inteiro

    At Devexperts, we work with renowned financial institutions to deliver cutting-edge solutions. As a leading provider of trading platforms and brokerage automation services, our company focuses on complex software development projects, market data products, and IT consulting.We are seeking an experienced Android Software Engineer to join our Research &...


  • Porto, Porto, Portugal Smartenergy Group Ag Tempo inteiro

    Company OverviewThe Smartenergy Group Ag is a leading company in the field of green hydrogen and derived e-Fuels projects.SalaryWe offer a competitive salary range between 120,000 to 180,000 CHF per annum, depending on experience.Job DescriptionKey Responsibilities:Execution of feasibility studies, conceptual designs, and techno-economic assessments for...

  • iOS Developer

    3 semanas atrás


    Porto, Porto, Portugal Devexperts Tempo inteiro

    About DevexpertsDevexperts is a company that delivers software solutions to respected financial institutions. Our team works on complex projects, including trading platforms, software development, and IT consulting services.About the JobWe are looking for an experienced iOS Developer to join our Research & Development Team. The team is currently working on a...

  • Data Engineering Specialist

    3 semanas atrás


    Porto, Porto, Portugal Farfetch Tempo inteiro

    The mission of FARFETCH is to build a global platform for luxury fashion. Our Data Engineering team is looking for a talented professional to join our team and help us achieve this goal. As a Data Engineering Specialist, you will be responsible for designing, developing, and maintaining our custom data pipelines. You will work closely with our data...

  • Data Platform Engineer

    3 semanas atrás


    Porto, Porto, Portugal Celfocus Tempo inteiro

    About the RoleCelfocus is a European high-tech system integrator providing professional services focused on creating business value through Analytics and Cognitive solutions addressing various markets strategic opportunities. We serve clients in 25+ countries delivering solutions such as accelerating digital network transformation in Autonomous Networks,...


  • Porto, Porto, Portugal Devexperts Llc Tempo inteiro

    About Devexperts LlcDevexperts is a rapidly growing company specializing in financial software development, implementation, and support for investment and brokerage companies dealing with global futures, options, stocks, and crypto trading. Our trading platforms are fully integrated for both retail and institutional brokers, featuring comprehensive front-,...


  • Porto, Porto, Portugal Devexperts Tempo inteiro

    Job OverviewWe are seeking a highly skilled Data Engineering Lead to join our Research & Development Team at Devexperts, a leading provider of trading platforms and brokerage automation solutions. The successful candidate will have expertise in Java and AWS, with a strong background in designing and developing robust data pipelines.Salary Range: $120,000 -...


  • Porto, Porto, Portugal Phiture Tempo inteiro

    About the RoleWe are seeking a highly skilled Senior Mechanical Engineer to join our team in Wollerau, Switzerland. As a key member of our organization, you will play a critical role in the development of our green hydrogen and Power-to-X production projects.The successful candidate will have a minimum of 12 years of experience in mechanical engineering and...