Senior Data Engineer

1 semana atrás

Porto, Porto, Portugal Euronext Tempo inteiro

Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering.

The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies.

Experience with Iceberg tables for managing large datasets is highly desirable.

As a Senior Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data solutions on the AWS cloud platform.

You will collaborate with cross-functional teams to develop robust data pipelines, ETL processes, and orchestration workflows, leveraging tools like Apache Airflow and AWS Step Functions.

Strong production awareness and troubleshooting skills are essential, along with the ability to provide technical leadership, mentorship, and guidance to junior team members.

Key Accountabilities The Senior Data Analyst/Engineer will be assigned to one or more projects and might change projects when higher priorities are identified.

When the Senior Data Engineer has acquired sufficient experience, it can be exposed to support activity of production systems, namely being on call for support.


Design and Implement AWS Solutions:
Utilize expert knowledge of AWS services such as Lambda, Glue, Step Functions, and others to design, implement, and maintain scalable and efficient data solutions on the cloud platform Solution Architecture and

Cloud Infrastructure:
Develop robust solution architectures and cloud infrastructure designs, considering factors such as scalability, performance, security, and cost optimization.

Demonstrate proficiency in cloud networking, including VPCs, subnets, security groups, and routing tables, to ensure secure and reliable data transmission.


Data Engineering and Database Management:

SQL Proficiency:
Writing and optimizing SQL queries

Performance Tuning:
Identifying and optimizing performance bottlenecks

ETL and Data Integration:
Extracting, transforming, and loading data into Redshift, mysql, Postgresql

Cluster Management:
Provisioning, scaling, and monitoring Redshift clusters

Security and Compliance:
Implementing security measures and ensuring compliance

AWS Integration:
Integrating Redshift with other AWS services

Monitoring and Troubleshooting:
Monitoring cluster performance and resolving issues

Documentation and Training:
Creating documentation and providing training to team members

Logging and Tracing:

Proficiency in setting up and managing logging and tracing mechanisms in AWS, including leveraging services like AWS CloudTrail for auditing API calls and AWS X-Ray for distributed tracing and performance analysis.

Understanding of best practices for logging configuration, log aggregation, and analysis to ensure visibility into system activity and troubleshooting capabilities.


Orchestration and Workflow Management:

Implement orchestration solutions using tools like Apache Airflow and AWS Step Functions to automate and manage data workflows effectively.

Utilize Athena for interactive query analysis and exploration of large datasets stored in Amazon S3.

Technical Leadership and Solution Documentation:

Provide technical leadership and guidance to the team, acting as a subject matter expert in AWS and data engineering technologies.

Write comprehensive solution documents and technical documentation to communicate architecture designs, data workflows, and best practices effectively.

Proactive

Production Awareness and Troubleshooting:

Demonstrate production awareness by proactively monitoring system health, automating checks, and anticipating potential issues to ensure smooth operation of data solutions.

Utilize strong troubleshooting skills to identify and resolve issues promptly, minimizing downtime and impact on business operations.

Continuous Improvement and Innovation:

Stay updated on emerging technologies and industry trends, continuously evaluating and incorporating new tools and techniques to enhance data engineering processes and infrastructure.

Take a proactive approach to challenge business requirements and propose innovative solutions to improve efficiency, scalability, and performance. Profile and Skills Education and KnowledgeBS/MS degree in Computer Science, Engineering or equivalent working experienceEnglish (B2 or higher level)

Euronext is looking at the following profile:
Profile & Skills:Expertise in

AWS:
Extensive experience with AWS services, particularly Lambda, Glue, StepFunctions, CloudFormation, CloudWatch, and others

Strong Solution Architecture Knowledge:
Ability to design scalable and efficient data solutions onAWS, considering best practices for cloud architecture and infrastructure

Proficiency in Python and Databases:
Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, RedShift) and NoSQL databases

Orchestration and Workflow Management:
Experience with orchestration tools such as Apache Airflow and AWS Step Functions for automating and managing data workflows.

ETL Tools and Big Data Experience:
Knowledge of ETL tools and experience working with large volumes of data, with a preference for Kafka experience

Experience with Iceberg Tables:
Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions

Production Awareness and Troubleshooting:
Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues

Technical Leadership and Communication:
Capable of evolving into a technical lead role, with excellent communication and teamwork skills to collaborate effectively with cross-functional teams

Strong Analytical and Problem-Solving Skills:
Ability to analyze requirements, define technical approaches, and propose innovative solutions to complex problems

Documentation and Requirements Analysis:
Experience in writing solution documents, technical documentation, and the ability to challenge and refine business requirements

Nice to Have:
Knowledge in Apache Flink, Kafka, and other big data technologies.
Experience with cloud-native architectures and serverless computing.
Certification in AWS or relevant technologies.
Euronext ValuesUnity

  • We respect and value the people we work with
  • We are unified through a common purpose
  • We embrace diversity and strive for inclusionIntegrity
  • We value transparency, communicate honestly and share information openly
  • We act with integrity in everything we do
  • We don't hide our mistakes, and we learn from themAgility
  • We act with a sense of urgency and decisiveness
  • We are adaptable, responsive and embrace change
  • We take smart risksEnergy
  • We are positively driven to make a difference and challenge the status quo
  • We focus on and encourage personal leadership
  • We motivate each other with our ambitionAccountability
  • We deliver maximum value to our customers and stakeholders
  • We take ownership and are accountable for the outcome
  • We reward and celebrate performance We are proud to be an equal opportunity employer. We do not discriminate against individuals on the basis of race, gender, age, citizenship, religion, sexual orientation, gender identity or expression, disability, or any other legally protected factor. We value the unique talents of all our people, who come from diverse backgrounds with different personal experiences and points of view and we are committed to providing an environment of mutual respect. Additional Information This job description is only describing the main activities within a certain role and is not exhaustive. It does not prevent to add more tasks, projects. About Us Euronext is the leading pan-European market infrastructure, connecting European economies to global capital markets, to accelerate innovation and sustainable growth. It operates regulated exchanges in Belgium, France, Ireland, Italy, the Netherlands, Norway and Portugal. With close to 1,930 listed issuers and around €6.3 trillion in market capitalisatio n as of end December 2022, it has an unmatched blue-chip franchise and a strong diverse domestic and international client base. Euronext operates regulated and transparent equity and derivatives markets, one of Europe's leading electronic fixed income trading markets and is the largest centre for debt and funds listings in the world. Its total product offering includes Equities, FX, Exchange Traded Funds, Warrants & Certificates, Bonds, Derivatives, Commodities and Indices. The Group provides a multi-asset clearing house through Euronext Clearing, and custody and settlement services through Euronext Securities central securities depositories in Denmark, Italy, Norway and Portugal. Euronext also leverages its expertise in running markets by providing technology and managed services to third parties. In addition to its main regulated market, it also operates a number of junior markets, simplifying access to listing for SMEs. #J-18808-Ljbffr

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal BJSS Tempo inteiro

    Senior Data Engineer Porto, Porto District Senior Data EngineerPorto Porto, Porto District, Portugal About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Five9 Tempo inteiro

    Senior Data Engineer - Data Services Porto, Porto District Senior Data Engineer - Data ServicesPorto Porto, Porto District, Portugal Responsibilities: Design, construct, test, and maintain highly scalable data management systems. Ensure systems meet business requirements and industry practices. Integrate new data management technologies and software...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Euronext Tempo inteiro

    Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies....

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Infineon Technologies AG Tempo inteiro

    Do you enjoy both working technically and enabling others with Data? In this role, you will enable our customers to maximize the value generated by data within a global, company-wide Business Intelligence and Analytics organization. We are fully committed to this organization's strategic impact and we are looking for you to leave your footprint and to work...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Credable Group Tempo inteiro

    Senior Data Engineer Porto, Porto District Senior Data EngineerPorto Porto, Porto District, Portugal Welcome to Credable We build embedded finance solutions that provide access to finance to people and places that previously were left in the dark. Picture not being able to store your earnings securely, transmit or receive money over great distances, acquire...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Finoa Tempo inteiro

    Senior Data Engineer Lead Level Santo Tirso, Porto Your mission We are a leading blockchain asset custody platform, committed to providing secure and reliable services to our clients. Our mission is to leverage data to enhance our processes and drive informed- making across various stakeholders. As we expand our team, we are looking for a passionate Senior...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal SWORD Health, Inc Tempo inteiro

    Senior Data Engineer Porto, Porto District Senior Data EngineerPorto Porto, Porto District, Portugal Sword Health is on a mission to free two billion people from pain as the world's first and only end platform to predict, prevent and treat pain. Delivering a 62% reduction in pain and a 60% reduction in surgery intent, at Sword, we are using technology to...

  • Senior Engineer It Data Business Intelligence

    1 semana atrás

    Porto, Porto, Portugal Tn Portugal Tempo inteiro

    Senior Engineer It Data Business Intelligence & Analytics (F/M/Div) Vila Nova de Gaia, Porto District Senior Engineer It Data Business Intelligence & Analytics (F/M/Div)Porto Porto, Porto, Portugal col-wideJob Description:As a Senior Engineer IT Data Business Intelligence & Analytics, you will support the implementation of BI solutions in the area of Supply...

  • Senior Data Engineer

    4 semanas atrás

    Porto, Porto, Portugal Olisipo Tempo inteiro

    Did you know that 97% of our employees value the professional progress provided by the training we offer? Discover all the reasons that make us a Great Place to Work iT's happening We are looking for a Senior Data Engineer to integrate a hybrid project in Porto.Responsibilities: Explore, clean, and analyse large and complex datasets to support business...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Olisipo Tempo inteiro

    Did you know that 97% of our employees value the professional progress provided by the training we offer? Discover all the reasons that make us a Great Place to Work iT's happening We are looking for a Senior Data Engineer to integrate a hybrid project in Porto.Responsibilities: Explore, clean, and analyse large and complex datasets to support business...

  • Senior Data Engineer

    3 semanas atrás

    Porto, Porto, Portugal Olisipo Tempo inteiro

    Did you know that 97% of our employees value the professional progress provided by the training we offer? Discover all the reasons that make us a Great Place to Work iT's happening We are looking for a Senior Data Engineer to integrate a hybrid project in Porto.Responsibilities: Explore, clean, and analyse large and complex datasets to support business...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Apm Terminals Tempo inteiro

    Maersk is a renowned global leader in logistics, shaping the future of trade and logistics across 130 countries.Join us at Maersk to collaborate with professionals who move the world daily, while working towards a sustainable future.What We Offer:Work with skilled professionals and access world-class learning programsHybrid working flexibility and...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Infineon Technologies Ag Tempo inteiro

    Do you enjoy both working technically and enabling others with Data? In this role, you will enable our customers to maximize the value generated by data within a global, company-wide Business Intelligence and Analytics organization. We are fully committed to this organization's strategic impact and we are looking for you to leave your footprint and to work...

  • Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Dellent Consulting Tempo inteiro

    Would you like to make an impact in different industries with your work? Then this project is for you. Here you will have the opportunity to be part of a multicultural and inclusive team with global projection that contacts with areas such as consultancy, law, strategy, insurance, finance, among others. We are looking for a Data Engineer Azure to work in...

  • Senior Sistems Engineer – Data Center

    1 semana atrás

    Porto, Porto, Portugal DATA MART Consulting GmbH Tempo inteiro

    A equipa de Technical Services implementa as soluções vendidas pela Warpcom, apoia a pré-venda na fase de proposta técnica e assegura a 3a linha de suporte para os clientes suportados pelo Warpcom Command Center (NOC, SOC e IT Operations). Como Systems Engineer de Data Center & Cloud, vais fazer parte duma equipa especializada em soluções de...

  • Senior Blockchain Engineer

    1 semana atrás

    Porto, Porto, Portugal Employment Pro Limited Tempo inteiro

    Buscar vagas de emprego e oportunidades de carreiraEncontramos 336 vagas para Vagas de emprego senior-blockchain-engineer .Receba alerta de vagas em seu email. Registre-se agoraFunção: Network Engineer SeniorEmpresa: Integer ConsultingTipo: Full-timeContrato: n/dLocalidade: LisboaFunção: (Senior)Cloud EngineerEmpresa:Diconium Digital SolutionsTipo:...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal We Are Meta Tempo inteiro

    Seeking a Senior Data Engineer: Rhino, are you there? At WE ARE META, we're focused on finding the perfect match between our Rhinos and our clients. 1.Expand your network: As a consultant at We Are Meta you'll get to have access to a network of national and international partners across diverse sectors of the tech industry. 2.Enjoy our perks:When you join...

  • Data / Analytics Engineer (All Genders)

    1 semana atrás

    Porto, Porto, Portugal TeamViewer Tempo inteiro

    (Senior) Data / Analytics Engineer (all genders) Porto, Porto District (Senior) Data / Analytics Engineer (all genders)Porto Porto, Porto District, Portugal Responsibilities Join our Data department inside R&D and help us shape the product decisions and processes of TeamViewer with the help of data. Act as the interface between development and internal...

  • Senior Data Engineer

    1 semana atrás

    Porto, Porto, Portugal Euronext Tempo inteiro

    Euronext is seeking a talented Senior Data Engineer with expertise in AWS and a strong background in solution architecture, database management, and data engineering. The ideal candidate will have extensive experience with AWS services such as Lambda, Glue, Step Functions, and CloudFormation, along with proficiency in Python, SQL, and database technologies....

  • Senior Datawarehouse Engineer

    1 semana atrás

    Porto, Porto, Portugal Tn Portugal Tempo inteiro

    Senior Datawarehouse Engineer (M/F/D) Porto, Porto District Senior Datawarehouse Engineer (M/F/D)Porto Porto, Porto, Portugal col-wideJob Description:Introduction SentenceAs a Senior BI Engineer in our Tech Hub in Portugal, you will be an integral part of our local tech team, shaping the data landscape at ProSiebenSat. 1 Group with current technologies and...