Data Platform Engineer

Há 1 mês

Lisbon, Portugal ComplyAdvantage Tempo inteiro
What you will be doing :

Are you a highly skilled Data Platform Engineer with a passion for cutting-edge technology and a desire to make a real impact? Join our innovative team at ComplyAdvantage, where you'll design, manage, monitor, and optimise a diverse array of data systems running on AWS and GCP. Your expertise will ensure the seamless operation of SQL, NoSQL, Kafka, and Spark-based data layers, supporting our global client base.

Key Responsibilities:

  • Innovative Design and Maintenance: Develop and sustain data layer orchestration systems, managing self-managed and PaaS data layer technologies, and ensure data consistency while designing databases.
  • Performance and Availability: Oversee data layer components on AWS and GCP, guaranteeing top performance and reliability. Conduct regular performance tuning and troubleshoot issues.
  • Backup and Cost Management: Configure and deploy robust backup systems for databases, Kafka, and Spark, ensuring data integrity and enabling disaster recovery. Implement cost management strategies to optimise resource utilisation.
  • Documentation and Collaboration: Maintain thorough documentation for all Data Infrastructure engineering processes. Work closely with various teams to integrate data sources and support application requirements, adhering to best practices.
  • Capacity and Project Planning: Monitor and manage data infrastructure capacity, planning for future growth and scalability. Collaborate with stakeholders to define and prioritise engineering projects, setting realistic timelines and expectations.
  • Technical Support: Provide guidance and support to engineering team members on database and data layer architecture and technologies. Collaborate with Software Engineers to develop resilient data sharding strategies.

Our Tech Stack:

  • Cloud-Based Infrastructure: Fully cloud-based with a Kubernetes-focused tech stack. Compute workloads run in Kubernetes clusters across multiple regions.
  • Infrastructure Management: Heavy use of Terraform and Helm, adhering to GitOps paradigms for managing cloud infrastructure and Kubernetes applications.
  • Core Technologies: Extensive use of Kafka, distributed PostgreSQL and Cassandra QL, Elasticsearch, and Databricks/Spark. Development of inter-cloud failover options to support multi-cloud plans.
  • Wide Array of Applications: Teams build and release containerised applications for low latency APIs, machine learning models, and data processing pipelines.

About You:

  • Experience: Significant expertise with AWS and/or GCP core services, data systems (Apache Kafka, Apache Spark, Elasticsearch, PostgreSQL, Cassandra), and Kubernetes. Experience codifying infrastructure in Terraform and/or Helm charts.
  • Cost and Performance: Awareness of cost and performance considerations in designing data systems architectures. Proficiency with logging, monitoring, and tracing tools.
  • CI/CD and Security: Familiarity with CI tooling, test pipelines, and asset generation (e.g., Docker images, Helm charts). Understanding of security considerations in data systems.
  • Data Modelling: Experience with data modelling, sharding, and indexing strategies for large-scale databases.

Nice to Have:

  • Experience running distributed databases within Kubernetes.
  • Familiarity with distributed SQL and NoSQL databases such as Yugabyte, Cockroach, Spanner, HBase, or CouchDB.

Education:

  • BSc/BA degree in computer science, engineering, or related discipline OR equivalent experience in required skills

What’s in it for you?

  • Equity as we want you to have a part of what we are building
  • Unlimited Time Off Policy- A work-life balance and focus on our well-being are critical to keeping us performing at our best
  • We embrace a hybrid approach that requires employees to be in the office for two days a week. We strongly believe that this approach fosters collaboration and enables the building of meaningful relationships
  • You will also get a new starter budget to kit out your home office
  • Opportunity to work on innovative projects with smart-minded people keen to share their knowledge and continuously improve
  • Annual learning budget (prorated based on start date) to drive your performance and career development

About us:

ComplyAdvantage is the financial industry’s leading source of AI-driven financial crime risk data and detection technology. Our mission is to neutralise the risk of money laundering, terrorist financing, corruption, and other financial crime.

More than 1000 companies rely on us to understand the risk of who they’re doing business with through the world’s only global, real-time database of people and companies. Our solutions identify thousands of risk events daily from millions of structured and unstructured data points.

We have five global hubs in New York, London, Singapore, Lisbon and Cluj-Napoca and are backed by Goldman Sachs, Ontario Teachers, Index Ventures, and Balderton Capital.

Since 2014, we have raised over $100 million in funding, and in 2022 alone grew by over 40% to over 500 people globally. Over the next 12 months, as our revenue increases, we plan to increase to 600.

At ComplyAdvantage diversity fuels our rocket ship and our commitment to inclusion across race, gender, age, religion, identity and experience drives us forward every day. We encourage everyone to apply and aspire to consider every application fairly.

We will handle your information in accordance with our Privacy Policy. For further information, please click

  • Data Engineer Senior

    2 meses atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Position: Data Engineer Senior  you will be responsible for designing, developing, and maintaining our data infrastructure. You will work closely with our team of data scientists and analysts to ensure that our data is accurate, accessible, and secure. You will also be responsible for implementing data pipelines and ETL processes to support our data-driven...

  • Data Engineer

    1 semana atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer

    2 semanas atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer | Azure

    Há 1 mês

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Analyst/ Data Engineer

    6 meses atrás

    Lisbon, Portugal Equação IT Tempo inteiro

    Data Analyst/ Data Engineer Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners. We are looking for a Data Analyst/ Data Engineer with the following...

  • Big Data Engineer

    4 semanas atrás

    Lisbon, Portugal Vodafone Tempo inteiro

    What you’ll do The Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows, and...

  • Big Data Engineer

    4 meses atrás

    Lisbon, Portugal Vodafone Tempo inteiro

    What you’ll do The Big Data Engineer plays a key role in Digital Engineering team by supporting the strategy and deliverables related to Cloud Platform (GCP) and Data Engineering. The Big Data engineer is a core member of the agile teams delivering data pipelines and capabilities within the organization through building and automating data flows,...

  • Data Engineer

    Há 1 mês

    Lisbon, Portugal ComplyAdvantage Tempo inteiro

    What you will be doing : We are looking for talented Data Engineers to help us build our internal Platform solutions as well as provide insights to our customers. By giving our customers actionable insights, we enable them to be agile with their compliance operations, iterating on how they tune their search and transaction monitoring parameters. You will...

  • Senior Data Engineer

    6 meses atrás

    Lisbon, Portugal BJSS Tempo inteiro

    About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data solutions in order to deliver business value.As a BJSS data engineer you’ll help our clients deploy data...

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal Landing.jobs Tempo inteiro

    At Engine B (Permanent), in Lisbon, Portugal Expires at: 2025-03-01 Remote policy: Partial remote Engine B, founded in 2018, specializes in generative AI tools that automate complex tasks in professional services, enhancing decision-making and improving service quality. In 2024, Engine B was acquired by CliftonLarsonAllen (CLA), combining our AI expertise...

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal Landing.jobs Tempo inteiro

    At Engine B (Permanent), in Lisbon, PortugalExpires at: 2025-03-01Remote policy: Partial remoteEngine B, founded in 2018, specializes in generative AI tools that automate complex tasks in professional services, enhancing decision-making and improving service quality. In 2024, Engine B was acquired by CliftonLarsonAllen (CLA), combining our AI expertise with...

  • Data Engineer

    Há 1 mês

    Lisbon, Portugal Sky Tempo inteiro

    Join us at Sky Portugal and be part of our exciting journey to lead the way in the streaming tech world! As a  Data Engineer , you'll play a key role in our innovative team dedicated to creating exceptional experiences for our global customers. From powering platforms like NBCUniversal’s Peacock in the United States to Sky’s NOW, and SkyShowtime...

  • Data Engineer

    2 semanas atrás

    Lisbon, Portugal Boost-IT Tempo inteiro

    Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.If you're passionate about technology and...

  • Data Engineer

    2 semanas atrás

    Lisbon, Portugal NTT DATA Tempo inteiro

    Job Description We are a multinational Business and Technology consultancy that reinvents and transforms organizations through innovation and have been ranked by Gartner as one of the top 10 IT services companies in the world. At NTTDATA we are Digital Lovers. We love technology, work with passion, with enthusiasm, in a creative and collaborative...

  • Platform Engineer

    Há 4 dias

    Lisbon, Portugal Top Sigma, Lda Tempo inteiro

    JOB DETAILS: Location: Portugal (Portuguese residency required)Work model: Remote DESCRIPTION: Join our team as a Platform Engineer. You will optimize our cloud infrastructure, ensuring performance, scalability, and security. Your role includes overseeing the migration process, designing and maintaining the cloud platform, and integrating on-site systems...

  • Power Platform Developer

    Há 1 mês

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de IT.Somos uma multinacional que opera ativamente em Portugal e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • GCP Data Engineer

    2 semanas atrás

    Lisbon, Portugal NTT DATA Tempo inteiro

    Job Description Somos uma consultora multinacional de Negócios e Tecnologia que reinventa e transforma as organizações através da inovação e fomos considerados pela Gartner como uma das 10 maiores empresas de serviços de TI do mundo. Na NTTDATA somos Digital Lovers.Amamos a tecnologia, trabalhamos com paixão, com entusiasmo, num ambiente criativo e...

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal Causeway Technologies Tempo inteiro

    Data Engineer LisbonWho are we?We are ranked as the UK’s #1 construction specific software player and our mission is simple; to provide market leading end-to-end software solutions to the construction and construction like industries across the entire build life cycle.If you are looking to build an exceptional career with an award-winning company you’ve...

  • Data Engineer

    6 meses atrás

    Lisbon, Portugal Equação IT Tempo inteiro

    Data Engineer Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners. We are looking for a Data Engineer with the following requirements: Requirements: •...

  • Data Driven | Data Engineer

    Há 1 mês

    Lisbon, Portugal Devoteam Portugal Tempo inteiro

    Job DescriptionWe are looking for a Data Engineer with experience in Python and ETL processes to deliver high quality data tools and support the business.Key Responsibilities:Develop and design data pipelines/ETL in Python.Industrialize processes for full automation Assess client needs, understand the business and deliver a proper solution Build and design...