Data Platform Engineer

2 meses atrás

Lisbon, Portugal ComplyAdvantage Tempo inteiro
What you will be doing :

Are you a highly skilled Data Platform Engineer with a passion for cutting-edge technology and a desire to make a real impact? Join our innovative team at ComplyAdvantage, where you'll design, manage, monitor, and optimise a diverse array of data systems running on AWS and GCP. Your expertise will ensure the seamless operation of SQL, NoSQL, Kafka, and Spark-based data layers, supporting our global client base.

Key Responsibilities:

  • Innovative Design and Maintenance: Develop and sustain data layer orchestration systems, managing self-managed and PaaS data layer technologies, and ensure data consistency while designing databases.
  • Performance and Availability: Oversee data layer components on AWS and GCP, guaranteeing top performance and reliability. Conduct regular performance tuning and troubleshoot issues.
  • Backup and Cost Management: Configure and deploy robust backup systems for databases, Kafka, and Spark, ensuring data integrity and enabling disaster recovery. Implement cost management strategies to optimise resource utilisation.
  • Documentation and Collaboration: Maintain thorough documentation for all Data Infrastructure engineering processes. Work closely with various teams to integrate data sources and support application requirements, adhering to best practices.
  • Capacity and Project Planning: Monitor and manage data infrastructure capacity, planning for future growth and scalability. Collaborate with stakeholders to define and prioritise engineering projects, setting realistic timelines and expectations.
  • Technical Support: Provide guidance and support to engineering team members on database and data layer architecture and technologies. Collaborate with Software Engineers to develop resilient data sharding strategies.

Our Tech Stack:

  • Cloud-Based Infrastructure: Fully cloud-based with a Kubernetes-focused tech stack. Compute workloads run in Kubernetes clusters across multiple regions.
  • Infrastructure Management: Heavy use of Terraform and Helm, adhering to GitOps paradigms for managing cloud infrastructure and Kubernetes applications.
  • Core Technologies: Extensive use of Kafka, distributed PostgreSQL and Cassandra QL, Elasticsearch, and Databricks/Spark. Development of inter-cloud failover options to support multi-cloud plans.
  • Wide Array of Applications: Teams build and release containerised applications for low latency APIs, machine learning models, and data processing pipelines.

About You:

  • Experience: Significant expertise with AWS and/or GCP core services, data systems (Apache Kafka, Apache Spark, Elasticsearch, PostgreSQL, Cassandra), and Kubernetes. Experience codifying infrastructure in Terraform and/or Helm charts.
  • Cost and Performance: Awareness of cost and performance considerations in designing data systems architectures. Proficiency with logging, monitoring, and tracing tools.
  • CI/CD and Security: Familiarity with CI tooling, test pipelines, and asset generation (e.g., Docker images, Helm charts). Understanding of security considerations in data systems.
  • Data Modelling: Experience with data modelling, sharding, and indexing strategies for large-scale databases.

Nice to Have:

  • Experience running distributed databases within Kubernetes.
  • Familiarity with distributed SQL and NoSQL databases such as Yugabyte, Cockroach, Spanner, HBase, or CouchDB.

Education:

  • BSc/BA degree in computer science, engineering, or related discipline OR equivalent experience in required skills

What’s in it for you?

  • Equity as we want you to have a part of what we are building
  • Unlimited Time Off Policy- A work-life balance and focus on our well-being are critical to keeping us performing at our best
  • We embrace a hybrid approach that requires employees to be in the office for two days a week. We strongly believe that this approach fosters collaboration and enables the building of meaningful relationships
  • You will also get a new starter budget to kit out your home office
  • Opportunity to work on innovative projects with smart-minded people keen to share their knowledge and continuously improve
  • Annual learning budget (prorated based on start date) to drive your performance and career development

About us:

ComplyAdvantage is the financial industry’s leading source of AI-driven financial crime risk data and detection technology. Our mission is to neutralise the risk of money laundering, terrorist financing, corruption, and other financial crime.

More than 1000 companies rely on us to understand the risk of who they’re doing business with through the world’s only global, real-time database of people and companies. Our solutions identify thousands of risk events daily from millions of structured and unstructured data points.

We have five global hubs in New York, London, Singapore, Lisbon and Cluj-Napoca and are backed by Goldman Sachs, Ontario Teachers, Index Ventures, and Balderton Capital.

Since 2014, we have raised over $100 million in funding, and in 2022 alone grew by over 40% to over 500 people globally. Over the next 12 months, as our revenue increases, we plan to increase to 600.

At ComplyAdvantage diversity fuels our rocket ship and our commitment to inclusion across race, gender, age, religion, identity and experience drives us forward every day. We encourage everyone to apply and aspire to consider every application fairly.

We will handle your information in accordance with our Privacy Policy. For further information, please click

  • Data Engineer

    Há 1 mês

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer

    1 semana atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer

    1 semana atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Engineer

    4 semanas atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera activamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Engineer

    1 semana atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera activamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer

    1 semana atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer | Azure

    2 meses atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Muito Gosto! Somos o Grupo DATA!O nosso propósito é simplificar a vida dos nossos clientes e fazemos isso em todo o mundo, através das nossas soluções de TI.Somos uma multinacional que opera ativamente em Portugal, e estamos em constante expansão!Adoramos trabalhar com grandes empresas e fazer crescer as empresas com as quais colaboramos....

  • Data Architect

    4 semanas atrás

    Lisbon, Portugal Grupo Data Tempo inteiro

    Hi! We are DATA Group and we are searching for the best talent! Our goal is to simplify our clients' lives with innovative IT solutions. We operate at global scale and we are expanding to Portugal! If you are passionate and have the desire to make the difference, we want to get to know you! Join us to be part of this incredible adventure! Who are we looking...

  • Data Engineer

    3 semanas atrás

    Lisbon, Portugal Miniclip Tempo inteiro

    Job Description Do you love working with Big Data? Miniclip is looking for a driven and motivated to join our dynamic team. If you're passionate about data and eager to build innovative solutions, this is the perfect opportunity for you! As a Data Engineer at Miniclip, you will play a key role in the development, testing, and maintenance of our data...

  • Data Analyst/ Data Engineer

    7 meses atrás

    Lisbon, Portugal Equação IT Tempo inteiro

    Data Analyst/ Data Engineer Equação IT is a company focused on boosting technology and solid solutions through our expert consultants leading a high perspective and adding value to our customers with the purpose of providing optimization and business growth to our partners. We are looking for a Data Analyst/ Data Engineer with the following...

  • Azure Data Engineer

    3 semanas atrás

    Lisbon, Portugal Alter Solutions Tempo inteiro

    Job DescriptionWe are in an exciting phase of transforming our Azure Data Platform to enable Advanced Analytics, consolidating existing data, expanding outcomes, and optimizing functionality. In this context, we are looking for an Azure Data Engineer to join our dynamic team.Role Responsibilities:Design, build, and optimize data pipelines for the Azure Data...

  • Azure Data Engineer

    3 semanas atrás

    Lisbon, Portugal ALTER SOLUTIONS Tempo inteiro

    Job Description We are in an exciting phase of transforming our Azure Data Platform to enable Advanced Analytics, consolidating existing data, expanding outcomes, and optimizing functionality. In this context, we are looking for an Azure Data Engineer to join our dynamic team. Role Responsibilities: Design, build, and optimize data pipelines for...

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal ComplyAdvantage Tempo inteiro

    What you will be doing : We are looking for talented Data Engineers to help us build our internal Platform solutions as well as provide insights to our customers. By giving our customers actionable insights, we enable them to be agile with their compliance operations, iterating on how they tune their search and transaction monitoring parameters. You will...

  • Senior Data Engineer

    7 meses atrás

    Lisbon, Portugal BJSS Tempo inteiro

    About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data solutions in order to deliver business value.As a BJSS data engineer you’ll help our clients deploy data...

  • Data Engineer

    3 meses atrás

    Lisbon, Portugal Landing.jobs Tempo inteiro

    At Engine B (Permanent), in Lisbon, Portugal Expires at: 2025-03-01 Remote policy: Partial remote Engine B, founded in 2018, specializes in generative AI tools that automate complex tasks in professional services, enhancing decision-making and improving service quality. In 2024, Engine B was acquired by CliftonLarsonAllen (CLA), combining our AI expertise...

  • Data Engineer

    3 meses atrás

    Lisbon, Portugal Landing.jobs Tempo inteiro

    At Engine B (Permanent), in Lisbon, PortugalExpires at: 2025-03-01Remote policy: Partial remoteEngine B, founded in 2018, specializes in generative AI tools that automate complex tasks in professional services, enhancing decision-making and improving service quality. In 2024, Engine B was acquired by CliftonLarsonAllen (CLA), combining our AI expertise with...

  • Data Engineer

    2 meses atrás

    Lisbon, Portugal Sky Tempo inteiro

    Join us at Sky Portugal and be part of our exciting journey to lead the way in the streaming tech world! As a  Data Engineer , you'll play a key role in our innovative team dedicated to creating exceptional experiences for our global customers. From powering platforms like NBCUniversal’s Peacock in the United States to Sky’s NOW, and SkyShowtime...

  • Data Engineer

    Há 1 mês

    Lisbon, Portugal Boost-IT Tempo inteiro

    Boost IT is a Portuguese technology consultancy company, we are integrated into one of the most entrepreneurial groups in Portugal, with investment in more than 30 companies.We want to be known for being the most dynamic, energetic and reliable company to operate in the market and, for that, we want to count on you.If you're passionate about technology and...

  • Platform Engineer

    Há 1 mês

    Lisbon, Portugal Top Sigma, Lda Tempo inteiro

    JOB DETAILS: Location: Portugal (Portuguese residency required)Work model: Remote DESCRIPTION: Join our team as a Platform Engineer. You will optimize our cloud infrastructure, ensuring performance, scalability, and security. Your role includes overseeing the migration process, designing and maintaining the cloud platform, and integrating on-site systems...