Data Engineer Databricks

Há 5 dias

Leiria, Portugal syffer Tempo inteiro

Syffer is an all-inclusive consulting company focused on talent, tech and innovation. We exist to elevate companies and humans all around the world, making change, from the inside to the outside. We believe that technology + human kindness positively impacts every community around the world. Our approach is simple, we see a world without borders, and believe in equal opportunities. We are guided by our core principles of spreading positivity, good energy and promote equality and care for others. Our hiring process is unique People are selected by their value, education, talent and personality. We dont present ethnicity, religion, national origin, age, gender, sexual orientation or identity. Its time to burst the bubble, and we will do it together What You'll do: Design and implement a common Python library for Databricks used across batch and streaming data pipelines; Develop reusable PySpark modules and abstract classes for Bronze, Silver, and Gold processing layers; Collaborate with other engineers to ensure coding standards, documentation, and testing practices are followed; Maintain CI/CD integration with GitLab and Databricks Asset Bundles (DABs); Work closely with DataOps to ensure library updates are stable and observable in production; Integrate monitoring and logging standards using Grafana and DQX for data quality validation; Work within Databricks, Airflow on AKS, and Terraform-managed infrastructure; Ensure smooth library deployment, versioning, and package management across environments; Collaborate with DataOps to enforce secure and performant runtime environments; Utilize stack components including Talend, Azure ADLS Gen2, Azure Databricks, Airflow (AKS), Terraform, SQL, Python, PySpark, Grafana, Kafka (Aiven), GitLab, Databricks Asset Bundles (DABs), and DQX (Data Quality Framework); Hybrid Work Model; What You Are: Proven experience with Databricks, PySpark, and Python library design; Strong software engineering background OOP, testing, CI/CD, and abstraction principles; Understanding of both batch and streaming data processing; Knowledge of Medallion Architecture and data lifecycle best practices; Familiarity with Airflow (AKS), Terraform, and Azure ADLS Gen2; Fluent in Portuguese and English; What youll get: Wage according to candidate's professional experience; Remote Work whenever possible; Allocation of health insurance from the beginning of the employment; Delivery of work equipment adjusted to the performance of functions; And others. Work together with expert teams on projects of large magnitude and intensity, long term together with our clients, all leaders in their industries. Are you ready to step into a diverse and inclusive world with us? Together we will promote uniquess

  • Data Engineer Databricks

    Há 5 dias

    Leiria, Leiria, Portugal syffer Tempo inteiro

    Syffer is an all-inclusive consulting company focused on talent, tech and innovation. We exist to elevate companies and humans all around the world, making change, from the inside to the outside.We believe that technology + human kindness positively impacts every community around the world. Our approach is simple, we see a world without borders, and believe...

  • Data Engineer

    3 semanas atrás

    Leiria, Portugal SuperAwesome Tempo inteiro

    Data Engineer Portugal (Lisbon) Remote Full-time SuperAwesome is an award-winning technology company that powers the youth digital ecosystem, helping brands to meet their audience where they are. We bring together proprietary advertising and gaming products, audience insights, and compliance capabilities to help build a safer internet for the next...

  • Data Engineer

    3 semanas atrás

    Leiria, Portugal CloudDevs Tempo inteiro

    About Us At Stark & Partners, we’re transforming Portugal into Europe’s premier talent hotspot. As a rapidly growing ScaleUp, we build exceptional teams and establish strategic locations for international innovation leaders. We’ve ditched traditional hierarchies for flat structures and authentic communication. Our philosophy is simple: employees come...

  • Senior Data Engineer

    2 semanas atrás

    Leiria, Leiria, Portugal 28Stone Tempo inteiro 35 800 € por ano

    At 28Stone, we specialize in delivering tailored software solutions for the financial services industry, working closely with major institutions in the US and UK to build high-performance systems for global capital markets. With over 200 professionals across North America and EMEA, we are a global IT consulting firm known for deep domain expertise and a...

  • Senior Data Engineer

    2 semanas atrás

    Leiria, Portugal Descompagnons Trabalho Temporário Lda Tempo inteiro

    TMC is an international technological engineering company that brings expertise to its clients. All around the world TMC supports them with the realization of their technological challenges. Based on a unique Employeneurship model, TMC unites scientists, researchers or engineers with passion for all aspects of technology and a fascination for large and...

  • Data Engineer Databricks

    Há 5 dias

    Leiria, Portugal Hexa Consulting Tempo inteiro

    About the Project Our client, 28Stone, specializes in delivering tailored software solutions for the financial services industry, working closely with major institutions in the US and UK to build high-performance systems for global capital markets. With over 200 professionals across North America and EMEA, they are a global IT consulting firm known for deep...

  • Senior Data Engineer

    1 semana atrás

    Leiria, Portugal Asenium Consulting Tempo inteiro

    Estamos à procura de um(a) Data Engineer experiente para integrar um projeto de grande escala com atuação internacional. Local de trabalho: 100% remoto desde Portugal Requisitos obrigatórios: 5+ anos de experiência profissional como Data Engineer ; Conhecimentosem arquitetura de dados , pipelines ETL/ELT e modelagem de dados ; Experiência

  • Data Engineer

    Há 4 dias

    Leiria, Portugal Aubay Portugal Tempo inteiro

    Your connection with Aubay starts in the following lines: Aubay Portugal is a multinational French company, in Portugal since 2007. We have offices in Lisbon and Oporto and we are a specialized consultant in Management, Implementation, Development and Maintenance of Information Systems. We have more than 150 active partners and we operate in sectors such as...

  • Senior Data Engineer

    1 semana atrás

    Leiria, Portugal Asenium Consulting Tempo inteiro

    Procura-se um Data Engineer experiente para projeto internacional. Irá projetar, desenvolver e manter pipelines de dados.

  • Backend Engineer | Data Layer

    2 semanas atrás

    Leiria, Portugal Affinity Tempo inteiro

    Data Engineer Portugal (Lisbon) Remote Full-time SuperAwesome is an award-winning technology company that powers the youth digital ecosystem, helping brands to meet their audience where they are. We bring together proprietary advertising and gaming products, audience insights, and compliance capabilities to help build a safer internet for the next...