Data & Ai Engineer

2 semanas atrás


Porto, Porto, Portugal Capgemini Tempo inteiro
Key responsibilities

  • Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis
  • Design and implement solutions to meet business requirements
  • Support and maintain existing Hadoop applications and related technologies
  • Develop and maintain metadata, user access and security controls
  • Develop and maintain technical documentation, including data models, process flows and system diagrams
Requirements

  • Minimum 35 years of experience from Scala/Spark related projects and/or engagements
  • Create Scala/Spark jobs for data transformation and aggregation as per the complex business requirements.
  • Should be able work in a challenging and agile environment with quick turnaround times and strict deadlines.
  • Perform Unit tests of the Scala code
  • Raise PR, trigger build and release JAR versions for deployment via Jenkins pipeline
  • Should be familiar with CI/CD concepts and the processes
  • Peer review the code
  • Perform RCA of the bugs raised
  • Should have excellent understanding of Hadoop ecosystem
  • Should be well versed with below technologies
Preferred

  • Relevant certifications (e.g., Scala, Spark, Hadoop, Performance)
  • Knowledge of other programming languages (e.g., Python, R)
  • Insight to cloudbased solutions such as Snowflake
  • Experience in Financial Services, preferrable in the Credit risk domain
Ref. code
Posted on 03 Oct 2023
Experience level Experienced Professional
When you join Capgemini, you don't just start a new job. You become part of something bigger.

We bring together passionate, skilled people, a tech-driven approach to innovation, and a deep commitment to our clients to help organizations unlock the true value of technology.

As a graduate or an experienced professional, you will be working with the world's leading brands to enhance and transform the way they do business.

#J-18808-Ljbffr
  • Lead Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal Siemens Gas and Power GmbH & Co. KG Tempo inteiro

    As a Lead Data Engineer (f/w/d), you will build and guide your team of Data Engineers who are responsible for enabling technically translated business requirements into analytical products, helping to bring new insights alive. As a leader, you will be at the forefront of our transformation journey to become a data driven company in future. Passionate about...

  • Data & Ai Engineer

    2 semanas atrás


    Porto, Porto, Portugal Capgemini Tempo inteiro

    Data Engineer ScalaKey responsibilitiesDevelop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysisDesign and implement solutions to meet business requirementsSupport and maintain existing Hadoop applications and related technologiesDevelop and maintain metadata, user access and security controlsDevelop and maintain...

  • Data & AI Engineer

    2 semanas atrás


    Porto, Porto, Portugal Capgemini Tempo inteiro

    Data Engineer - ScalaKey responsibilities Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis Design and implement solutions to meet business requirements Support and maintain existing Hadoop applications and related technologies Develop and maintain metadata, user access and security controls Develop and...

  • AI Manager

    2 semanas atrás


    Porto, Porto, Portugal Michael Page Tempo inteiro

    Our client is seeking a highly skilled and experienced Data Scientist, preferably with experience in NLP, Generative AI, LLMs, MLOps, Optimization techniques, and AI solution Architecture to build and lead the AI Tech Lab of the Group.In this role you will be key role in leading the development and implementation of AI solutions, leveraging your technical...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal DATA MART Consulting GmbH Tempo inteiro

    Neotalent Conclusion is one of the leading Iberian specialists providing services in Information Technology and Engineering services. As part of the Netherlands-based organization Conclusion, which has an ecosystem of over 25 companies and 3,600 employees, we are focused on increasing the technological capacity of our clients and the digital transformation...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal Employment Pro Limited Tempo inteiro

    Buscar vagas de emprego e oportunidades de carreiraEncontramos 161 vagas para Vagas de emprego data-engineer .Receba alerta de vagas em seu email. Registre-se agoraFunção: Data EngineerEmpresa: CodeWinTipo: Full-timeContrato: n/dLocalidade: Lisboa, PortoFunção: Data EngineerEmpresa: AltarioTipo:Full-timeContrato: Contrato sem termoLocalidade: Aveiro,...

  • Lead Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal Siemens Gas And Power Gmbh & Co. Kg Tempo inteiro

    As a Lead Data Engineer (f/w/d), you will build and guide your team of Data Engineers who are responsible for enabling technically translated business requirements into analytical products, helping to bring new insights alive. As a leader, you will be at the forefront of our transformation journey to become a data driven company in future. Passionate about...


  • Porto, Porto, Portugal Geomiq Tempo inteiro

    Senior Data Engineer (Hybrid) or Remote At Geomiq, we're inspired every day by our customers and teammates. Geomiq is the UK's leading Digital Manufacturing Marketplace. An innovative B2B MaaS (Manufacturing as a Service) platform and Artificial Intelligence (AI) powered system that connect buyers and sellers with unprecedented efficiency.Conventional...

  • AI Specialist

    2 semanas atrás


    Porto, Porto, Portugal BJSS Tempo inteiro

    About the Role We are strengthening our AI offering and are looking for an AI specialist to help businesses use artificial intelligence (AI) by understanding their needs, designing AI solutions, and implementing those solutions. BJSS AI specialists have expertise in machine learning, natural language processing, and other AI technologies. The successful...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal Dellent Consulting Tempo inteiro

    Se és um profissional apaixonado pelo universo automóvel e pela inovação na mobilidade, e queres enfrentar novos desafios, estás no sitio certo. Procuramos pessoas que queiram fazer parte de um projeto líder no setor, contribuindo para a transformação e excelência num ambiente dinâmico e desafiante. Procuramos um(a) Data Engineer para um projeto...

  • Data & Ai Engineer

    2 semanas atrás


    Porto, Porto, Portugal Capgemini Tempo inteiro

    Key responsibilities - Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis- Design and implement solutions to meet business requirements- Support and maintain existing Hadoop applications and related technologies- Develop and maintain metadata, user access and security controls- Develop and maintain technical...


  • Porto, Porto, Portugal DATA MART Consulting GmbH Tempo inteiro

    A equipa de Technical Services implementa as soluções vendidas pela Warpcom, apoia a pré-venda na fase de proposta técnica e assegura a 3a linha de suporte para os clientes suportados pelo Warpcom Command Center (NOC, SOC e IT Operations). Como Systems Engineer de Data Center & Cloud, vais fazer parte duma equipa especializada em soluções de...

  • Senior Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal BJSS Tempo inteiro

    Senior Data Engineer Porto, Porto District Senior Data EngineerPorto Porto, Porto District, Portugal About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data...

  • Data Engineer

    Há 4 dias


    Porto, Porto, Portugal Shore Tempo inteiro

    Neste momento, estamos a recrutar para integração nos nossos clientes um Data Engineer. Conheça abaixo os detalhes da oportunidade.Requisitos: Licenciatura em Engenharia de Informática ou similar (preferencial) Experiência mínima de 3 anos com engenharia de dados Conhecimentos de ferramentas e tecnologias de dados, incluindo ETL/ELT, data warehousing,...


  • Porto, Porto, Portugal Humana Portugal Tempo inteiro

    Senior Lecturer in Data Analytics and AISenior Lecturer in Data Analytics and AISenior Lecturer in Data Analytics and AI The Opportunity Porto Business School is actively seeking a dynamic individual to fill the position of a full-time senior Lecturer in Data Analytics and AI. The successful candidate will play a crucial role in shaping our academic...

  • Data Lead

    2 semanas atrás


    Porto, Porto, Portugal Data Mart Consulting Gmbh Tempo inteiro

    The role requires managing and optimizing data assets to support business objectives, focusing on defining data quality requirements and operational processes, developing data cleansing plans, and assessing current state data quality processes. The position emphasizes improving and monitoring data quality through multi-functional ERP programs and throughout...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal We Are META Tempo inteiro

    Data Engineer (French Speaker) Porto Python,Pyspark,Hadoop,GCP,machine learning Are you a Data Engineer? Become a Rhino join the #crash We are META, more than a company a TEAM that will shake your idea about tech recruitment. Based in Évora but acting mainly in a remote way, we work with national and international partners in several areas with offices...

  • AI Tech Lab Manager

    Há 4 dias


    Porto, Porto, Portugal Euronext Tempo inteiro

    ProfileEuronext is the leading pan-European exchange with a unique federal model, in a mission to accelerate innovation and sustainable development across Europe. From raising equity to traded products, issuer services to market data, Euronext addresses the needs of marketplaces, investors and companies, playing a crucial role in connecting European...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal We Are Meta Tempo inteiro

    Data Engineer (French Speaker)PortoPython,Pyspark,Hadoop,GCP,machine learning Are you a Data Engineer? Become a Rhino join the #crash We are META, more than a company a TEAM that will shake your idea about tech recruitment. Based in Évora but acting mainly in a remote way, we work with national and international partners in several areas with offices...

  • Data Engineer

    2 semanas atrás


    Porto, Porto, Portugal AskBlue Tempo inteiro

    We are currently looking for a Data Engineer to integrate one of your project teams in Lisbon or PortoMain Tasks: Develop and design data pipelines/ETL in Python; Industrialize processes for full automation; Assess client needs, understand the business and deliver a proper solution; Build and design visualization tools (e.g dashboards); Be the point of...