Data & Ai Engineer
2 semanas atrás
- ScalaKey responsibilities
- Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis
- Design and implement solutions to meet business requirements
- Support and maintain existing Hadoop applications and related technologies
- Develop and maintain metadata, user access and security controls
- Develop and maintain technical documentation, including data models, process flows and system diagrams Requirements
- Minimum 3 5 years of experience from Scala/Spark related projects and/or engagements
- Create Scala/Spark jobs for data transformation and aggregation as per the complex business requirements.
- Should be able work in a challenging and agile environment with quick turnaround times and strict deadlines.
- Perform Unit tests of the Scala code
- Raise PR, trigger build and release JAR versions for deployment via Jenkins pipeline
- Should be familiar with CI/CD concepts and the processes
- Peer review the code
- Perform RCA of the bugs raised
- Should have excellent understanding of Hadoop ecosystem
- Should be well versed with below technologies JenkinsHQL(Hive Queries)OozieShell scriptingGITSplunk Preferred
-
Lead Data Engineer
2 semanas atrás
Porto, Porto, Portugal Siemens Gas and Power GmbH & Co. KG Tempo inteiroAs a Lead Data Engineer (f/w/d), you will build and guide your team of Data Engineers who are responsible for enabling technically translated business requirements into analytical products, helping to bring new insights alive. As a leader, you will be at the forefront of our transformation journey to become a data driven company in future. Passionate about...
-
Data & AI Engineer
2 semanas atrás
Porto, Porto, Portugal Capgemini Tempo inteiroData Engineer - ScalaKey responsibilities Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis Design and implement solutions to meet business requirements Support and maintain existing Hadoop applications and related technologies Develop and maintain metadata, user access and security controls Develop and...
-
AI Manager
2 semanas atrás
Porto, Porto, Portugal Michael Page Tempo inteiroOur client is seeking a highly skilled and experienced Data Scientist, preferably with experience in NLP, Generative AI, LLMs, MLOps, Optimization techniques, and AI solution Architecture to build and lead the AI Tech Lab of the Group.In this role you will be key role in leading the development and implementation of AI solutions, leveraging your technical...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal DATA MART Consulting GmbH Tempo inteiroNeotalent Conclusion is one of the leading Iberian specialists providing services in Information Technology and Engineering services. As part of the Netherlands-based organization Conclusion, which has an ecosystem of over 25 companies and 3,600 employees, we are focused on increasing the technological capacity of our clients and the digital transformation...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal Employment Pro Limited Tempo inteiroBuscar vagas de emprego e oportunidades de carreiraEncontramos 161 vagas para Vagas de emprego data-engineer .Receba alerta de vagas em seu email. Registre-se agoraFunção: Data EngineerEmpresa: CodeWinTipo: Full-timeContrato: n/dLocalidade: Lisboa, PortoFunção: Data EngineerEmpresa: AltarioTipo:Full-timeContrato: Contrato sem termoLocalidade: Aveiro,...
-
Lead Data Engineer
2 semanas atrás
Porto, Porto, Portugal Siemens Gas And Power Gmbh & Co. Kg Tempo inteiroAs a Lead Data Engineer (f/w/d), you will build and guide your team of Data Engineers who are responsible for enabling technically translated business requirements into analytical products, helping to bring new insights alive. As a leader, you will be at the forefront of our transformation journey to become a data driven company in future. Passionate about...
-
Porto, Porto, Portugal Geomiq Tempo inteiroSenior Data Engineer (Hybrid) or Remote At Geomiq, we're inspired every day by our customers and teammates. Geomiq is the UK's leading Digital Manufacturing Marketplace. An innovative B2B MaaS (Manufacturing as a Service) platform and Artificial Intelligence (AI) powered system that connect buyers and sellers with unprecedented efficiency.Conventional...
-
AI Specialist
2 semanas atrás
Porto, Porto, Portugal BJSS Tempo inteiroAbout the Role We are strengthening our AI offering and are looking for an AI specialist to help businesses use artificial intelligence (AI) by understanding their needs, designing AI solutions, and implementing those solutions. BJSS AI specialists have expertise in machine learning, natural language processing, and other AI technologies. The successful...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal Dellent Consulting Tempo inteiroSe és um profissional apaixonado pelo universo automóvel e pela inovação na mobilidade, e queres enfrentar novos desafios, estás no sitio certo. Procuramos pessoas que queiram fazer parte de um projeto líder no setor, contribuindo para a transformação e excelência num ambiente dinâmico e desafiante. Procuramos um(a) Data Engineer para um projeto...
-
Data & Ai Engineer
2 semanas atrás
Porto, Porto, Portugal Capgemini Tempo inteiroKey responsibilities - Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis- Design and implement solutions to meet business requirements- Support and maintain existing Hadoop applications and related technologies- Develop and maintain metadata, user access and security controls- Develop and maintain technical...
-
Senior Sistems Engineer – Data Center
2 semanas atrás
Porto, Porto, Portugal DATA MART Consulting GmbH Tempo inteiroA equipa de Technical Services implementa as soluções vendidas pela Warpcom, apoia a pré-venda na fase de proposta técnica e assegura a 3a linha de suporte para os clientes suportados pelo Warpcom Command Center (NOC, SOC e IT Operations). Como Systems Engineer de Data Center & Cloud, vais fazer parte duma equipa especializada em soluções de...
-
Senior Data Engineer
2 semanas atrás
Porto, Porto, Portugal BJSS Tempo inteiroSenior Data Engineer Porto, Porto District Senior Data EngineerPorto Porto, Porto District, Portugal About the Role BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data...
-
Data Engineer
Há 7 dias
Porto, Porto, Portugal Shore Tempo inteiroNeste momento, estamos a recrutar para integração nos nossos clientes um Data Engineer. Conheça abaixo os detalhes da oportunidade.Requisitos: Licenciatura em Engenharia de Informática ou similar (preferencial) Experiência mínima de 3 anos com engenharia de dados Conhecimentos de ferramentas e tecnologias de dados, incluindo ETL/ELT, data warehousing,...
-
Data & Ai Engineer
2 semanas atrás
Porto, Porto, Portugal Capgemini Tempo inteiroKey responsibilities Develop Scala/Spark programs, scripts, and macros for data extraction, transformation and analysis Design and implement solutions to meet business requirements Support and maintain existing Hadoop applications and related technologies Develop and maintain metadata, user access and security controls Develop and maintain technical...
-
Senior Lecturer In Data Analytics And Ai
2 semanas atrás
Porto, Porto, Portugal Humana Portugal Tempo inteiroSenior Lecturer in Data Analytics and AISenior Lecturer in Data Analytics and AISenior Lecturer in Data Analytics and AI The Opportunity Porto Business School is actively seeking a dynamic individual to fill the position of a full-time senior Lecturer in Data Analytics and AI. The successful candidate will play a crucial role in shaping our academic...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal We Are META Tempo inteiroData Engineer (French Speaker) Porto Python,Pyspark,Hadoop,GCP,machine learning Are you a Data Engineer? Become a Rhino join the #crash We are META, more than a company a TEAM that will shake your idea about tech recruitment. Based in Évora but acting mainly in a remote way, we work with national and international partners in several areas with offices...
-
Data Lead
2 semanas atrás
Porto, Porto, Portugal Data Mart Consulting Gmbh Tempo inteiroThe role requires managing and optimizing data assets to support business objectives, focusing on defining data quality requirements and operational processes, developing data cleansing plans, and assessing current state data quality processes. The position emphasizes improving and monitoring data quality through multi-functional ERP programs and throughout...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal We Are Meta Tempo inteiroData Engineer (French Speaker)PortoPython,Pyspark,Hadoop,GCP,machine learning Are you a Data Engineer? Become a Rhino join the #crash We are META, more than a company a TEAM that will shake your idea about tech recruitment. Based in Évora but acting mainly in a remote way, we work with national and international partners in several areas with offices...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal AskBlue Tempo inteiroWe are currently looking for a Data Engineer to integrate one of your project teams in Lisbon or PortoMain Tasks: Develop and design data pipelines/ETL in Python; Industrialize processes for full automation; Assess client needs, understand the business and deliver a proper solution; Build and design visualization tools (e.g dashboards); Be the point of...
-
Data Engineer
2 semanas atrás
Porto, Porto, Portugal Dellent Consulting Tempo inteiroWould you like to make an impact in different industries with your work? Then this project is for you. Here you will have the opportunity to be part of a multicultural and inclusive team with global projection that contacts with areas such as consultancy, law, strategy, insurance, finance, among others. We are looking for a Data Engineer Azure to work in...