Data Engineer

Há 5 dias

Braga, Portugal Match Profiler Tempo integral

Описание
Match Profiler is an Information Systems consultancy with over 25 years of experience in the national and international technology market.
The company develops solutions that drive business growth through innovation, trust, and security.
Задачи
Develop Datalake pipelines using Python and PySpark;
Analyze requirements andpropose architecture solutions within the Datalake;
Gather, document, examine, and manage application requirements in an Agile environment;
Implement use cases ranging from basic to complex;
Promote efficiencyand automation;
Maintain existing processes and support technical needs of other users;
Collaborate with business users, analysts, and developers to deliver data-driven solutions;
Contribute to local initiatives and projects from assessment and use case identification to implementation and industrialization;
Suggest improvements forexisting processes, particularly regarding performance.
Требования
At least 4 years of professional experience in BigData and NoSQL technologies (Hadoop, HDFS, Hive, Kerberos, Starburst);
Experience with Visual Studio Code or similar frameworks;
Experience with Python and PySpark;
Knowledge of data modeling principles and SQL;
Familiarity with DevOps concepts (Git, Jenkins, XL Deploy, XL Release);
English level B2 or higher;
Analytical mindsetwith the ability to identify patterns and trends;
Ability to communicate data insights to stakeholders;
Experience with Agile methodologies (Scrum/Kanban);
Ability to work inan international and distributed team;
Availability to travel abroad for short periods;
Nice to have: Optimization and performance improvement experience (Shell Script, Execution plan);
Nice to have: knowledge in PowerBI, PowerApps, PowerAutomate, Microsoft Certifications (PL-100, PL-200, PL-300, PL-400, PL-500, PL-600, PL-700, PL-900, DP-X00);
Nice to have: administration of SharePoint Online and Dataverse, experience with REST APIs, SSAS, SSIS, Azure, and proficiency in French.
Условия
Base salary: **€ – **€ gross per year;
Meal allowance of 7,50€ per day via meal card;
Health insurance for theemployee with an option to extend to family;
Annual performancebonusbased on individual and company objectives.
#J-*-Ljbffr