Data Driven | Azure Databricks Data Engineer
Há 1 mês
Company Description
At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B. We believe in transforming technology to create value for our clients, partners and employees in a world where technology is developed for people. We are proud of the culture we have built together. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople. Join our multidisciplinary team of Cloud experts, Designers, Business consultants, Security experts, Engineers, Developers and other extraordinary talents, spread across more than 20 EMEA countries. Become one of our tech and business leaders on cloud, data and cyber security. Let’s fuse creativity with technology together and build innovative solutions that actively change things for the better.
Job Description
The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. He/she will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities. His/her role will involve close collaboration with data scientists, analysts, and other stakeholders to deliver data-driven solutions.
Key Responsibilites:
• Collaborate in the design, construction, installation, tests, and maintenance of highly scalable data management systems using Azure Databricks.
• Develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities.
• Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
• Ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.
• Collaborate with data architects to implement effective data models and schemas within the Databricks environment.
• Monitor data reliability, efficiency, and quality, and implement improvements as needed.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Develop and maintain documentation related to data pipeline architecture, development processes, and data governance;
• Stay current with industry trends and developments in cloud computing, big data, and Azure Databricks.
Qualifications
• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or proven experience in a similar field.
• Proven experience as a Data Engineer with a focus on Azure Databricks and related Azure services.
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience with Apache Spark and its integration with Databricks.
• Proficiency in SQL and experience with data modeling and data warehousing concepts.
• Familiarity with DevOps practices and CI/CD pipelines.
• Excellent analytical and problem-solving abilities.
• Effective communication skills in English and Portuguese and the ability to work collaboratively in a team environment.
Additional Information
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
-
Porto, Portugal Devoteam Portugal Tempo inteiroJob Description The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks.He/she will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities.His/her role will involve close collaboration with data scientists,...
-
Porto, Portugal Devoteam Portugal Tempo inteiroJob DescriptionThe Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. He/she will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities. His/her role will involve close collaboration with data scientists,...
-
Porto, Portugal Devoteam Tempo inteiroCompany DescriptionAt Devoteam, we believe that technology with strong human values can actively drive change for the better.Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us.We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of...
-
Azure Databricks Data Engineer Position
4 semanas atrás
Porto, Porto, Portugal Devoteam Portugal Tempo inteiroJob OpportunityAzure Databricks Data EngineerWe are seeking an experienced Data Engineer to join our team at Devoteam Portugal. This role involves building and maintaining a highly scalable data ecosystem using Azure Databricks, collaborating with data scientists and analysts to deliver data-driven solutions, and staying current with industry trends and...
-
Porto, Porto, Portugal Devoteam Tempo inteiroAt Devoteam, we transform technology to create value for our clients, partners and employees in a world where technology is developed for people.We are proud of the culture we have built together. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople.Join our multidisciplinary team of...
-
Data Driven Specialist
Há 1 mês
Porto, Porto, Portugal Devoteam Portugal Tempo inteiro**Data Engineer - Azure Databricks**We are looking for a talented Data Engineer to join our team at Devoteam Portugal. As a Data Engineer, you will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks.Your role will involve developing and managing data pipelines, ensuring data quality, and enabling advanced analytics...
-
Azure - Data Engineer
2 meses atrás
Porto, Portugal Timestamp - Sistemas De Informação, Sa Tempo inteiroTimestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification. Role: Azure - Data Engineer Deliverables: ·...
-
Azure - Data Engineer
2 meses atrás
Porto, Portugal Timestamp - Sistemas De Informação, Sa Tempo inteiroTimestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification.Role: Azure - Data EngineerDeliverables:Design of...
-
Azure Data Engineer
2 meses atrás
Porto, Portugal Dellent Tempo inteiroDellent is a consulting company focused in System Information and Telecommunications. Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations. We are looking for a Azure Data Engineer to work in a project hybrid or remote in Lisbon or Porto . This project is for...
-
Data Engineer
4 meses atrás
Porto, Portugal Grit Solutions Tempo inteiroData Engineer - Azure Building Data Highways: Data Engineer Position Available! There's no secret to being number-one; it takes willingness to improve and determination to pursue it. At GRiT®,?it's all about the journey to get there. We believe talent and intelligence are important, yet passion and perseverance are the key to achieving any goal. We are...
-
Senior Data Engineer: Azure Data Engineering Expert
2 meses atrás
Porto, Porto, Portugal Phiture Tempo inteiroRole OverviewWe are looking for a skilled Data Engineer to join our team at Phiture. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign, develop, and maintain data pipelines using Azure Data Factory, Databricks, and Azure DevOpsWork closely with the engineering team to...
-
Data Engineer with Azure Expertise
Há 1 mês
Porto, Porto, Portugal Phiture Tempo inteiroCompany OverviewWe Are META is a consulting firm that specializes in finding the perfect match between our clients and talented professionals. Our mission is to provide top-notch services that exceed expectations.SalaryThe estimated annual salary for this position is around €80,000 - €110,000 depending on experience, with additional benefits such as...
-
Data Engineer
6 meses atrás
Porto, Portugal Dellent Consulting Tempo inteiroWould you like to make an impact in different industries with your work? Then this project is for you. Here you will have the opportunity to be part of a multicultural and inclusive team with global projection that contacts with areas such as consultancy, law, strategy, insurance, finance, among others. We are looking for a Data Engineer - Azure to work in...
-
Highly Skilled Azure Data Engineer
4 semanas atrás
Porto, Porto, Portugal Kcs It Tempo inteiroAbout the RoleWe are seeking an exceptional Azure Data Engineer to join our team at KCS IT. As a key member of our organization, you will be responsible for designing and implementing data solutions using Azure cloud technologies.Job OverviewThis is a Full Remote position in Portugal, ideal for those who value flexibility and remote work. We offer a highly...
-
Azure Data Engineer
6 meses atrás
Porto, Portugal Link Consulting Tempo inteiroAt Link Consulting (Permanent / Contractor), in Maia, Portugal Expires at: ******** Remote policy: Partial remote Are you a Technology enthusiast, searching for new challenges, a new career path, where you can expand your core base of expertise? If so…this challenge is for you! Link Consulting is a Portuguese IT services company, Portugal, which,...
-
Azure Data Solutions Engineer
2 meses atrás
Porto, Porto, Portugal Link Consulting Tempo inteiroAbout Link ConsultingLink Consulting is a pioneering IT services company in Portugal, dedicated to supporting clients overcome business challenges through innovative .Net solutions.Job OverviewWe are seeking an experienced Data Engineer to join our team of specialists in Maia, Porto. As a key contributor, you will develop and provide .Net solutions in a...
-
Data Engineer
4 meses atrás
Porto, Portugal Grit Solutions Tempo inteiroData Engineer Building Data Highways: Data Engineer Position Available! There's no secret to being number-one; it takes willingness to improve and determination to pursue it. At GRiT®,?it's all about the journey to get there. We believe talent and intelligence are important, yet passion and perseverance are the key to achieving any goal. We are Tech...
-
Data Platform Engineer
4 semanas atrás
Porto, Portugal Noesis Portugal Tempo inteiroNoesis is looking for candidates with the following profile: Main Key Responsibilities: Linux System Administrator Azure Data Platform Engineering (Databricks, Data Factory, Azure Machine Learning, Event Hub and Log Analytics) Azure infrastructure (networks, virtual machines, firewall, backups); Requirements: Bachelor's degree or higher in Information...
-
Data Engineering Specialist
2 meses atrás
Porto, Porto, Portugal Kcs It Tempo inteiroAbout the Role We are seeking a talented Data Engineer with Azure expertise to join our team at KCS IT. If you have a passion for building and maintaining large-scale data systems, we want to hear from you. Key Responsibilities • Design, implement, and maintain data warehouses and data pipelines using Azure Data Factory, Azure Databricks, and Azure SQL...
-
Porto, Porto, Portugal Metyis Ag Tempo inteiroMetyis Ag, a global forward-thinking firm, is seeking an experienced Data Engineer to join its Data and Analytics team in Porto. We offer a competitive salary of approximately €75,000 per annum.Company Overview:Metyis Ag operates across various industries, providing Big Data, Digital Commerce, Marketing & Design solutions, and Advisory services. Our...