Data Driven | Azure Databricks Data Engineer
Há 1 mês
The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks. He/she will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities. His/her role will involve close collaboration with data scientists, analysts, and other stakeholders to deliver data-driven solutions.
Key Responsibilites:
• Collaborate in the design, construction, installation, tests, and maintenance of highly scalable data management systems using Azure Databricks.
• Develop data processing pipelines using Databricks Notebooks, Spark SQL, and other Databricks utilities.
• Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DB.
• Ensure optimal performance of data processing and extraction, transformation, and loading (ETL) processes.
• Collaborate with data architects to implement effective data models and schemas within the Databricks environment.
• Monitor data reliability, efficiency, and quality, and implement improvements as needed.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Develop and maintain documentation related to data pipeline architecture, development processes, and data governance;
• Stay current with industry trends and developments in cloud computing, big data, and Azure Databricks.
Qualifications
• Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or proven experience in a similar field.
• Proven experience as a Data Engineer with a focus on Azure Databricks and related Azure services.
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience with Apache Spark and its integration with Databricks.
• Proficiency in SQL and experience with data modeling and data warehousing concepts.
• Familiarity with DevOps practices and CI/CD pipelines.
• Excellent analytical and problem-solving abilities.
• Effective communication skills in English and Portuguese and the ability to work collaboratively in a team environment.
Additional Information
The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.
-
Porto, Portugal Devoteam Portugal Tempo inteiroJob Description The Azure Databricks Data Engineer will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks.He/she will be responsible for developing and managing data pipelines, ensuring data quality, and enabling advanced analytics capabilities.His/her role will involve close collaboration with data scientists,...
-
Porto, Portugal Devoteam Tempo inteiroCompany DescriptionAt Devoteam, we believe that technology with strong human values can actively drive change for the better.Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us.We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of...
-
Porto, Portugal Devoteam Tempo inteiroCompany Description At Devoteam, we believe that technology with strong human values can actively drive change for the better. Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us. We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue...
-
Azure Databricks Data Engineer Position
3 semanas atrás
Porto, Porto, Portugal Devoteam Portugal Tempo inteiroJob OpportunityAzure Databricks Data EngineerWe are seeking an experienced Data Engineer to join our team at Devoteam Portugal. This role involves building and maintaining a highly scalable data ecosystem using Azure Databricks, collaborating with data scientists and analysts to deliver data-driven solutions, and staying current with industry trends and...
-
Azure Databricks Data Engineer Specialist
4 semanas atrás
Porto, Porto, Portugal Devoteam Tempo inteiroAt Devoteam, we transform technology to create value for our clients, partners and employees in a world where technology is developed for people.We are proud of the culture we have built together. We are proud of our people at the service of technology. We are proud of our diverse environment. Because we are #TechforPeople.Join our multidisciplinary team of...
-
Data Driven Specialist
Há 1 mês
Porto, Porto, Portugal Devoteam Portugal Tempo inteiro**Data Engineer - Azure Databricks**We are looking for a talented Data Engineer to join our team at Devoteam Portugal. As a Data Engineer, you will be instrumental in building and maintaining an optimized data ecosystem using Azure Databricks.Your role will involve developing and managing data pipelines, ensuring data quality, and enabling advanced analytics...
-
Azure - Data Engineer
2 meses atrás
Porto, Portugal Timestamp - Sistemas De Informação, Sa Tempo inteiroTimestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification. Role: Azure - Data Engineer Deliverables: ·...
-
Azure - Data Engineer
2 meses atrás
Porto, Portugal Timestamp - Sistemas De Informação, Sa Tempo inteiroTimestamp Group aggregates several leading Portuguese IT solutions and services companies around the concepts of excellence and knowledge sharing. We are committed to technological leadership, based on the quality of our service and technological solutions, supported by continuous training and certification.Role: Azure - Data EngineerDeliverables:Design of...
-
Azure Data Engineer
2 meses atrás
Porto, Portugal Dellent Tempo inteiroDellent is a consulting company focused in System Information and Telecommunications. Our goal is to help our candidates and consultants to take a step forward in their careers through projects that meet their needs and expectations. We are looking for a Azure Data Engineer to work in a project hybrid or remote in Lisbon or Porto . This project is for...
-
Data Engineer
4 meses atrás
Porto, Portugal Grit Solutions Tempo inteiroData Engineer - Azure Building Data Highways: Data Engineer Position Available! There's no secret to being number-one; it takes willingness to improve and determination to pursue it. At GRiT®,?it's all about the journey to get there. We believe talent and intelligence are important, yet passion and perseverance are the key to achieving any goal. We are...
-
Senior Data Engineer: Azure Data Engineering Expert
2 meses atrás
Porto, Porto, Portugal Phiture Tempo inteiroRole OverviewWe are looking for a skilled Data Engineer to join our team at Phiture. As a Data Engineer, you will play a crucial role in designing, building, and maintaining our data infrastructure.Key ResponsibilitiesDesign, develop, and maintain data pipelines using Azure Data Factory, Databricks, and Azure DevOpsWork closely with the engineering team to...
-
Data Engineer with Azure Expertise
Há 1 mês
Porto, Porto, Portugal Phiture Tempo inteiroCompany OverviewWe Are META is a consulting firm that specializes in finding the perfect match between our clients and talented professionals. Our mission is to provide top-notch services that exceed expectations.SalaryThe estimated annual salary for this position is around €80,000 - €110,000 depending on experience, with additional benefits such as...
-
Data Engineer
6 meses atrás
Porto, Portugal Dellent Consulting Tempo inteiroWould you like to make an impact in different industries with your work? Then this project is for you. Here you will have the opportunity to be part of a multicultural and inclusive team with global projection that contacts with areas such as consultancy, law, strategy, insurance, finance, among others. We are looking for a Data Engineer - Azure to work in...
-
Data Management Specialist
2 meses atrás
Porto, Portugal Phiture Tempo inteiroSeeking a Data Management Specialist (with Azure Databricks): Rhino, are you there?At WE ARE META, we focus on finding the perfect match between our Rhinos and our clients.Why join us? Expand your network: As a consultant at We Are META, you'll have access to a network of national and international partners across diverse sectors of the tech industry.Enjoy...
-
Highly Skilled Azure Data Engineer
4 semanas atrás
Porto, Porto, Portugal Kcs It Tempo inteiroAbout the RoleWe are seeking an exceptional Azure Data Engineer to join our team at KCS IT. As a key member of our organization, you will be responsible for designing and implementing data solutions using Azure cloud technologies.Job OverviewThis is a Full Remote position in Portugal, ideal for those who value flexibility and remote work. We offer a highly...
-
Azure Cloud Data Engineer
Há 1 mês
Porto, Porto, Portugal Timestamp - Sistemas De Informação, Sa Tempo inteiroRole OverviewAt Timestamp - Sistemas De Informação, Sa, we are seeking an experienced Azure Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and implementing technical solutions covering the needs of our clients, including data modeling, integration flows, and data mapping.Key ResponsibilitiesDesign and implement...
-
Azure Data Engineer
6 meses atrás
Porto, Portugal Link Consulting Tempo inteiroAt Link Consulting (Permanent / Contractor), in Maia, Portugal Expires at: ******** Remote policy: Partial remote Are you a Technology enthusiast, searching for new challenges, a new career path, where you can expand your core base of expertise? If so…this challenge is for you! Link Consulting is a Portuguese IT services company, Portugal, which,...
-
Data Management Specialist
2 meses atrás
Porto, Portugal Phiture Tempo inteiroSeeking a Data Management Specialist (with Azure Databricks): Rhino, are you there? At WE ARE META, we focus on finding the perfect match between our Rhinos and our clients.Why join us?Expand your network: As a consultant at We Are META, you'll have access to a network of national and international partners across diverse sectors of the tech industry.Enjoy...
-
Azure Data Solutions Engineer
Há 1 mês
Porto, Porto, Portugal Link Consulting Tempo inteiroAbout Link ConsultingLink Consulting is a pioneering IT services company in Portugal, dedicated to supporting clients overcome business challenges through innovative .Net solutions.Job OverviewWe are seeking an experienced Data Engineer to join our team of specialists in Maia, Porto. As a key contributor, you will develop and provide .Net solutions in a...
-
Data Engineer
4 meses atrás
Porto, Portugal Grit Solutions Tempo inteiroData Engineer Building Data Highways: Data Engineer Position Available! There's no secret to being number-one; it takes willingness to improve and determination to pursue it. At GRiT®,?it's all about the journey to get there. We believe talent and intelligence are important, yet passion and perseverance are the key to achieving any goal. We are Tech...