Senior Data Software Engineer

Há 2 semanas

Lisbon, Portugal EPAM Systems Tempo integral

We are seeking a

Senior Data Software Engineer

skilled in Databricks to join our team in Portugal.

You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment. This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.

Responsibilities

Design, develop and maintain scalable data pipelines and architectures

Optimize data models and enhance ETL processes utilizing Databricks and related technologies

Implement rigorous data quality checks and monitoring to guarantee high integrity

Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools

Troubleshoot and resolve data-related issues promptly

Participate in code reviews ensuring adherence to high standards of code quality

Requirements

Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies

Solid understanding of data architecture and data modeling skills

Expertise in Spark, using either Scala or PySpark

Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks

Engineering background in AWS, Azure or GCP

Experience with big data and performance optimization of data-intensive applications

Proactive approach and prior client-facing experience

Ability to navigate ambiguity and work independently

Desire to engage in a transparent, fast-moving startup environment

Fluent English communication skills at a B2+ level or higher

We offer

Competitive compensation depending on experience and skills

Variety of projects within one company

Being a part of a project following engineering excellence standards

Individual career path and professional growth opportunities

Internal events and communities

Flexible work hours