Senior Data Software Engineer

Há 5 dias

Lisboa, Portugal Epam Systems Tempo integral

We are seeking a
Senior Data Software Engineer
skilled in Databricks to join our team in Portugal.
You will be integral to our efforts, bringing a deep understanding of data engineering, expertise in Databricks and an open-minded approach to our collaborative and friendly work environment.
This role is ideal for a professional eager to develop scalable data solutions and drive innovation in our Data practice.
Responsibilities
Design, develop and maintain scalable data pipelines and architectures
Optimize data models and enhance ETL processes utilizing Databricks and related technologies
Implement rigorous data quality checks and monitoring to guarantee high integrity
Keep abreast of the latest trends and technologies in data engineering and advocate for the adoption of beneficial new tools
Troubleshoot and resolve data-related issues promptly
Participate in code reviews ensuring adherence to high standards of code quality
Requirements
Hands-on experience with Databricks, including Delta Lake workflows, Delta Live Tables, along with deployment and versioning strategies
Solid understanding of data architecture and data modeling skills
Expertise in Spark, using either Scala or PySpark
Proficiency in cloud-native technologies and software engineering best practices such as containers, unit tests, linting and code style checks
Engineering background in AWS, Azure or GCP
Experience with big data and performance optimization of data-intensive applications
Proactive approach and prior client-facing experience
Ability to navigate ambiguity and work independently
Desire to engage in a transparent, fast-moving startup environment
Fluent English communication skills at a B2+ level or higher
We offer
Competitive compensation depending on experience and skills
Variety of projects within one company
Being a part of a project following engineering excellence standards
Individual career path and professional growth opportunities
Internal events and communities
Flexible work hours