Senior Data Engineer

Há 2 horas

Lisboa, Portugal Claranet Tempo integral

We're fast learners, hard
workers, natural collaborators... and we
Make Modern Happen
Our ambition is to unlock the
potential of our digital world so that organisations everywhere can innovate
and thrive securely. We aim to achieve this goal by bringing together the
world's most talented people and the most powerful technologies, combining them
to address our customers' challenges and to build something stronger together.
If you share
our vision, join us
Right now, we
are looking for an
Senior Data Engineer to integrate our talent team.
Your
responsibilities include:
Re -architect, optimize, and scale big data
processing components.
Analyze workload patterns and drive improvements
in performance, reliability, scalability, and cost efficiency.
Ensure the stability and operational excellence
of Apache Spark workloads running in cloud environments.
Operate, maintain, and evolve Hadoop ecosystem
components, including HDFS and YARN.
Design, build, and improve data ingestion and
processing pipelines.
Enhance developer and power -user experiences
across data science and analytics platforms.
Collaborate with engineers, data scientists,
product teams, and platform teams to deliver roadmap initiatives.
Develop, deploy, monitor, and support services
following a "you build it, you run it" DevOps mindset.
Participate in an on -call rotation and take
ownership of platform reliability and operational health.
Contribute to the evolution of a scalable,
cloud -native, microservices architecture.

You
must have:
5+ years of experience building and operating
distributed big data systems.
Strong hands -on experience with Apache Spark,
including performance tuning, debugging, and orchestration.
Solid software engineering background with strong
programming skills in Java.
Strong understanding of distributed systems and
data processing architectures.
Experience with the Hadoop ecosystem, including
HDFS and YARN.
Experience managing Linux -based environments in
the cloud.
Experience designing, building, and operating
ETL/ELT pipelines.
Familiarity with JupyterHub or JupyterLab
environments.
Experience with CI/CD, monitoring, observability,
and production support.
Ability to troubleshoot complex distributed
systems and work autonomously on challenging technical problems.
Strong ownership mindset and commitment to
operational excellence.

We
value:
Experience running Apache Spark on EMR or
Kubernetes.
Hands -on experience with Kubernetes, AWS S3, AWS
Glue, Kafka, Apache Airflow, Apache Iceberg, Trino, Nessie.
Experience building automation and data pipelines
for large -scale data workflows.
Experience developing or maintaining Data Science
or Machine Learning platforms.
Contributions to open -source projects,
particularly within the Big Data ecosystem.
Experience supporting high -volume, data -intensive
platforms in production environments.

We
offer:
Regular professional
development;
Health insurance, with family package;
Regular teambuilding
programs;
Friendly workplace.

Workplace:
Portugal - Remote
Claranet, Make modern happen