Senior Big Data Engineer

Há 3 dias

Almada, Setúbal, Portugal Grid Dynamics Tempo integral

Join to apply for the Senior Big Data Engineer role at Grid Dynamics.
Fully remote from Portugal — As a Senior Big Data Engineer (Scala/Spark), you'll be responsible for developing robust data pipelines, maintaining infrastructure, and optimizing performance across distributed systems.
You'll also have opportunities to contribute to Dev Ops and CI/CD workflows, working closely with platform teams to ensure smooth delivery and deployment of big data solutions.
The project goal is to implement pipelines and infrastructure for generating reports based on huge amounts of collected data.
Our team is responsible for designing, coding, and verifying jobs written in the latest version of Scala/Spark, ensuring that the algorithms we implement return accurate statistics that will be used by our stakeholders.
Although this is a Big Data Engineer position, CI/CD and Dev Ops knowledge would be a big plus, as working with infrastructure will also be part of the role.
Responsibilities
Design, develop, and maintain scalable data processing pipelines using Apache Spark and Scala Ensure accuracy and efficiency of statistical algorithms implemented in production Collaborate with global engineering teams on distributed data architecture and design Work with large-scale distributed systems (e.G., Hadoop, Kafka, Cassandra) for data ingestion and processing Contribute to the build and optimization of Data Lakes and Data Warehousing solutions Support and enhance CI/CD workflows, infrastructure automation, and deployment processes Requirements Proficiency in Scala/Spark Hands-on expertise with Hadoop Processing and computation frameworks: Kafka, Spark, Dataframe/SQL API DB engines: Oracle, Postgres, Teradata, Cassandra Experience implementing Data Lakes, Data Warehousing or analytics systems is an advantage Good understanding of distributed computing technologies, approaches, and patterns Nice to have Dev Ops/CI/CD skills We offer Opportunity to work on bleeding-edge projects Work with a highly motivated and dedicated team Competitive salary Flexible schedule Professional development opportunities About Us Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services.
Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation.
A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & Dev Ops, application modernization and customer experience.
Founded in ****, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.
Seniority level Mid-Senior level Employment type Contract Job function Engineering and Information Technology Industries IT Services and IT Consulting Referrals increase your chances of interviewing at Grid Dynamics by 2x.
Get notified about new Big Data Developer jobs in Lisbon, Lisbon, Portugal.
We're unlocking community knowledge in a new way.
Experts add insights directly into each article, started with the help of AI.