Data Engineer

We are looking for a Data Engineer in Portugal who's eager to embark on an exciting new opportunity

About KWAN

We connect IT professionals with projects that match their skills, professional experience, and goals, then we offer a career progression program, delivered by in-house specialists - our People Experience Partners - to guide them through our journey with us.

What is this challenge about:

• Design, build, and maintain reliable, scalable data pipelines and ETL/ELT processes for production environments.
• Develop and optimize data ingestion, processing, transformation, and orchestration workflows across cloud and on-premise data platforms.
• Implement data quality frameworks, including validation, monitoring, and alerting, to ensure data integrity and reliability.
• Design and maintain data models and schemas for operational and analytical use cases, applying appropriate normalization, denormalization, and dimensional modeling techniques.
• Manage and optimize data infrastructure using Infrastructure as Code (IaC) and modern CI/CD practices.
• Troubleshoot data pipeline issues and performance bottlenecks, identifying and implementing effective optimization strategies.
• Collaborate with Data Scientists, Analytics teams, Business Intelligence stakeholders, and other technical teams to translate business requirements into scalable data solutions.
• Contribute to the design and evolution of data warehouses, data lakes, and enterprise-scale data platforms.
• Maintain technical documentation and follow best practices for development, deployment, monitoring, and data governance.
• For Senior/Lead profiles, provide technical guidance and mentorship to junior engineers and contribute to architectural decisions.

🛠 What we are looking for:

• +5 years experience building and maintaining production-grade data pipelines, with strong expertise in ETL/ELT and data orchestration.
• Strong proficiency in SQL and experience with relational and non-relational databases such as PostgreSQL, MySQL, Redis, Elasticsearch, and DynamoDB.
• Experience with cloud data warehouses and analytics platforms such as Snowflake, Amazon Redshift, BigQuery, or equivalent.
• Hands-on experience with orchestration tools such as Apache Airflow, AWS Step Functions, Luigi, or similar.
• Strong Python skills for data processing, transformation, and automation.
• Experience with AWS data services, including S3, Glue, Athena, EMR, Kinesis, Lambda, Step Functions, and RDS.
• Familiarity with big data and distributed processing technologies such as Apache Spark, Kafka, Kinesis, or Flink is a plus.
• Strong understanding of data modeling, including dimensional modeling, normalization, denormalization, and analytical schema design.
• Experience with Infrastructure as Code tools such as Terraform, CloudFormation, or Ansible.
• Experience with Git and CI/CD pipelines for data pipeline deployment and infrastructure management.
• Good knowledge of data quality, monitoring, alerting, and observability practices.
• Experience with data visualization and BI tools such as Tableau, Looker, or Grafana is a plus.
• Familiarity with monitoring platforms such as Datadog, CloudWatch, and Grafana.
• Strong problem-solving skills, with the ability to diagnose complex technical issues and optimize data pipeline performance.
• Living in Portugal (remote role).
• Fluent level of English.

What we offer

• A project that matches your skills and ambitions, as well as your preferences for working policies and culture.
• A competitive salary with awesome benefits and opportunities to leverage your knowledge and network to earn additional income.
• An empowering and respectful work culture enriched with social and learning events.
• A People Experience Partner specially assigned to you - your go-to career guide, responsible for supporting your growth, facilitating training, and ensuring your work-life balance at KWAN.

Some Words From Our Colleagues

"At KWAN, they make sure that I feel comfortable with the client I'm working for and that what I'm doing aligns with my career aspirations."

- Luis Caldeira, DevOps @ KWAN

Grab this opportunity, apply now