Rust Software Engineer – LLM Evaluation

2 semanas atrás

Lisboa, Lisboa, Portugal Elvis Eckardt Recruitment & Sales Solutions Limited Tempo inteiro
The Role:

Senior Software Engineer – Rust (LLM Evaluation & Repository Validation)

Location: Permanent Remote, Africa-Based

Contract Type: Contractor (no medical/paid leave)

Duration: 3 months (extensions possible)

Start Date: Immediate (within 1 week)

Commitment: 20–40 hours/week with some overlap with Pacific Standard Time (PST)

Experience Required: 3–8 years overall, with 2+ years in Rust

About the Project

We are building LLM evaluation and training datasets to train large language models (LLMs) to work on realistic software engineering problems. A key approach in this project involves creating verifiable SWE tasks from public repository histories in a synthetic, human-in-the-loop process. The goal is to expand dataset coverage across programming languages, complexity levels, and problem domains.

This role blends hands-on software engineering with AI-focused research, giving you a chance to work at the intersection of open-source software and cutting-edge AI systems.

Responsibilities:

  • Analyse and triage GitHub issues across trending open-source libraries.
  • Set up and configure repositories (including Dockerization and development environment setup).
  • Evaluate unit test coverage and quality across projects.
  • Run and modify codebases locally to assess LLM bug-fixing performance.
  • Collaborate with researchers to design/select repositories and tasks challenging for LLMs.
  • (Optional) Lead junior engineers collaborating on evaluation tasks.

Why Join:

  • Work remotely on impactful AI + software engineering projects.
  • Collaborate with researchers shaping the future of AI-assisted development.
  • Opportunity to contribute to real-world open-source challenges while influencing LLM training and evaluation.

Application Process: To apply, please submit your CV and a cover letter detailing your relevant experience and qualifications for the role. Applications will be reviewed on a rolling basis, so early submissions are encouraged.

Equal Opportunity Employer: We value diversity and are committed to creating an inclusive work environment. We encourage applicants from all backgrounds to apply.

Contact: Elvis Eckardt

Ideal Profile:

Must-Have Skills:

  • 3–8 years of professional software development experience.
  • Minimum 2+ years of experience with Rust in production environments.
  • Strong proficiency with Git, Docker, and software pipelines.
  • Ability to navigate and understand complex, real-world codebases.
  • Comfortable running, modifying, and testing repositories locally.

Nice-to-Have Skills:

  • Prior contributions to or evaluation of open-source projects.
  • Experience with developer tools, automation agents, or AI/LLM evaluation.
  • Exposure to LLM-related research or dataset generation.
What's on Offer?
  • Work within a company with a solid track record of success
  • Great work environment
  • Join a well known brand within IT Services

  • Rust Software Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Damia Group Tempo inteiro 42 000 € - 84 000 € por ano

     Seeking a Rust Software Engineer: Rhino, are you there?At WE ARE META, we focus on finding the perfect match between our Rhinos and our clients.Why join us?Expand your network: As a consultant at We Are META, you'll have access to a network of national and international partners across diverse sectors of the tech industry.Enjoy our perks: When you join...

  • Senior Software Engineer

    Há 3 dias

    Lisboa, Lisboa, Portugal Workato Tempo inteiro

    About WorkatoWorkato transforms technology complexity into business opportunity. As the leader in enterprise orchestration, Workato helps businesses globally streamline operations by connecting data, processes, applications, and experiences. Its AI-powered platform enables teams to navigate complex workflows in real-time, driving efficiency and...

  • Software Engineer

    1 semana atrás

    Lisboa, Lisboa, Portugal Cloudflare Tempo inteiro

    About UsAt Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without...

  • Software Engineer, Orpheus

    1 semana atrás

    Lisboa, Lisboa, Portugal Cloudflare Tempo inteiro

    About UsAt Cloudflare, we are on a mission to help build a better Internet. Today the company runs one of the world's largest networks that powers millions of websites and other Internet properties for customers ranging from individual bloggers to SMBs to Fortune 500 companies. Cloudflare protects and accelerates any Internet application online without...

  • Senior Software Engineer

    Há 7 dias

    Lisboa, Lisboa, Portugal Datadog Tempo inteiro

    The Datadog Agent collects and transmits application and host telemetry, which powers many Datadog products such as Infrastructure Monitoring, Logs, APM, and Database Monitoring. This software runs on customer infrastructure across various platforms, collecting and receiving telemetry that is then forwarded to Datadog for analysis. This process provides...

  • Junior Aerospace Embedded Software Engineer

    1 semana atrás

    Lisboa, Lisboa, Portugal Critical Software Tempo inteiro

    Ready to kick-start your career writing code that Airbus trusts with human lives?If you're passionate about embedded systems and want to learn from some of the best in the industry, this is your chance.Building better and safer isn't just a slogan – it's how we work.We create technology that speaks not only in code, but with meaning: better solutions,...

  • Junior Aerospace Embedded Software Engineer

    1 semana atrás

    Lisboa, Lisboa, Portugal Critical Software Tempo inteiro

    Ready to kick-start your career writing code that Airbus trusts with human lives?If you're passionate about embedded systems and want to learn from some of the best in the industry, this is your chance.Building better and safer isn't just a slogan – it's how we work.We create technology that speaks not only in code, but with meaning: better solutions,...

  • Senior Software Engineer

    2 semanas atrás

    Lisboa, Lisboa, Portugal Datadog Tempo inteiro 80 000 € - 150 000 € por ano

    Distributed Systems engineers at Datadog design, implement and run in production the foundational platforms powering our applications. Your data pipelines will ingest, store, analyze and query in real-time billions of events per second from companies all over the globe. The platforms are optimized for durability, high availability, low latency,...

  • Lisbon

    2 semanas atrás

    Lisboa, Lisboa, Portugal Automation Engineer Tempo inteiro 30 000 € - 60 000 € por ano

    Job DescriptionAutomation Engineer - SDET - LisbonOverview#TEamCandour are seeking a talented and motivated Automation Engineer - SDET - to join our thriving, global enterprise client working out of their expanding Lisbon tech hub. This position is being offered on a hybrid basis and will required 2 days attendance per week at the office in Central Lisbon.As...

  • Staff Software Engineer

    1 dia atrás

    Lisboa, Lisboa, Portugal Zendesk Tempo inteiro

    Job DescriptionAt Zendesk, our focus is helping our customers build great relationships with their customers. Founded by three Danish entrepreneurs, Zendesk has experienced remarkable success and growth while maintaining a fun, positive, and down-to-earth culture.We are looking for a Staff Software Engineer to join our AI Copilot team. You will be delivering...