📢 New: get today's jobs on our WhatsApp Channel
Jobiglo

No results.

Senior AI Engineer – RAG, Evaluation & Production

OakRidge DOO

New
Senior 🇬🇧 English
Python FastAPI grounding citations evaluation frameworks observability golden datasets AI quality metrics LLM failure modes MCP servers MCP gateways

Job description

About the role

We are seeking a medior‑to‑senior AI Engineer to take a Retrieval‑Augmented Generation (RAG) or tool‑using chatbot from prototype to production for real users. The role focuses on making AI assistants reliable, measurable and ready for enterprise deployment, with a particular emphasis on Dutch‑language outputs for Flemish SMEs.

Key responsibilities

  • Own answer quality for AI assistants, ensuring grounding, citations, reduced hallucinations and graceful “I don’t know” responses.
  • Design, build and improve RAG and tool‑using chatbot workflows in a production Python/FastAPI environment.
  • Prepare image generation and branded PPTX, DOCX, PDF outputs for production use.
  • Set up quality measurement using golden sets, evaluations, traces and automated testing.
  • Iterate on systems based on measurable quality metrics rather than prompt tweaking.
  • Evaluate and enhance Dutch‑language answers for Flemish SMEs.
  • Collaborate with external partners to transfer or integrate AI solutions.

Required profile

  • Medior‑to‑senior engineering experience in applied AI / Generative AI.
  • Proven track record shipping a RAG or tool‑using chatbot to real users.
  • Strong hands‑on mindset as an individual contributor.
  • Ability to design and maintain golden datasets and AI quality metrics.
  • Comfortable working in a production API environment.

Required skills

  • Python programming.
  • FastAPI for production APIs.
  • Retrieval‑augmented generation, grounding and citation techniques.
  • Evaluation frameworks and observability tools.
  • Design of golden datasets and AI quality metrics.
  • Understanding of LLM failure modes, especially hallucinations.
  • Experience with MCP servers and MCP gateways (plus).

Questions fréquentes

Le salaire n'est pas communiqué publiquement par le recruteur. Vous pouvez postuler et négocier directement avec OakRidge DOO.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.

Why are you reporting this job?

Thank you for your report. We will review this job.

Explore further

Salaries, guides and searches for Северна Македонија.

Salaries by job title

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

By continuing, you accept our terms of use.

Already have an account? Login

💬 Chat with us on Telegram Chat on WhatsApp

Published пред 2 часа

Expires после 1 месец

3 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

OakRidge DOO