About the role (summary)
Our client — a regional technology platform scaling AI capabilities across products — seeks a Generative AI / Prompt Engineering Lead (PromptOps) to design, optimise and operationalise prompts, instruction pipelines, and prompt-driven product features.
You will shape how LLMs are safely and reliably integrated into customer-facing and internal workflows, set prompt governance standards, and mentor engineers across the business.
Key responsibilities
- Lead prompt design, prompt chaining and prompt templates for product features (chat, summaries, code generation, knowledge retrieval).
- Build and maintain PromptOps pipelines: prompt versioning, testing, evaluation metrics, A/B experiments and rollout processes.
- Develop evaluation frameworks (qualitative + quantitative) for LLM output quality, robustness, bias and hallucination risk.
- Collaborate with product managers, ML engineers, data engineers and UX to embed LLMs into features with good latency, cost and safety trade-offs.
- Implement guardrails and content safety checks; work with legal/compliance on regulatory and data-privacy considerations.
- Define prompt documentation, best practices and run internal training / prompt design workshops.
- Monitor model costs, automate prompt batching and optimisation to control inference spend.
- Mentor junior prompt engineers and guide sourcing of external LLM models/APIs.
Requirements (must-have)
- Bachelor's or Master's in Computer Science, AI, Cognitive Science, or related discipline (or equivalent experience).
- 3–6 years in ML/AI product or applied NLP roles; demonstrable experience working with LLMs (OpenAI, Anthropic, Llama-class, PaLM, etc.).
- Hands-on prompt engineering experience — designing effective prompts, prompt chaining, few-shot prompting and evaluation.
- Strong Python skills and familiarity with deployment/inference frameworks (LangChain, LlamaIndex, Hugging Face pipelines or equivalent).
- Experience with A/B testing, offline/online evaluation metrics, and monitoring ML performance in production.
- Excellent stakeholder skills: able to translate product problems into prompt/model solutions.
Preferred qualifications (nice-to-have)
- Production experience with PromptOps tooling (prompt versioning, CI for prompts).
- Background in ML safety/AI ethics, content moderation systems or model risk management.
- Experience optimising latency/cost at scale (e.g., batching, quantised models, retrieval augmentation).
What the client offers
- Be a core leader in an AI product-centric team with rapid growth and strong funding.
- Competitive compensation (base + equity/bonus), flexible hybrid work and skills budget.
- Hands-on ownership of end-to-end PromptOps and opportunity to influence product roadmap.
Please note: This is a client role managed by Octomate Staffing Pte Ltd.
Recruitment services are provided by:
Octomate Staffing Pte Ltd
EA Licence No.: 23C1980
EA Personnel: Zachary Ng (Registration No.: R