LLM Applications Engineer

About the Role

We're seeking an experienced AI Engineer specialized in Large Language Models (LLMs) to join our team. In this role, you'll be responsible for developing, implementing, and optimizing LLM-based solutions using both commercial APIs (like OpenAI) and open-source models.

Key Responsibilities

• Design and develop AI applications leveraging LLMs through APIs (OpenAI, Anthropic, etc.) and open-source models
• Fine-tune and customize LLMs for specific business use cases and domains
• Build robust prompt engineering frameworks and evaluation pipelines
• Create and implement evaluation methodologies to measure model performance and output quality
• Stay current with the rapidly evolving LLM landscape and integrate new advancements
• Collaborate with cross-functional teams to identify opportunities for AI implementation

Required Qualifications

• 3+ years of experience in R&D (Backend Developer, Data Scientist etc.)
• 1+ years experience working with LLMs like GPT-4, Claude, or open-source alternatives (Llama, Mistral, etc.)
• Experience with prompt engineering and optimization techniques
• Strong understanding of LLM evaluation methodologies and metrics
• Familiarity with vector databases and RAG
• Familiarity with agents workflows, LangChain, chain of thoughts etc.

Preferred Qualifications

• Experience with fine-tuning and adapting foundation models
• Familiarity with building production-ready ML pipelines
• Experience with containerization and cloud deployment of AI systems