Job Description

Location : Tokyo
Salary : ¥11,856,000 annual
Reference Number :06940-0013272619

Position Overview:

We are looking for a skilled LLM Agent Engineer to join our AI team. In this role, you will drive the development and optimization of intelligent agent systems, focusing on improving agent performance, enhancing observability, and refining evaluation pipelines through data-driven approaches.

Key Responsibilities:

• Agent Performance Monitoring: Improve monitoring systems for AI agents to ensure optimal performance and reliability.

• LLM Evaluation Pipelines: Design and implement evaluation pipelines and benchmarks tailored to LLM applications.

• Operational Support: Resolve operational issues, ensuring continuous system stability and high performance.

• Iterative Agent Improvement: Lead the enhancement of LLM agents based on performance metrics and user feedback.

• Agile Practices: Actively contribute to daily scrums, sprint planning, and sprint reviews. Reporting will be in English.

• Documentation: Maintain clear documentation of services and models for internal teams and stakeholders.

• Collaboration: Engage in daily communication through Slack and meetings, primarily in English.

• Code Reviews: Ensure high engineering standards through thorough documentation and code reviews.

Required Qualifications:

• Experience in LLM Agent development, particularly with frameworks like LangChain or LangGraph.

• Proven track record in developing AI/LLM evaluation pipelines and performance measurement systems.

• Strong background in software engineering, emphasizing maintainable and clean code.

• A data-driven mindset, with the ability to analyze and act on metrics to improve performance.

Preferred Qualifications:

• Familiarity with MCP (Model Context Protocol) or similar technologies.

• Knowledge of statistics and data science for advanced modeling and analysis.

• Experience with Databricks for data processing and machine learning workflows.

By clicking 'apply', you give your express consent that Robert Half may use your personal information to process your job application and to contact you from time to time for future employment opportunities. For further information on how Robert Half processes your personal information and how to access and correct your information, please read the Robert Half privacy notice . Please do not submit any sensitive personal data to us in your resume (such as such as race, beliefs, social status, medical history or criminal record) as we do not collect your sensitive personal data at this time.

お客様が「今すぐ応募」ボタンをクリックすることにより、ロバート・ハーフ（以下、当社）がお客様の応募内容を処理し、求人情報を今後随時ご連絡する目的で個人情報を使用することに明示的に同意ただいたこととなります。当社による個人情報の処理方法、またお客様自身の個人情報へのアクセスおよびその訂正に関する詳細については、プライバシー規約（）をお読みください。当社は、要配慮個人情報はお預かりしておりませんので人種、信条、社会的身分、病歴、犯罪の経歴など、取扱いに特に配慮を要する個人情報は、ご提出いただく職務経歴書・レジュメ等に含めないようお願いいたします。

Job Tags

Similar Jobs