We are currently partnering with a fast-growing AI & Data consulting company in Japan that is actively expanding its Generative AI and Large Language Model (LLM) division and is now looking for both LLM Scientists and Senior LLM Scientists.
Please note that prior financial industry experience is NOT required.
For foreign candidates, a valid Japanese work visa and at least JLPT N2-level Japanese (or equivalent business Japanese communication skills) are required to apply.
Position Levels
• Junior / Mid-Level: ¥6M – ¥10M JPY
• Senior Level: ¥10M – ¥25M JPY
The company works directly with major enterprise clients in Japan on cutting-edge AI transformation initiatives involving Generative AI, LLM applications, AI governance, intelligent automation, and next-generation enterprise AI ecosystems.
These positions offer the opportunity to work on real-world Generative AI implementation projects, including Retrieval-Augmented Generation (RAG), AI Agents, enterprise knowledge systems, AI-powered business process transformation, LLM evaluation frameworks, and production-grade AI applications.
The environment is highly collaborative and technology-driven, combining hands-on development, advanced AI implementation, and business-oriented consulting engagements.
Key Responsibilities
• Design, develop, and evaluate enterprise-grade applications utilizing Large Language Models (LLMs)
• Develop and optimize prompts, workflows, and inference strategies for Generative AI solutions
• Build and support Retrieval-Augmented Generation (RAG) systems and AI Agent-based applications
• Participate in Generative AI proof-of-concepts (PoCs), implementation projects, and production deployments
• Collaborate with AI consultants, data scientists, and data engineers to translate business requirements into AI solutions
• Conduct technical validation, benchmarking, and evaluation of LLM-based systems
• Support AI governance, guardrails, model safety, and responsible AI initiatives
• Contribute to internal AI frameworks, reusable assets, and next-generation Generative AI capabilities
• Participate in enterprise AI transformation projects across multiple business domains
Examples of projects include:
• Enterprise knowledge search and RAG implementation initiatives
• Local/private LLM deployment and operational efficiency projects
• AI governance and guardrail validation initiatives
• Business process transformation through Generative AI and intelligent automation
• Legacy system modernization supported by Generative AI technologies
• AI Agent development and orchestration frameworks
• LLM evaluation and optimization projects
Requirements
Required:
• Bachelor's degree or equivalent academic background in Computer Science, Machine Learning, Data Science, Mathematics, Statistics, Engineering, or related fields
• Approximately 1+ years of professional experience in AI, data science, machine learning, or related technical fields
• Experience developing applications utilizing Large Language Models (LLMs) through commercial cloud AI services or equivalent platforms
• Experience with prompt engineering, LLM integration, or Generative AI application development
• Business-level Japanese (JLPT N2 or equivalent)
• Eligibility to work in Japan
Preferred:
• Experience with Retrieval-Augmented Generation (RAG)
• Experience with AI Agents and multi-agent systems
• Experience with LLMOps, model evaluation, fine-tuning, or AI deployment pipelines
• Experience collaborating directly with business stakeholders and translating requirements into AI solutions
• Experience with enterprise AI transformation or consulting projects
• Experience with structured and unstructured data analytics
• Experience with Python for AI development and production implementation
• Experience using modern data platforms such as Snowflake, Databricks, or BigQuery
• Master's degree in Computer Science, Machine Learning, Applied Mathematics, Statistics, Econometrics, or related disciplines
• English communication skills
• Financial services experience is a plus but not required
Benefits
Compensation & Benefits:
• Annual salary: ¥6M – ¥25M JPY
• Location: Nihonbashi, Chuo-ku, Tokyo
• Hybrid work style available (office + remote work combination)
• Full flex-time system (no core time)
• Standard working hours: 8 hours/day
Holidays & Time Off:
• Full two-day weekend system
• 123 annual holidays annually
• Paid leave granted after probation period
• Refresh leave / New Year holidays / parental leave / condolence leave
Benefits:
• Defined contribution pension plan
• Learning & self-development support
• Internal/external networking support budget
• Sports & wellness allowance
• Full annual health check support
• Full influenza vaccination support including dependents
• Full transportation reimbursement
• Relocation support (eligible employees)
• Childcare/babysitter support
• Business trip & training allowances
• Marriage / childbirth / condolence support system
Insurance:
• Health insurance
• Employee pension
• Employment insurance
• Workers’ compensation insurance
Additional Information:
• Non-smoking office environment
• Flexible internal role mobility and career growth opportunities
This is an excellent opportunity for someone who wants to work at the intersection of enterprise AI, large-scale data architecture, and real business transformation within Japan’s financial industry