Chinmay Deshpande

I am a Senior Software Engineer with over nine years of expertise in AI, machine learning, and developer productivity, specializing in large language models (LLMs), Retrieval-Augmented Generation (RAG), GenAI, and MLOps. My journey includes over 7 years at Amazon Lab126, where I have designed and shipped innovative AI solutions at scale. At Amazon, I drive the integration of LLMs and generative AI into flagship products like the Astro home robot and internal developer tools. My hands-on experience spans end-to-end LLM application development: from building advanced RAG pipelines and deploying open- and closed-source models on AWS, to optimizing inference platforms for cost and latency using PyTorch, Ray, and NVIDIA GPUs. I have led and mentored teams through the full lifecycle of AI/ML projects—architecting scalable cloud and on-device inference systems, developing fine-tuning and evaluation frameworks, and championing best practices in MLOps. My work has delivered measurable impact, such as enabling Astro’s natural conversational abilities, architecting a research assistant agent with a custom orchestrator, and enhancing developer efficiency with GenAI-powered tools and CI/CD automation. I am passionate about operationalizing AI, driving cross-functional initiatives, and mentoring teams to accelerate AI adoption across organizations. Skills: LLM, RAG, GenAI, MLOps, PyTorch, TensorRT, Docker, Ray, Kubernetes, AWS, TypeScript, React, FastAPI, developer tools, agent systems, and production AI deployments.