Software Jobs in Herndon, VA (Now Hiring) — 461 open — Page 3

LLM Prompt Specialist – Remote 

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. 
 
This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential. 

Job Title: LLM Prompt Specialist
Location: 100% Remote (United States)
Position Type: Full-time, Direct W2
Salary Range: $100,000–$150,000 Annually
Experience: 6+ years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position. 

Job Summary
We are looking for a Prompt Engineering Architect to define and lead the strategy, patterns, and tooling for designing prompts, agentic workflows, and LLM-based application architectures across the organization. The role combines deep practical mastery of modern LLMs with the discipline of building reusable design patterns, evaluation frameworks, and developer tooling that scale across many teams and use cases. The ideal candidate has shipped LLM-powered products in production, is fluent in prompt design patterns and agent architectures, and brings strong judgment about when and how to apply different LLM techniques responsibly.

Key Responsibilities

• Define organization-wide standards, patterns, and reference architectures for LLM-based applications.
• Design prompt structures, instruction templates, and retrieval strategies for diverse production use cases.
• Architect agentic systems incorporating tool use, planning, memory, and multi-step reasoning.
• Lead the design of retrieval-augmented generation pipelines including chunking, indexing, and reranking strategies.
• Develop evaluation frameworks for prompt quality, agent reliability, and end-to-end task success.
• Build internal tooling and libraries that accelerate LLM application development across teams.
• Establish guardrails, safety filters, and policy enforcement patterns for LLM-powered products.
• Collaborate with model engineering teams on prompt-model co-design and fine-tuning opportunities.
• Conduct technical reviews of LLM application designs across multiple product teams.
• Mentor engineers and applied scientists on prompt engineering and LLM application architecture.
• Lead red-teaming exercises and continuously improve robustness against adversarial inputs.
• Track latency, cost, and quality trade-offs in LLM application design and recommend optimizations.
• Document patterns, anti-patterns, and lessons learned for broad internal reuse.
• Stay current with LLM capabilities, tooling, and research, and translate advances into practical guidance.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Computational Linguistics, or a related field.
• Six or more years of software engineering experience, with significant time on LLM-based applications.
• Demonstrated experience shipping LLM-powered products to production.
• Deep familiarity with modern LLM APIs and agent frameworks.
• Strong understanding of retrieval-augmented generation, embeddings, and vector databases.
• Experience designing evaluation pipelines for non-deterministic systems.
• Strong Python skills and comfort with modern application frameworks.
• Solid grasp of responsible AI principles, including safety and policy considerations.
• Excellent written and verbal communication skills.
• Track record of mentoring engineers and influencing technical direction.

Preferred Qualifications

• Public writing, talks, or open-source contributions on LLM application development.
• Experience with multi-agent architectures and complex tool-use systems.
• Familiarity with fine-tuning workflows and when to choose them over prompting.
• Exposure to product domains such as customer support, coding assistants, or analytics agents.
• Experience integrating LLMs into enterprise software systems with strict compliance requirements.

How to Apply
Would you like to know more about this opportunity? For immediate consideration, please send your resume to [email protected] or contact us at (908) 650-6699. Learn more about Bright Vision Technologies at www.bvteck.com. 
 
Bright Vision Technologies is an Equal Opportunity Employer. 
 

Equal Employment Opportunity (EEO) Statement

Bright Vision Technologies (BV Teck) is committed to equal employment opportunity (EEO) for all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other protected status as defined by applicable federal, state, or local laws. This commitment extends to all aspects of employment, including recruitment, hiring, training, compensation, promotion, transfer, leaves of absence, termination, layoffs, and recall.

BV Teck expressly prohibits any form of workplace harassment or discrimination. Any improper interference with employees' ability to perform their job duties may result in disciplinary action up to and including termination of employment.