Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Manila, Metro Manila, Philippines · Remote Solely
$80/hr–$100/hr
Senior
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Model Benchmarking, CI/CD, Automated Testing
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Buenos Aires, Argentina · Remote Solely
$80/hr–$100/hr
Senior
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Model Benchmarking, CI/CD, Automated Testing
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Hyderabad, Telangana, India · Remote Solely
$80/hr–$100/hr
Senior
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Benchmarking, Data Pipelines, CI/CD
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
São Paulo, São Paulo, Brazil · Remote Solely
$80/hr–$100/hr
Senior
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Benchmarking, CI/CD, Automated Testing
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Ottawa, Ontario, Canada · Remote Solely
$80/hr–$100/hr
Senior
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Benchmarking, Data Pipelines, CI/CD
Company Description An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platf…
Skills: Python, AI Evaluation, Benchmarking, Data Pipelines, CI/CD
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Aruba, AW
Oranjestad, Aruba, Aruba · On-site
$40/hr–$52/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, English Proficiency, Tech Savvy, Property Evaluation
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Cairns, AU
Cairns, Queensland, Australia · On-site
$60/hr–$75/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, English Proficiency, Tech Savvy, Property Evaluation
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Charlotte, US
Charlotte, North Carolina, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Report Writing
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Colorado Springs, US
Colorado Springs, Colorado, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Hospitality
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Daytona Beach, US
Daytona Beach, Florida, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, English Proficiency, Tech Savvy, Property Evaluation
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Destin, US
Destin, Florida, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Report Writing
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Jacksonville, US
Jacksonville, Florida, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, English Proficiency, Tech Savvy, Property Evaluation
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - North Carolina Coast, US
Wilmington, North Carolina, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Report Writing
Company Description An enterprise client is currently recruiting people who can bring energy, emotion, and clarity to their voice, whether you’re a professional actor or someone with a naturally expressive personality. T…
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Lafayette County, MS, US
Oxford, Mississippi, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Hospitality
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Lafayette County, MS, US
Oxford, Mississippi, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Report Writing
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - St George, US
St. George, Utah, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Report Writing
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Santa Fe, US
Santa Fe, New Mexico, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, Property Evaluation, Photography, Hospitality
Strong Communicators Needed for An Airbnb Luxe Home Consultant Project - Panama City Beach, US
Panama City Beach, Florida, United States · On-site
$75/hr–$90/hr
Entry level
Job Description Join our program supporting Airbnb’s Luxe program as a Home Consultant and help us uphold the exceptional quality and hospitality standards expected from the luxury homes in Airbnb’s Luxe offering. As par…
Skills: Communication Skills, Attention To Detail, English Proficiency, Tech Savvy, Property Evaluation
Copy of Senior Python Developer (AI Evaluation & Benchmarking)
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
$80/hr–$100/hr
Contract
Posted 38d ago
~39 hrs/week
Remote in Texas City, Texas, United States
Responsibilities
Design and develop coding benchmarks to evaluate frontier AI models and analyze AI-generated code for correctness and efficiency. Build scalable data pipelines and create structured programming scenarios to improve AI reasoning and reliability.
Requirements
Requires 4+ years of professional software engineering experience with expert-level Python proficiency and knowledge of at least one other language like Go or C++. Candidates must be experienced with CI/CD pipelines and automated testing frameworks.
Full job description
Company Description
An enterprise client is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. This opportunity support the client who is a leading AI platform that enables organizations to build intelligent applications through high-quality human feedback, AI evaluation, and model alignment.
The selected consultants will contribute to AI research by designing programming benchmarks, evaluating AI-generated code, and helping improve the performance, reasoning, and reliability of frontier AI models. This is an excellent opportunity for experienced software engineers who enjoy solving complex technical problems while contributing to the future of Generative AI.
Job Description
This opportunity is ideal for senior software engineers with strong Python expertise who enjoy writing high-quality code, reviewing technical solutions, and working on AI-related projects.
What You'll Do:
Design and develop coding benchmarks used to evaluate frontier AI models.
Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows.
Create structured programming scenarios to test reasoning, debugging, and code quality.
Work with large codebases and multi-language software environments.
Collaborate with teams focused on improving how AI models understand, generate, and evaluate software.
Write clean, maintainable, and well-tested Python code following software engineering best practices.
Qualifications
Requirements:
4+ years of professional software engineering experience (required).
Expert-level proficiency in Python.
Experience working at a high-growth technology company or top-tier software organization.
Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar.
Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit.
Strong understanding of software engineering best practices, debugging, and code quality.
Excellent analytical and problem-solving skills.
Nice to Haves:
Experience with AI/ML evaluation, model benchmarking, or Generative AI.
Background in security engineering.
Significant contributions to open-source software projects.
Experience working with large-scale distributed systems or enterprise software platforms.
Additional Information
Fully remote contract opportunity.
Compensation ranges from $80–$100 USD per hour.
Expected workload is 10–39 hours per week, depending on project needs.
Weekly payments for approved work completed during the previous week.
Work volume may fluctuate throughout the duration of the engagement.
Hiring Process:
Submit your proposal.
Complete a short qualification form provided by the client.
Qualified candidates will receive an Upwork contract offer and onboarding instructions.
After accepting the contract, candidates will gain access to the client's evaluation.
Candidates who successfully pass the evaluation will be invited to a technical interview with the client.
One solution built for enterprise companies to source, contract, manage, and pay any type of contingent talent.
Industry
Technology, Information and Internet
Company size
201-500 employees
Founded
2025
LinkedIn followers
6,800
Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.
One solution built for enterprise companies to source, contract, manage, and pay any type of contingent talent.
Industry
Technology, Information and Internet
Company size
201-500 employees
Founded
2025
LinkedIn followers
6,800
Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.