Language Measurement Scientist

$111k - $150k

Location
Pittsburgh, PA
Workplace
On-site
Employment
Full-time

About this role

Our mission at Duolingo is to develop the best education in the world and make it universally available. It’s a big mission, and that’s where you come in!

At Duolingo, you’ll join a team that cares about educating our users, experimenting with big ideas, making fact-based decisions, and finding innovative solutions to complex problems. You’ll have limitless learning opportunities and daily collaborations with world-class minds — while doing work that’s both meaningful and fun.

Join our life-changing mission to develop education for our half a billion (and growing!) learners around the world. 

Read our blog to learn more.


About the role...

Duolingo is looking for a language assessment expert to support test development and research for the Duolingo English Test. You will join our Assessment Research and Development team, collaborating across disciplines to design and evaluate innovative language assessments. Your work will help ensure that assessment tasks and scores are valid, reliable, and fair while advancing Duolingo’s mission through science.

🧠  You will...

  • Collaborate with measurement researchers, engineers, and designers to develop innovative, research-driven language assessments.
  • Design and evaluate assessment tasks, including new interactive item formats.
  • Conduct qualitative and quantitative studies examining the validity, reliability, and fairness of assessment tasks and test scores.
  • Apply language assessment and measurement principles to improve test design, content, scoring, and quality assurance.
  • Translate research findings into clear recommendations for technical and non-technical partners.
  • Share findings through technical reports, research publications, blog posts, and presentations to professional and academic audiences.

✅  You have...

  • A PhD in language testing, applied linguistics, second language acquisition, educational measurement, or a related field.
  • Experience developing or conducting research on high-stakes language assessments or comparable professional experience.
  • Expertise in language assessment, including test design, validity, reliability, fairness, and the measurement of language proficiency.
  • Experience designing and analyzing qualitative and quantitative research studies.
  • Experience communicating research through publications, reports, or presentations.
  • The ability to explain complex measurement concepts clearly to collaborators from different disciplines.
  • Proficiency with data-analysis tools such as R or Python.
  • Strong collaboration, project-management, and organizational skills.

⭐  Exceptional candidates will have...

  • Experience applying large language models, natural language processing, or related technologies to language assessment.
  • Experience collaborating with software engineers, or AI researchers to develop digital assessment products.
  • Experience designing or developing computer-adaptive tests.
  • Expertise in evidence-centered design, interactive-task development, or integrated-skills assessment.

The offered salary is dependent upon several factors, including work experience, skills, and internal peer comparisons. The posted range is subject to change in the future. For this role, base salary is supplemented by equity compensation. We encourage you to talk with your recruiter for more information related to compensation for this role!

Salary Range:
$110,500—$149,500 USD

Benefits: Take a peek at how we care for our employees' holistic well-being with our benefits here.

Job Alerts: Sign up for job alerts here.

Accommodations: We will do everything we can within reason to make sure that your interview takes place in an environment that fairly and accurately assesses your skills. If you need assistance or accommodation, please contact [email protected].

Equal Employment Opportunity: Duolingo is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.

Fraud Warning: Unfortunately, there is a rise in scammers pretending to be real Duolingo employees. Duolingo and our employees will never ask for your Social Security number, bank details, or passport info, and we’ll never ask you to deposit a check, purchase equipment, or exchange money during the interview process. Real Duolingo employees always use an email that ends in @duolingo.com or @recruiting.duolingo.com. Stay alert and double-check these details before sharing any information.

By applying for this position your data will be processed as per the Duolingo Applicant Privacy Notice.

Apply to Duolingo

Clera fills in Duolingo's application for you.

How it works

Open the role in Clera

Sign in, and this role opens on your Clera job board, ready to apply.

Clera fills in the application

Clera fills the form from your profile and resume, and asks what's missing.

Track it in Clera

Each application you send shows up in your Clera tracker, sorted by stage.

Want Clera to find roles for you?

Ask your AI about this role

It knows you. Clera gives it the role.

Does this role fit my profile?

First time? Connect Clera once, about a minute.
One click above pre-fills the connector. Or by hand: Settings > Connectors > Add custom connector, paste https://mcp.getclera.com. Either way, sign in with the account you use on Clera and approve the consent screen.
https://mcp.getclera.com

Sign in with your Clera account. MCP docs

About Duolingo

Duolingo is the most downloaded education app in the history of the App Store.

Our mission is to develop the best education in the world and make it universally available.

Learning a new language is hard, but staying motivated is often the hardest part. That’s why we use fun, bite-sized, game-like lessons designed to keep you engaged and to drive real learning outcomes. Our approach is grounded in efficacy: we continuously test and improve our methods to ensure learners make meaningful progress.

We also believe in democratizing education by offering an effective, high-quality free product. Developing a great free product is essential to our mission, ensuring that anyone with a smartphone can access learning that works.

When it comes to utilizing AI tools, we have a golden rule: we use it when it clearly improves outcomes for learners. We don’t use it as a shortcut or a replacement for people, but as a tool to enhance learning experiences and efficacy.

Duolingo has been named to: Fast Company’s Most Innovative Education Company (2026, 2022), Apple Design Award (2023), TIME100 Most Influential Companies (2023), Fast Company Best Workplaces for Innovators (2022), among others.

Team size
501-1,000 employees people
Founded
2011
Industry
Higher Education
Workplace
On-site
Locations
Pittsburgh, Pennsylvania, United States

Benefits

  • Equity compensation