San Francisco, California, United States · Remote OK
Programmatic QA • Testing for LLMs & Agents • Data Quality • Platform Reliability About Finalytics.ai Finalytics.ai is the leading provider of personalization for the financial industry. Our platform combines data integr…
Skills: Python, Pytest, Playwright, SQL, API Testing
San Francisco, California, United States • Remote OK
Sign up with Clera and we'll reach out the moment a role actually fits you — no more spraying applications into the void.
Build and maintain automated testing frameworks for core personalization features, LLM-driven agents, and data pipelines. Collaborate with engineering to implement quality gates and monitor platform reliability and performance.
Requires 3+ years of experience in QA/SDET with strong Python and browser automation skills. Candidates must be data-savvy with SQL proficiency and a strong interest in testing non-deterministic AI systems.
Programmatic QA • Testing for LLMs & Agents • Data Quality • Platform Reliability
About Finalytics.ai
Finalytics.ai is the leading provider of personalization for the financial industry. Our platform combines data integrations, machine learning, and real-time technology to make digital experiences more relevant and higher-converting for credit unions and banks. We're a growing startup led by industry veterans, building the next generation of AI-driven personalization.
Why This Role Is Different
QA at Finalytics goes well beyond clicking through a UI. Our platform makes model-driven decisions, runs LLMs and agents that generate content and answer questions, and depends on data pipelines that feed those models every day — and all of it has to be tested programmatically.
We're looking for an engineering-minded QA team contributor to help build quality across three areas: our core personalization features, our LLM and agentic capabilities, and the data that powers them. This is a coding role, embedded in the same repo and release flow as our engineers that will report directly to the CTO. You won't just find bugs — you'll build the automated tests, evals, and data checks that let a small team ship trustworthy AI every sprint.
Our stack is Python/Django with a JavaScript personalization tag, backed by MySQL, Celery, BigQuery, and AWS.
What You'll Do
What We're Looking For
Nice to Have
Why Finalytics
Extractable is a digital strategy, design, and data analytics consultancy focused on the future of financial services.
The world’s gone digital. Still, some financial institutions are struggling to make the transition. As the leading strategic UX and customer insights consultancy for financial service organizations, our deep industry knowledge and extensive data-driven insights can help you turn every digital touch point into an opportunity for measurable business growth. We not only deliver analytics expertise and strategic, top-level planning, we’ll help you build engaging customer experiences that lead to positive outcomes for both you and your customer. We’ll help you identify the digital technology and backend support systems you need to seamlessly implement a solution across all customer channels. We can also provide a platform to monitor and gather customer engagement insights across all these channels—in real time—so you can make adjustments on the fly. Our services include: Deep data analysis and insights Experience design and development Back-office process redesign Customer research Marketing and branding Digital strategy, vision, and planning Strategic technology planning and implementation Consultation for implementing innovative programs
Offices: 44 Montgomery St, 3rd Floor, San Francisco, California 94104, US
Extractable is a digital strategy, design, and data analytics consultancy focused on the future of financial services.
The world’s gone digital. Still, some financial institutions are struggling to make the transition. As the leading strategic UX and customer insights consultancy for financial service organizations, our deep industry knowledge and extensive data-driven insights can help you turn every digital touch point into an opportunity for measurable business growth. We not only deliver analytics expertise and strategic, top-level planning, we’ll help you build engaging customer experiences that lead to positive outcomes for both you and your customer. We’ll help you identify the digital technology and backend support systems you need to seamlessly implement a solution across all customer channels. We can also provide a platform to monitor and gather customer engagement insights across all these channels—in real time—so you can make adjustments on the fly. Our services include: Deep data analysis and insights Experience design and development Back-office process redesign Customer research Marketing and branding Digital strategy, vision, and planning Strategic technology planning and implementation Consultation for implementing innovative programs
Offices: 44 Montgomery St, 3rd Floor, San Francisco, California 94104, US
