First Monday
Jobs
Jobs open to youOnly jobs that can hire where you liveA CV for each jobWritten from your record, every line checkedMemoryIt remembers, so you don’t repeat yourselfInterview helpResearch, prep and hints only you seeWatch how it works0:28
FAQDocsUse in AI, Free
Your countryNorth AmericaEuropeAsia-PacificLatin AmericaNot on the list? Tell us where you liveRequest early accessEarly access
First Monday

Remote jobs that can actually hire you.

Beta formacOSWindows

Jobs

Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico

Product

Jobs open to youA CV for each jobMemoryInterview helpHow it works

Company

FAQContact

Legal

Privacy PolicyTerms & Conditions
Jobs
Jobs open to you in CanadaRemote jobs in the USRemote jobs in PolandRemote jobs in the UKRemote jobs in CanadaRemote jobs in Mexico
Product
Jobs open to youA CV for each jobMemoryInterview helpHow it works
Company
FAQContact
Legal
Privacy PolicyTerms & Conditions
Remote jobs by country
United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand

Remote jobs by country

United StatesPolandUnited KingdomCanadaMexicoBrazilGermanySpainPortugalIrelandNetherlandsIndiaSwedenBelgiumAustriaDenmarkFinlandSwitzerlandNorwayAustraliaNew Zealand
© 2026 First MondayNo tracking cookies. Anonymous page statistics only.
First Monday
Jobs/Engineering/QA Engineer

QA Engineer

Xperteez Technology

Remote · WorldwideEngineeringPosted September 9, 2026
Open to people in 21 countriesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Quality assurance, Software testing, Test case design, Human Data, English (B2 level or above)
Nice to have
Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack
Posted
September 9, 2026
Company
Xperteez Technology

Who it can hire

We read the post for each of the 21 countries we cover.

  • Open to people in the US, Canada, the UK, Ireland, Germany, the Netherlands, Belgium, Austria, Switzerland, Sweden, Denmark, Norway, Finland, Poland, Spain, Portugal, Australia, New Zealand, Mexico, Brazil and India

    The employer lists this job as remote there: “Remote (International)”.

The job post

Role Title: QA Engineer

Role Type: Contractor

Location: Remote

We are engaging QA Engineers to contribute expertise in software quality evaluation for a customer's high-volume project. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters. This opportunity is open to specialists who have both strong QA backgrounds and prior paid experience with human data annotation, RLHF, model output evaluation, or rubric-based grading for AI training. Software QA experience alone, without a human-in-the-loop AI evaluation component, does not count toward this requirement.

Required Skills

  • Quality Assurance

  • Software Testing

  • Test Case Design

  • Automation Testing

  • Regression Testing

  • Bug Tracking

  • Test Management Tools

  • Selenium

  • Manual & Automated Testing

  • Bug Reporting

  • Quality Evaluation

  • Human Data

Scope of Work

  • Evaluate and rate AI-generated technical outputs against defined quality criteria and rubrics, identifying answers that may appear correct but are actually inaccurate or incomplete.

  • Design and assess comprehensive test cases for functional, regression, and edge-case scenarios, including negative and boundary tests.

  • Review bug reports and test documentation to ensure issues are reproducible, documentation is complete, and severity is properly assessed.

  • Identify, isolate, and document defects with precise reproduction steps and utilize structured tracking mechanisms.

  • Provide detailed, actionable written feedback and annotations to support efficient resolution by developers without the need for clarification.

  • Collaborate with project teams to refine evaluation guidelines and ensure continuous improvement of testing standards and methodologies.

Preferred Qualifications

  • Proven professional experience as a QA Engineer, SDET, Test Engineer, QA Analyst, or similar role in software quality assurance.

  • Strong command of QA fundamentals, including test case design, bug tracking, regression testing, and both manual and automated testing strategies.

  • Hands-on experience with automation frameworks and test management tools such as Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, or BrowserStack (or similar tools).

  • Prior paid human data experience supporting AI training—such as annotation, labeling, RLHF, AI response evaluation, model evaluation, or rubric-based grading—is a firm project requirement.

  • Excellent analytical and problem-solving skills with meticulous attention to detail.

  • Ability to communicate complex findings clearly in written English, providing specific, actionable feedback (B2 level or above).

  • No formal degree required—practical, demonstrable testing experience takes precedence.

  • Reliable internet connection and readiness to begin promptly.

First Monday isn’t the employer or a recruiter and isn’t affiliated with Xperteez Technology. Details may have changed since; confirm with the employer before you apply.

Open to people in 21 countriesApply for this job Write my CV for this job Early access
Pay
Not stated
Required
Quality assurance, Software testing, Test case design, Human Data, English (B2 level or above)
Nice to have
Selenium, Playwright, Cypress, Appium, Postman, Jira, TestRail, Zephyr, BrowserStack
Posted
September 9, 2026
Company
Xperteez Technology

Similar jobs open to people in the United States

PQuality Assurance EngineerProphetX · Remote · USQA Engineer: AI-Assisted TestingECFX · United StatesQuality AnalystIrth Solutions · United StatesMSenior QA EngineerMakai Digital · Remote · South America, US, Canada
First Monday

Get jobs like this every Monday.

One email a week with new remote jobs open to people in Canada. Free, and one click to unsubscribe. Privacy

Or request early access to the app
Apply for this job