hackajob is collaborating with Mercor to connect them with exceptional professionals for this role.

Mercor is looking for a **Bilingual Portuguese STEM Expert** with experience in **biology / physics / chemistry** theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in **biology / physics / chemistry** will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate **Portuguese /English** prompts and responses, ensuring scientific precision while maintaining clear, natural **Portuguese** phrasing and alignment with English where needed. * * * ## **Job Details** - **Design and Optimize STEM-Based Prompts (Bilingual):** Create detailed prompts in **Portuguese** and/or English with multiple constraints and scientific instructions. - **Define and Document Evaluation Standards:** Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in **Portuguese**—linguistic clarity and appropriate academic tone. - **Conduct Model Testing and Grading (Bilingual):** Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing **Portuguese vs. English** where needed. - **Support Benchmarking and Quality Assurance:** Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across **Portuguese-language** benchmarks before integration into official benchmarks. * * * ## **Minimum Qualifications** - Native-level fluency in **Portuguese (written)** with strong reading/writing ability in English - BS or BA in **Biology / Physics / Chemistry** - Familiarity with undergraduate-level **biology / physics / chemistry** topics - Strong writing and critical thinking skills - Ability to work independently and meet deadlines * * * ## **Preferred Qualifications** - **2+ years** of experience in teaching, research, or an applied STEM discipline field * * * ## **Application & Onboarding Process** - Complete an AI-led interview (around **15 minutes**) - Complete a **45-minute** written assessment that will guide you through writing rubrics - If selected, you will be invited to work on the project * * * ## **More Details About This Role** - Expect to contribute at least **20 hours per week** - Expect a commitment of around **1 month** - You’ll be working in a structured project environment with clear goals and tools