M

QA Engineering Lead (AI) (Python, PHP)

We’re looking for QA Engineering Leads to set technical direction and lead major quality initiatives for our GenAI products at Meta. You enjoy solving difficult, ambiguous quality problems and building evaluation systems that enable multip…

meta

Зарплата не указанаСШАMenlo Park

We’re looking for QA Engineering Leads to set technical direction and lead major quality initiatives for our GenAI products at Meta. You enjoy solving difficult, ambiguous quality problems and building evaluation systems that enable multiple teams to ship reliable AI experiences. In this hands-on role, you will shape quality strategy across related products and platforms, lead the design and implementation of shared testing and evaluation capabilities, and help other engineers deliver high-quality work.

QA Engineering Lead (AI) Responsibilities:

  • Define and drive the technical quality strategy and roadmap for a major Gen AI initiative spanning multiple engineering teams, balancing product risk, delivery speed, and engineering investment
  • Lead and perform hands-on testing of consumer-facing and business-facing applications, APIs, and AI models, adapting quality priorities and test coverage in a fast-paced development environment
  • Architect and implement shared AI evaluation and test automation systems that support multiple models, products, and platforms, while directly solving the most challenging technical problems
  • Establish consistent evaluation methods, benchmark design, product-aligned weighted scoring frameworks, and quality standards for model behavior and end-to-end product experiences, working with research, engineering, and product partners
  • Lead the development of reliable evaluation signals, including calibration of human and automated judgments, analysis of measurement uncertainty, and investigation of gaps between offline evaluations and real-world outcomes
  • Identify systemic quality risks across models, data, applications, and infrastructure, and lead cross-team efforts to address their root causes
  • Drive quality planning for major launches and phased rollouts, aligning teams on success criteria, dependencies, monitoring, and regression response
  • Define metrics that connect model performance, product reliability, and user experience, and use them to guide quality priorities and investment decisions
  • Lead adoption of reusable evaluation frameworks, automation, and development practices that improve quality while reducing testing costs and time to feedback
  • Partner with engineering, infrastructure, research, product, and data teams to resolve technical trade-offs and influence product and system designs before quality issues emerge
  • Mentor QA engineers and technical leads, provide guidance, and raise the quality of engineering across the broader team

Minimum Qualifications:

  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
  • Currently has, or is in the process of obtaining, a Bachelor’s degree in Computer Science, Computer Engineering, a relevant technical field, or equivalent practical experience. A degree must be completed prior to joining Meta
  • 10+ years of quality assurance, test engineering, or software engineering experience, including substantial experience in building quality engineering systems
  • 3+ years of experience in AI model testing or evaluation, including designing evaluation frameworks and establishing model quality standards
  • Experience successfully leading a major technical quality initiative across multiple teams, from problem definition and architectural design through implementation, rollout, and measurable outcomes
  • Experience architecting and implementing scalable testing, automation, or evaluation systems in Python, PHP, Java, C/C++, or an equivalent programming language
  • Experience solving complex quality and reliability problems across client applications, backend services, and distributed systems
  • Hands-on experience testing consumer-facing and business-facing applications and APIs, and evaluating AI models
  • Hands-on experience with risk-based test strategy, performance and stress testing, and the design and maintenance of client and server test automation
  • Experience evaluating the reliability and limitations of quality metrics and using data to guide technical decisions
  • Experience leading quality engineering in fast-paced development teams, adapting test strategies and priorities as requirements evolve
  • Experience setting technical direction, resolving ambiguous requirements and cross-team dependencies, and influencing stakeholders without direct authority
  • Experience communicating complex technical problems, quality risks, and investment trade-offs to technical and non-technical stakeholders
  • Experience mentoring engineers or technical leads and driving the adoption of quality engineering practices beyond a single project

Preferred Qualifications:

  • Experience leading the evaluation strategy for generative text, image, voice, or multimodal products at scale
  • Experience designing shared evaluation infrastructure or testing frameworks and leading their adoption across multiple engineering teams
  • Experience designing evaluation systems that combine human review, model-based judgments, adversarial testing, and automated regression detection
  • Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
  • Demonstrated improvements in product reliability, evaluation coverage, regression prevention, or engineering efficiency across a major product initiative
  • Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
  • Experience leading cross-platform quality efforts within large engineering organizations and building consensus on technical standards and priorities
  • Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
  • Experience applying frontier AI model evaluation practices, including weighted scoring frameworks for assessing model quality and performance
  • Experience with statistical evaluation methods, benchmark validity, evaluator calibration, and connecting offline evaluation results to production quality
  • Experience partnering with AI research teams and translating evolving research capabilities into scalable product quality practices

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@meta.com.

$163,000/year to $224,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.

Похожие вакансии Ручное тестирование

hh.ru
ibs

Инженер по тестированию (Python / API) / QA Engineer

ibsАвтоподнятие
Зарплата не указанаРоссияОмскУдалёнка

Мы — IBS. Ведущий российский системный интегратор, разработчик цифровых решений для крупнейших компаний и государственного сектора.

Вы присоединитесь к команде, работающей над масштабной HR-платформой — экосистемой для управления персоналом: от подбора и обучения до постановки задач, управления отпусками и больничными. Продукт развивается как внутренняя система с выходом на рынок в модели cloud.

Это сложная ERP-система, состоящая из множества сервисов. Тестирование ведется как на фронтенде, так и на бэкенде, но ключевая задача — проверка бэкенда: API, интеграции, базы данных, бизнес-логика. Нужен специалист, который умеет и тестировать вручную, и писать автотесты на Python (PyTest).

Чем предстоит заниматься (обязанности)

  • Составление тест-кейсов по функционалу (анализ требований, проектирование тестов).

  • Проведение ручного тестирования: проверка нового функционала и регрессионное тестирование.

  • Автоматизация тест-кейсов на Python (PyTest).

  • Тестирование API — проверка контрактов между сервисами, работа с JSON.

  • Написание и выполнение SQL-запросов для проверки данных в БД.

  • Анализ логов (Kibana) для поиска причин ошибок.

  • Взаимодействие с разработчиками и аналитиками для уточнения требований.

Наши требования (компетенции)

Опыт: от 6 месяцев коммерческого опыта автоматизированного тестирования.

Обязательные навыки:

  • Преобладание опыта тестирования backend (API, JSON, SQL, DevTools) — это ключевое требование.

  • PyTest: уверенное знание библиотеки (фикстуры, параметризация, маркеры, фикстуры).

  • Общее владение Python: циклы, базовые алгоритмы, типы данных, методы и функции, классы.

  • Владение базовыми запросами к БД (как минимум до JOIN из нескольких таблиц).

  • Умение описывать и создавать тест-кейсы для автоматизации.

  • Навык интеграционного тестирования.

  • Навык чтения логов (у нас Kibana).

  • Понимание клиент-серверной архитектуры.

  • Знание протокола HTTP, методов, кодов статусов.

Личные качества:

  • Внимание к деталям и системное мышление.

  • Ответственность и самостоятельность.

  • Коммуникабельность — умение четко формулировать проблемы и аргументировать свою позицию.

  • Желание развиваться в автоматизации тестирования.

Будет преимуществом:

  • Опыт тестирования ERP-систем, HR-продуктов или сложных веб-приложений.

  • Понимание процессов управления персоналом (подбор, обучение, кадровый учет).

  • Опыт работы с PostgreSQL.

  • Опыт написания автотестов на API (requests, aiohttp).

  • Знание Git.

  • Опыт работы в крупных компаниях или финансовом секторе.

Условия работы

  • Официальное трудоустройство по ТК РФ.

  • ДМС на сотрудника и детей.

  • Работа над продуктом, который используют десятки тысяч сотрудников.

  • Прозрачная система постановки задач и профессиональная команда.

Как мы работаем

  • Проект развивается по гибким методологиям (Scrum/Kanban).

  • Тесное взаимодействие с разработчиками, аналитиками и владельцами продукта.

  • У нас есть четкие процессы, но при этом мы открыты к улучшениям и инициативам.

    В сопроводительном письме укажите пожалуйста зарплатные ожидания

Эта вакансия также есть на:GetmatchHabr Career
Соц.сети

Fullstack-тестировщик (Java)

от 160k ₽РоссияМоскваУдалёнка

Fullstack-тестировщик (Java) ••••••••

Зарплата: 160 000 ₽ на руки
Местоположение: Москва
Формат работы: Удаленно
Опубликована: ••••••••

Требования:
• Cucumber framework (связка .feature + Java steps)
• SQL-запросы для проверки данных в PostgreSQL
• Концепции Kafka
• Allure Reporting, Jenkins CI/CD

О компании:
•••••••• — проект Сбера; трудоустройство через ИП.

Контакт: ••••••••

•••••••• опубликована в ••••••••

Соц.сети

QA Testing for Trading Platform

Зарплата не указанаНе указана странаЛокация не указанаУдалёнка

QA Testing for Trading Platform
••••••••, Remote

Responsibilities:

— Collaborate with business stakeholders and end users to understand requirements;
— Perform functional testing of team deliverables;
— Conduct manual testing of desktop applications (trading platform);
— Conduct manual testing of mobile applications (web version);
— Utilize AI tools to support daily tasks;
— Create test cases in TestRail;
— Proactively contribute to process improvement initiatives.

Requirements:

— Min 5 years or similar experience;
— Analytical Skills;
— Manual Testing;
— Linux/Unix;
— Good communication skills/proactive;
— Trading experience;
— Automation skills (nice to have);
— Business analysis (nice to have).

••••••••

HireSeeker собирает вакансии со всех площадок и присылает только релевантные. Бесплатно.