yoinka

Subject Matter Expert - Child Safety

Reflection AI

New York, NYFull TimeMid
Sign in to applyVerified 2h ago
Location
New York, NY
Employment
Full Time
Work model
On-Site
Level
Mid
Posted
4h ago

Skills

GenAIPythonSQL

About this role

Our Mission

Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all.

Role

Overview As a Subject Matter Expert, Child Safety, you are our internal authority on preventing, detecting, and responding to child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) generated or facilitated through Reflection's models and products. You will define how the lab thinks about child safety, translate that expertise into concrete enforcement workflows and detection strategies, and act as a critical gatekeeper ensuring our open releases meet our child safety commitments. You will own child safety evaluations, human grading, auto-grading, enforcement end to end: standing up and scaling review workflows, serving as the primary point of contact for those who conduct content review, as well as conduct them yourself, driving model launch evals on novel or ambiguous cases, and partnering closely with our the technical Safety team, Alignment, Policy, and Legal teams to close gaps as the threat landscape evolves. You will also represent Reflection's child safety work externally with reporting bodies, NGOs, researchers, and, where appropriate, law enforcement. Because we ship open weights, the stakes are distinctive: your judgment shapes safeguards that must hold up in adversarial, real-world use. In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Reflection takes the wellbeing of team members working in this area seriously and provides access to wellness resources, trauma-informed support, and appropriate operational safeguards. We ask candidates to consider this aspect of the role carefully before applying.

What You'll Do

Serve as Reflection's internal subject matter expert on child safety, CSAM/CSEM, and online child sexual exploitation and abuse (CSEA), and set the standards, definitions, and escalation thresholds the lab operates against. Partner with Safety research and engineering teams to create new automated evaluations. Own the day-to-day operation of child safety content evaluation and review workflows, including task routing, queue management, quality assurance, escalation handling, and SLA monitoring. Serve as the primary point of contact for review partners conducting child safety content review, including onboarding, training, calibration, and ongoing support. Review novel or ambiguous flagged content to drive enforcement decisions, and surface policy and product gaps to the Alignment, Safety, and Policy teams. Partner with engineering to design, evaluate, and improve detection models, hash-matching pipelines, and automated enforcement systems, and to build child safety considerations into our pre-release evaluation and red-teaming process. Validate that models meet Reflection's child safety risk thresholds before open weights ship. Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate, consistent enforcement at scale. Identify and report emerging misuse patterns and threat actor behavior to internal stakeholders across the company. Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Reflection policy. Stay current on evolving legal frameworks, enforcement best practices, and child safety technology, and use these to keep our workflows ahead of the threat landscape.

What We're Looking For

Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection. Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related harm areas.

Subject Matter Expert - Child Safety at Reflection AI, New York, NY | Yoinka