Minimum qualifications:
- Bachelor's degree or equivalent practical experience.
- 4 years of experience in Trust and Safety Operations, data analytics, policy, cybersecurity, product policy, privacy and security, legal, compliance, risk management, intel, content moderation, AI testing or other relevant environment.
Preferred qualifications:
- Experience in business process analysis, operations management or global program management, or leading cross-functional process improvements.
- Understanding of AI systems, machine learning, and their potential risks or experience working with Google's products and services, particularly GenAI products.
- Ability to think and identify emerging threats and vulnerabilities and have experience using data to provide solutions and recommendations.
- Excellent communication and presentation skills (written and verbal) and the ability to influence cross-functionally at various levels.
- Excellent problem-solving, critical thinking skills and attention to detail in an ever-changing environment and ability to work independently and with a high degree of initiative.
About the job
Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.
As a Child Safety Analyst, you will be an expert in structured and unstructured safety pre-launch testing for Google's GenAI models and products, focused on the broad spectrum of online child abuse and exploitation risks. You will partner with the technical abuse-fighting experts in Trust and Safety to understand launch requirements, and to develop and implement testing protocols. You will leverage data analysis to provide quantitative and qualitative actionable insights on potential risks for mitigation by T and S and product teams. You will demonstrate analytical thinking through data-driven decision making, technical know-how, and your ability to think, collaborate across teams, and execute quickly will be instrumental in shaping the future of AI development, ensuring that Google's AI products do not generate content of children that is unsafe.
At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.
Responsibilities
- Own and lead structured pre-launch child safety testing, end to end, for Google’s most prominent GenAI products.
- Align on the standards, driving consistency across product areas and translating standards into clear guidelines for evaluation product output.
- Define and execute prompt generation strategies and executing prompt/response ratings against defined standards and develop reusable frameworks, processes, programs and best practices.
- Conduct in-depth quantitative and qualitative analysis of results, including unexpected, interesting and edge cases, providing clear insights to inform decision-making around pre and post-launch mitigation steps.
- Be comfortable to work with sensitive content or situations that are exposed to graphic, controversial or upsetting topics or content.
Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also
Google's EEO Policy and
EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our
Accommodations for Applicants form.