yoinka

Director, AI & Tooling

Salesforce

Washington BellevueStaffH-1B sponsor company
Sign in to applyVerified 1h ago
Location
Washington Bellevue
Work model
On-Site
Level
Staff
H-1B history
498 approvals (FY2023)
Posted
19h ago

Skills

GenAILLMSalesforce

About this role

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts. Job Category Operations Job Details About Salesforce Salesforce is the #1 AI CRM, where humans with agents drive customer success together. Here, ambition meets action. Tech meets trust. And innovation isn’t a buzzword — it’s a way of life. The world of work as we know it is changing and we're looking for Trailblazers who are passionate about bettering business and the world through AI, driving innovation, and keeping Salesforce's core values at the heart of it all. Ready to level-up your career at the company leading workforce transformation in the agentic era? You’re in the right place! Agentforce is the future of AI, and you are the future of Salesforce.

About the Role

The Director of Help Agent AI & Tooling leads the team accountable for the generative AI capabilities, evaluation tooling, observability, and emerging program initiatives that power Salesforce's Help Agent — a customer-facing Agentforce deployment and one of Salesforce's flagship Customer Zero implementations. This leader sits at the intersection of AI product strategy, data-driven evaluation, and production excellence, and plays a critical role in ensuring the Help Agent performs reliably, improves continuously, and delivers measurable business value.

Team

Functions This leader directly manages a team covering five core areas: Generative AI Strategy Drive the strategic roadmap for generative AI capabilities within the Help Agent — including retrieval architecture (e.g., Ensemble Retriever), LLM configurations, prompt and planner optimization, and agentic readiness scoring. Partner closely with Tech & Product, and other technology teams to influence the Help Agent roadmap and direct engineering relationships. Evaluations Tooling Own the end-to-end evaluations tooling strategy for Help Agent performance — including the Testing Center, Agentforce Testing Agents (ATA), and custom evaluation frameworks. Define and track answer quality metrics including completeness, correctness, relevance, faithfulness, clarity, and latency. Manage tooling gaps, coordinate with Tech & Product on product priorities, and expand evaluation capabilities toward greater scale and automation. Help Agent Observability Lead the observability program for the Help Agent — encompassing real-time performance monitoring, session tracing, error analysis, failure clustering, and business impact measurement. Serve as the primary stakeholder and voice of the Customer Zero on the Tech & Product Observability product roadmap. Coordinate with Technology Teams to converge on a comprehensive, always-on observability solution that replaces fragmented tooling. NNAOV Program Management Oversee the Net New Annual Order Value (NNAOV) program, driving pipeline generation through the Help Agent. Partner with the dedicated NNAOV Program Manager to define program goals, manage intake, and report on business outcomes.   AI Skill & Application Development Support the creation and delivery of AI Skills via applications like Slackbot, Claude Code and others to support the team's ability to deliver evaluations, insights, and opportunity sourcing for Roadmap development.

Key Responsibilities

Serve as the AI & Tooling team lead within Digital Success Data & AI, setting team mission, operating model, and priorities Act as a Customer Zero steward — representing Salesforce's own use of Agentforce as a reference customer, surfacing product gaps and driving roadmap influence through Shiproom intakes and direct T&P partnerships Monitor and manage Help Agent production health, including end-to-end latency, engagement rate, escalation rate, resolution rate, and quality scores — escalating issues and coordinating cross-functional remediation as needed Lead cross-functional collaboration with Technology Teams to align on evaluations, retrieval strategies,

Director, AI & Tooling at Salesforce, Washington Bellevue | Yoinka