Senior UX Language Researcher - Variable Staffing Pool

Become a part of our caring community   Who We Are With relentless consumer-centricity, Humana's Experience Design team, within the Consumer Digital organization, strives to eliminate friction in today's healthcare ecosystem so consumers feel confident, respected, and heard in the decisions affecting their health. The Senior UX Language Researcher (VSP/PT) must have a passion for data, efficiency, accuracy, and should be capable of: Analyzing conversational transcripts for industry standard metrics like accuracy, fallback rate, hallucination rate etc. Familiarity with LLMs; how they work, how to prompt them effectively, and how to evaluate the quality of their outputs Familiarity analyzing conversational chat and call transcripts with tools like Python, R, SQL Experience managing transcription and annotation projects including for LLM-based metrics Deep knowledge of language data labeling best practices, including transcription and annotation for conversational data Providing data quality expertise cross-functionally and advocating for best practices Delivering high-quality work in a fast-paced environment Working autonomously with minimal direction Contributing to process improvements to reduce time and improve output Improving software tools by identifying bugs and suggesting enhancements Diving deep into issues and implementing solutions independently Proactively addressing issues and problems Keeping up with changing project conventions and priorities Additional Responsibilities Label, evaluate, and ensure the quality of datasets. Work closely with UX, Product and Engineering to understand data ambiguities and resolve issues in conversational data. Conduct in-depth qualitative error trend analysis, developing action plans to enhance data quality. Conduct in depth quantitative data analyses to develop new metrics for tracking conversational experience performance and drive enhancements to the user experience Use your skills to make an impact   Required Qualifications 5+ years of related experience 2+ years of computational linguistics, language data processing, semantics, or syntax experience Bachelor's degree or equivalent Experience in natural language data labeling, data annotation, linguistic annotation or other forms of data markup, as well as working cross-functionally with different stakeholders Experience using Python, R, SQL for language data analysis Experience using Microsoft Excel for data analysis, formulae, and data visualization Preferred Qualifications Experience that includes strong analytical skills, attention to detail, and effective communication abilities Interest in pragmatics and conversational design Ability to navigate a Unix terminal and use common command line tools Additional Information This role is part of the Variable Staffing Pool (VSP) and pays at an hourly rate. Variable Staffing Pool Humana associates work part-time to full-time hours based on business need. VSP associates are not eligible for associate bonuses and receive limited benefits, which are effective upon hire. Work hours may vary based on business needs and assigned tasks. Work at Home Requirements: To ensure Home or Hybrid Home/Office employees’ ability to work effectively, the self-provided internet service of Home or Hybrid Home/Office employees must meet the following criteria: At minimum, a download speed of 25 Mbps and an upload speed of 10 Mbps is required; wireless, wired cable or DSL connection is suggested. In certain roles, the minimum recommended internet speed required by Humana may not be sufficient for business needs. Humana reserves the right to require associates to upgrade their internet service if necessary. Work from a dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information.   Travel: While this is a remote position, occasional travel to Humana's offices for training or meetings may be required.   Scheduled Weekly Hours 1 Pay Range The compensation range below