Senior Data Scientist – AI Research & Evaluation

Job Summary/Overview

The company is seeking a mission-driven Senior Data Scientist to join its AI Research & Data Science team. In this pivotal role, you’ll transform cutting-edge language model research into meaningful, faith-aligned product insights that drive real-world impact. You will lead the end-to-end experimentation lifecycle—from causal test design and metric development to automation and deployment—ensuring model outputs are trustworthy, fair, and aligned with the company’s mission to promote human flourishing through technology.

This position combines hands-on data analysis with strategic decision-making, working closely with engineers, product managers, and researchers to develop scalable systems, insightful dashboards, and robust evaluation frameworks. Ideal candidates are passionate about shaping AI for good, deeply experienced in statistical modeling, and excited to work in a collaborative, values-driven environment.

Key Responsibilities

Research & Technical Excellence

• Design and implement evaluation pipelines for model accuracy, bias, hallucination, latency, and cost.
• Develop and validate custom metrics that represent human flourishing
• Build instrumentation and automation for regression, drift detection, and lineage tracking in data pipelines.
• Contribute to internal knowledge-sharing through whitepapers, journal clubs, and mentorship.

Delivery

• Own the full analytics pipeline—from querying large datasets to surfacing insights via dashboards or internal tools.
• Standardize and accelerate experimentation using templates for A/B testing, Bayesian bandits, and other frameworks.
• Optimize performance across data workflows, inference pipelines, and labeling systems.

Strategic Clarity

• Collaborate cross-functionally to align metrics and datasets with mission-driven product outcomes.
• Communicate data trade-offs (e.g., GPU cost vs. accuracy vs. privacy) with clear recommendations to stakeholders.
• Maintain living documentation of metrics, governance rules, and experimentation checklists.

Collaboration

• Partner with infrastructure, security, and UX teams to ensure scalable, secure, and well-instrumented systems.
• Foster open dialogue, surfacing risks and driving evidence-based decision-making across functions.

Leadership & Influence

• Mentor junior analysts and engineers; elevate team competency in statistics and experimentation.
• Advocate for data-driven solutions even in the face of intuition-based resistance.
• Lead retrospectives, capture learnings, and continuously improve experimentation processes.

Required Qualifications

• Advanced degree or equivalent experience (e.g., peer-reviewed publications or high-impact data products).
• 5+ years in product or research-focused data science roles.
• Strong proficiency in SQL and Python (NumPy, Pandas); comfortable across ETL, analysis, and dashboarding.
• Deep experience with causal inference, A/B and switchback testing, and metric development.
• Proven ability to evaluate and partner on large language model (LLM) analytics.
• Excellent communication skills, with a knack for translating complex statistics into actionable insights.

Preferred Qualifications

• Hands-on experience with LLM evaluation, bias audits, or prompt analysis tooling.
• Familiarity with modern MLOps tools (e.g., Ray, Airflow, Kubernetes) and GPU cost tracking.
• Open-source contributions (e.g., repos with >500 GitHub stars) or relevant academic publications (NeurIPS, ICML, KDD).
• Experience in faith-aligned, mission-driven, or nonprofit-focused environments.

Additional Information

Location

• Hybrid role based in Sewickley, PA (Pittsburgh area) preferred
• Remote work available for highly qualified candidates

Work Environment & Benefits

• Flexible PTO and compliant sick leave policy
• Medical, dental, and vision insurance with up to 90% coverage for employees
• Generous employer HSA contributions for HDHP plans
• Employer-sponsored 401(k) with 2% match
• Learning & development stipend (available after 6 months)
• Paid parental leave
• Hybrid work environment with in-person and virtual team events
• Collaborative and mission-aligned team culture

Eligibility

Applicants must be currently authorized to work in the United States. Only U.S. Citizens or U.S. Permanent Residents are eligible for consideration at this time.