Get Started

Our Research and Science

Building the future of behavioral health AI—with clinical insight, transparent benchmarking, and peer-reviewed validation.

At mpathic, our scientific foundation is rooted in decades of research across behavioral health, communication science, and machine learning. We collaborate with clinicians, researchers, and technical experts to develop AI systems that are not only high-performing—but measurable, interpretable, and clinically trustworthy. Our benchmarking process compares AI predictions to gold-standard human judgments, helping ensure that our models reflect real-world clinical reasoning and uphold the highest standards of safety and quality.

How We Benchmark Our Models 

mpathic’s models are benchmarked against human expert raters using established coding systems and safety frameworks. Coders will establish interrater reliability with each other prior to establishing a ground-truth dataset or other evaluation framework to measure a model’s performance. We evaluate performance using multiple metrics to ensure consistency, reliability, and alignment with human judgment: 

  • Absolute Agreement: Measures direct label match between AI and expert coders.  
  • Precision: Percentage of AI-labeled behaviors that match expert annotations. 
  • Recall: Percentage of expert-identified behaviors that are correctly identified by the model. 
  • F1 Score: Harmonic mean of precision and recall—used for overall model reliability. 

These evaluations span multiple domains including motivational interviewing, empathy and soft skills in medical settings, clinical risk and misconduct, and patient adherence. 

Key Research Themes 

Our work bridges applied science and technical rigor. The following peer-reviewed studies demonstrate our contributions across fidelity evaluation, AI ethics, and health system impact: 

1. Fidelity & Skill Evaluation in Clinical Settings 

2. Safety, Equity & Cultural Responsiveness 

3. LLM Behavior, Summarization & Clinical Relevance 

4. Multimodal & Cross-Context Use 

Publications

Learn how mpathic’s evidence-based approach is grounded in rigorous research and continuous validation. Our studies demonstrate the measurable impact of empathic communication across industries.

View full list of publications

Collaborate with our research team

Our research team actively engages in collaborations that advance the scientific understanding of empathic communication and its applications across diverse fields. We welcome inquiries from scholars, institutions, and organizations interested in joint studies, data partnerships, or applied research initiatives.

Email us