Find your next open-source project

Search by name, purpose, or keyword — or paste a GitHub repository URL
All skills

preference-optimization

Aligns a fine-tuned model with preference data using DPO, ORPO, KTO or SimPO methods.

  • Part of wshobson/agents
  • 3.2k installs
  • Machine Learning · Fine-tuning and quantization