Skip to content

v0.0.2.dev0

Pre-release
Pre-release
Compare
Choose a tag to compare
@shadeMe shadeMe released this 24 Jun 10:01
· 89 commits to main since this release
9b29ac4

What's Changed

  • feat: Implement PipelinePair primitive and related utility functions by @shadeMe in #4
  • feat: Implement abstract EvaluationHarness class by @shadeMe in #5
  • refactor: Restructure submodules in evaluation by @shadeMe in #6
  • feat: Implement RAGEvaluationHarness and related classes by @shadeMe in #10
  • Add context to the README by @masci in #7
  • fix: Wheel paths for builds by @shadeMe in #12
  • fix: Correct parameter name for faithfulness evaluator and fix component names passed to PipelinePair by @shadeMe in #13
  • adding the OpenAIFunctionCaller by @TuanaCelik in #14
  • feat: Add ContextRelevanceEvaluator to RAG eval harness by @shadeMe in #15
  • feat: LLM-based Evaluators have raise_on_Failure=False by default by @davidsbatista in #16
  • feat: Add ground truth documents and answers to RAG eval run results as inputs by @shadeMe in #17
  • chore: Add OpenAIFuntionCaller to catalogue by @julian-risch in #18
  • build: Fetch build version from Git tag by @shadeMe in #19

New Contributors

Full Changelog: v0.0.1...v0.0.2.dev0