v0.0.2.dev0
Pre-release
Pre-release
What's Changed
- feat: Implement
PipelinePair
primitive and related utility functions by @shadeMe in #4 - feat: Implement abstract
EvaluationHarness
class by @shadeMe in #5 - refactor: Restructure submodules in
evaluation
by @shadeMe in #6 - feat: Implement
RAGEvaluationHarness
and related classes by @shadeMe in #10 - Add context to the README by @masci in #7
- fix: Wheel paths for builds by @shadeMe in #12
- fix: Correct parameter name for faithfulness evaluator and fix component names passed to
PipelinePair
by @shadeMe in #13 - adding the OpenAIFunctionCaller by @TuanaCelik in #14
- feat: Add
ContextRelevanceEvaluator
to RAG eval harness by @shadeMe in #15 - feat: LLM-based Evaluators have
raise_on_Failure=False
by default by @davidsbatista in #16 - feat: Add ground truth documents and answers to RAG eval run results as inputs by @shadeMe in #17
- chore: Add OpenAIFuntionCaller to catalogue by @julian-risch in #18
- build: Fetch build version from Git tag by @shadeMe in #19
New Contributors
- @masci made their first contribution in #7
- @TuanaCelik made their first contribution in #14
- @davidsbatista made their first contribution in #16
- @julian-risch made their first contribution in #18
Full Changelog: v0.0.1...v0.0.2.dev0