Skip to content

Releases: deepset-ai/haystack-experimental

v0.3.0

31 Oct 09:47
4e1b37a
Compare
Choose a tag to compare

New Experiments

Full Changelog: v0.2.0...v0.3.0

v0.2.0

01 Oct 12:50
8e26bf2
Compare
Choose a tag to compare

New experiments

New Contributors

Full Changelog: v0.1.1...v0.2.0

v0.1.1

29 Jul 08:54
46726dd
Compare
Choose a tag to compare

What's Changed

  • Add google colab link to the example harness nb by @bilgeyucel in #36
  • doc: Fix links to API docs and pip packages in RAG eval harness notebook by @shadeMe in #38
  • Improve OpenAPITool corner cases handling (missing operationId, servers under paths, etc) by @vblagoje in #37
  • fix: Centralize OpenAPI schema reference resolution by @vblagoje in #40
  • feat: Add telemetry to RAG eval harness by @shadeMe in #42
  • docs: Add section about telemetry to the readme by @shadeMe in #44
  • docs: add OpenAPITool notebook by @anakin87 in #45

New Contributors

Full Changelog: v0.1.0...v0.1.1

v0.1.0

08 Jul 11:57
438ee6b
Compare
Choose a tag to compare

New Experiments 🚀

Full Changelog: v0.0.1...v0.1.0

v0.0.2.dev0

24 Jun 10:01
9b29ac4
Compare
Choose a tag to compare
v0.0.2.dev0 Pre-release
Pre-release

What's Changed

  • feat: Implement PipelinePair primitive and related utility functions by @shadeMe in #4
  • feat: Implement abstract EvaluationHarness class by @shadeMe in #5
  • refactor: Restructure submodules in evaluation by @shadeMe in #6
  • feat: Implement RAGEvaluationHarness and related classes by @shadeMe in #10
  • Add context to the README by @masci in #7
  • fix: Wheel paths for builds by @shadeMe in #12
  • fix: Correct parameter name for faithfulness evaluator and fix component names passed to PipelinePair by @shadeMe in #13
  • adding the OpenAIFunctionCaller by @TuanaCelik in #14
  • feat: Add ContextRelevanceEvaluator to RAG eval harness by @shadeMe in #15
  • feat: LLM-based Evaluators have raise_on_Failure=False by default by @davidsbatista in #16
  • feat: Add ground truth documents and answers to RAG eval run results as inputs by @shadeMe in #17
  • chore: Add OpenAIFuntionCaller to catalogue by @julian-risch in #18
  • build: Fetch build version from Git tag by @shadeMe in #19

New Contributors

Full Changelog: v0.0.1...v0.0.2.dev0

v0.0.1

22 May 09:04
c1f4858
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: https://github.com/deepset-ai/haystack-experimental/commits/v0.0.1