Skip to content

dev to main - #20

Merged
srikanth-malyala merged 2 commits into
mainfrom
dev
Dec 11, 2024
Merged

srikanth-malyala merged 2 commits into
mainfrom
dev

Conversation

@srikanth-malyala

Copy link
Copy Markdown

Pull Request

Description

Describe the changes in this pull request:

  • What feature/bug does this PR address?
  • Provide any relevant links or screenshots.

Checklist

  • Code compiles correctly.
  • Created/updated tests.
  • Linting and formatting applied.
  • Documentation updated.

Related Issues

Closes #<issue_number>

- Update conversation evaluation templates with more realistic test cases
- Streamline safety evaluation types by removing redundant checks
- Update RAGAS evaluation metrics to remove deprecated ones
- Standardize context evaluation documentation and examples
- Add missing AgentJudge evaluation type to custom evaluations

Key changes:
- Conversation templates now use math homework example for better clarity
- Removed redundant safety checks like ProfanityFree and NotUnusualPrompt
- Removed deprecated RAGAS metrics (AnswerSemanticSimilarity, Maliciousness)
- Updated context evaluation documentation with comprehensive examples
- Added AgentJudge as new custom evaluation type
@srikanth-malyala
srikanth-malyala merged commit 8ebb100 into main Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants