Skip to content

FIX: MultiModalMessage in gemini with openai sdk error occured#6440

Merged
ekzhu merged 4 commits into
microsoft:mainfrom
SongChiYoung:FIX/Message_transformer_multimodal_error
May 1, 2025
Merged

FIX: MultiModalMessage in gemini with openai sdk error occured#6440
ekzhu merged 4 commits into
microsoft:mainfrom
SongChiYoung:FIX/Message_transformer_multimodal_error

Conversation

@SongChiYoung
Copy link
Copy Markdown
Contributor

@SongChiYoung SongChiYoung commented Apr 30, 2025

Why are these changes needed?

Multimodal message fill context with other routine. However current _set_empty_to_whitespace is fill with context.
So, error occured.

And, I checked multimodal_user_transformer_funcs and I found it, in this routine, context must not be empty.
Now remove the _set_empty_to_whitespace when multimodal message,

Related issue number

Closes #6439

Checks

@codecov
Copy link
Copy Markdown

codecov Bot commented May 1, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 78.55%. Comparing base (7c29704) to head (fbb74d4).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #6440   +/-   ##
=======================================
  Coverage   78.55%   78.55%           
=======================================
  Files         225      225           
  Lines       16523    16523           
=======================================
  Hits        12979    12979           
  Misses       3544     3544           
Flag Coverage Δ
unittests 78.55% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@ekzhu ekzhu merged commit 6fc4f53 into microsoft:main May 1, 2025
61 checks passed
ChrisBlaa pushed a commit to ChrisBlaa/autogen that referenced this pull request May 8, 2025
…rosoft#6440)

## Why are these changes needed?

Multimodal message fill context with other routine. However current
`_set_empty_to_whitespace` is fill with context.
So, error occured.

And, I checked `multimodal_user_transformer_funcs` and I found it, in
this routine, context must not be empty.
Now remove the `_set_empty_to_whitespace` when multimodal message,
<!-- Please give a short summary of the change and the problem this
solves. -->

## Related issue number

Closes microsoft#6439 

## Checks

- [ ] I've included any doc changes needed for
<https://microsoft.github.io/autogen/>. See
<https://github.com/microsoft/autogen/blob/main/CONTRIBUTING.md> to
build and test documentation locally.
- [x] I've added tests (if relevant) corresponding to the changes
introduced in this PR.
- [x] I've made sure all auto checks have passed.

Co-authored-by: Eric Zhu <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Following the MultiModalMessage example ends up in json decoder error.

2 participants