[Draft] Enable File Upload/Paste as Task in AGS #6091
Conversation
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## main #6091 +/- ##
=======================================
Coverage 77.27% 77.27%
=======================================
Files 200 200
Lines 14322 14322
=======================================
Hits 11068 11068
Misses 3254 3254
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
Thank you Victor! Let me make sure I understand the flow: in chat_input, user uploads a file (or multiple), it gets appended to FileList (upload supported on paste events and the upload button). I noticed the 5b file size limit, is this just for convenience or is there limits due to the webapp? once a user submits, we send the file alongside the task string to the websocket in start_stream, we take the files uploaded, and construct a task from them, which can be a MultiModal message if the uploaded file was an image. This is then uses for the run_stream method of the team, and the rest of the code is as usual. |
Yes, that is correct. |
|
You havent added the changes to runview, Now the task is saved as an object in RUN table. |
|
@KanikaChoudhary1312 , that is correct. |
victordibia
changed the title
* upstream/main: (120 commits) Update discover.md with adding email agent package (microsoft#6274) Expose TCM TypedDict classes for apps to use (microsoft#6269) Fix publish_message-method() notes (microsoft#6250) Fix ValueError: Dataclass has a union type error (microsoft#6266) [Bugfix] Fix for Issue microsoft#6241 - ChromaDB removed IncludeEnum (microsoft#6260) Add note on ModelInfo for Gemini Models (microsoft#6259) .NET update autogen 0.2.2 -> autogen 0.2.3 (microsoft#6257) [Draft] Enable File Upload/Paste as Task in AGS (microsoft#6091) Bugfix/azure ai search embedding (microsoft#6248) Expose more Task-Centric Memory parameters (microsoft#6246) fix: typo in usage.md (microsoft#6245) .NET update oai and aoai package version (microsoft#6239) Fix sha256_hash docstring (microsoft#6236) Update json_schema_to_pydantic version and make relaxed requirement on arry item. (microsoft#6209) Fix terminations conditions. (microsoft#6229) Docker Code Exec delete temp files (microsoft#6211) clean codes notes for autogen-core. (microsoft#6218) Fix/transformer aware any modelfamily (microsoft#6213) chore: Add powershell path check for code executor (microsoft#6212) added: gemini 2.5 pro preview (microsoft#6226) ... Signed-off-by: Peter Jausovec <[email protected]>
Why are these changes needed?
imagetaskags.mp4
Enable file upload/paste as a task in AGS. Enables tasks like
Only text and images supported for now
Underneath, it constructs TextMessage and Multimodal messages as the task.
Related issue number
Closes #5773
Checks