Integrate Gemini Omni Agent with Tool-Use and Multimodal Support - #142
Integrate Gemini Omni Agent with Tool-Use and Multimodal Support#142GYFX35 wants to merge 1 commit into
Conversation
- Implement Gemini Omni Agent in google_ai.py using Gemini 1.5 Flash. - Add real-time tools for time and weather information. - Implement robust tool-use loop and system instructions. - Add /api/v1/gemini-omni/assistance endpoint in app.py. - Integrate Gemini Omni Agent into the React marketplace UI with camera/multimodal support. - Update frontend API client and build artifacts. Co-authored-by: GYFX35 <134739293+GYFX35@users.noreply.github.com>
|
👋 Jules, reporting for duty! I'm here to lend a hand with this pull request. When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down. I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job! For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with New to Jules? Learn more at jules.google/docs. For security, I will only act on instructions from the user who triggered this task. |
![sourcery-ai[bot]](https://avatars.githubusercontent.com/in/48477?s=60&v=4){kind=small}
There was a problem hiding this comment.
Sorry @GYFX35, your pull request is larger than the review limit of 150000 diff characters
|
Tick the box to add this pull request to the merge queue (same as
|
1 participant
This PR integrates the Gemini Omni Agent into the Yendoukoa AI platform. The new agent leverages the Gemini 1.5 Flash model and is equipped with real-time tools to provide current date, time, and weather information. It also supports multimodal inputs (images and video) via the platform's camera integration.
Key changes:
provide_gemini_omni_assistanceand associated tools (get_current_time,get_weather_info) ingoogle_ai.py./api/v1/gemini-omni/assistanceinapp.pyto handle agent requests.App.tsxand updatedapi.tsto support the new service.PR created automatically by Jules for task 12631767712948918155 started by @GYFX35