-
Notifications
You must be signed in to change notification settings - Fork 6
Expand file tree
/
Copy pathvalidate_output.txt
More file actions
128 lines (105 loc) · 6.34 KB
/
Copy pathvalidate_output.txt
File metadata and controls
128 lines (105 loc) · 6.34 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DAB8B7610>
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DAB7F0B90>
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DAB8B7750>
GroupChatOrchestrator reached max_rounds=4; forcing completion.
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DAB9739D0>
======================================================================
AGENT PATTERNS DEMO VALIDATION
======================================================================
======================================================================
1. Maker-Checker PR Review
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
Time: 65.3s
Total events: 19
Messages: 0 | Started: 9 | Completed: 10 | Handoffs: 0 | Errors: 0
Agents with output: {'Reviewer', 'Worker'}
PASS
Cooldown 5s before next demo...
======================================================================
2. Hierarchical Research Brief
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
Time: 80.2s
Total events: 15
Messages: 3 | Started: 6 | Completed: 6 | Handoffs: 0 | Errors: 0
Agents with output: {'unknown', 'Manager', 'Specialist_B', 'Synthesizer', 'Specialist_A'}
[Manager] 1. Technical/implementation: What concrete model sizes, compression strategies, and runtime stacks are required to deliv...
[unknown] On-device enterprise LLM/RAG and basic multimodal tasks are feasible today by using 3�13B parameter models quantized to ...
[Synthesizer] **Key Finding** Enterprise?grade, secure on?device LLM and RAG workloads are technically viable today and offer a 4?6?...
PASS
Cooldown 5s before next demo...
======================================================================
3. Hand-off Customer Support
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
HandoffOrchestrator reached max events (150); forcing completion.
Time: 49.6s
Total events: 5
Messages: 0 | Started: 2 | Completed: 2 | Handoffs: 1 | Errors: 0
MISSING: No support agent (Billing/TechSupport) produced output
Agents with output: {"HandoffSentEvent(source='Triage', target='Billing')", 'Triage'}
WARN � 1 issue(s)
Cooldown 5s before next demo...
======================================================================
4. Network Brainstorm
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
Time: 67.3s
Total events: 12
Messages: 0 | Started: 6 | Completed: 6 | Handoffs: 0 | Errors: 0
Agents with output: {'Synthesizer', 'Pragmatist', 'Innovator', 'DevilsAdvocate'}
PASS
Cooldown 5s before next demo...
======================================================================
5. Supervisor Router
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
Time: 25.1s
Total events: 9
Messages: 2 | Started: 3 | Completed: 3 | Handoffs: 1 | Errors: 0
Routed to: {'CodeExpert'}
Agents with output: {'CodeExpert', 'Supervisor'}
[Supervisor] ROUTE: CodeExpert This request is a coding task (writing a Python function to read a CSV, group rows, and compute top c...
[CodeExpert] ```python import csv import re import warnings from collections import defaultdict from typing import List, Tuple def t...
PASS
Cooldown 5s before next demo...
======================================================================
6. Swarm + Auditor
======================================================================
[foundry_client] Microsoft Foundry: https://leestott-build-resource.services.ai.azure.com/api/projects/lee-build -> 'model-router-1'
Time: 37.1s
Total events: 17
Messages: 5 | Started: 6 | Completed: 6 | Handoffs: 0 | Errors: 0
Agents with output: {'Selector', 'Generator_B', 'Generator_C', 'Auditor', 'Generator_A'}
[Generator_C] PROPOSAL C: Launch a staged, low-risk FinOps + internal platform program that standardizes provisioning and enforces cos...
[Generator_B] PROPOSAL B: Launch a focused cloud cost-optimization program that combines immediate rightsizing and shut?off of idle re...
[Generator_A] PROPOSAL A: Build an autonomous, cost-aware platform (�Cloud Economy Engine�) that transparently places each workload on...
[Auditor] SCORES: A: Feasibility=4 Impact=9 Cost=5 Total=18 One-sentence rationale: Very high long-term impact if successful, ...
[Selector] WINNER: B Justification: Proposal B has the highest total score (26) and offers the best balance of feasibility, near-t...
PASS
======================================================================
SUMMARY
======================================================================
[OK] 1. Maker-Checker PR Review (65.3s) � PASS
[OK] 2. Hierarchical Research Brief (80.2s) � PASS
[!!] 3. Hand-off Customer Support (49.6s) � WARN
-> No support agent produced output
[OK] 4. Network Brainstorm (67.3s) � PASS
[OK] 5. Supervisor Router (25.1s) � PASS
[OK] 6. Swarm + Auditor (37.1s) � PASS
5/6 demos passed
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DA9813230>
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DA97D8690>
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DABB66850>
Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x0000021DAB972E90>