Skip to content

Update user_content initialization to None, handle System only event in Evaluation #4313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kauabh wants to merge 3 commits into
base: main
Choose a base branch
from
+5 −1
Open

Update user_content initialization to None, handle System only event in Evaluation #4313

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
4d7d3c3
Update user_content initialization to None
kauabh Jan 29, 2026
9eaeede
Merge branch 'main' into main
kauabh Jan 29, 2026
d85d3f8
Update src/google/adk/evaluation/evaluation_generator.py
kauabh Jan 29, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion src/google/adk/evaluation/evaluation_generator.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -277,7 +277,7 @@ def convert_events_to_eval_invocations(
invocations = []
for invocation_id, events in events_by_invocation_id.items():
final_response = None
user_content = ""
user_content = None
invocation_timestamp = 0
app_details = None
if (
Expand Down Expand Up @@ -306,6 +306,10 @@ def convert_events_to_eval_invocations(
if p.function_call or p.function_response or p.text:
events_to_add.append(event)
break
if user_content is None:
# We skip because an evaluation case without user input
# is generally not useful for testing/grading.
continue

invocation_events = [
InvocationEvent(author=e.author, content=e.content)
Expand Down