Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -136,7 +136,6 @@ jobs:
--config datasetUrl="http://data-server.data-server:8000/dataset.csv" \
--config agentUrl="http://agent-gateway-krakend.agent-gateway-krakend:10000/weather-agent" \
--config metrics="nv_accuracy context_recall" \
--config workflowName="Testworkflow-Name" \
--config image="${{ steps.extract-tag.outputs.image-tag }}" \
-n testkube \
--watch
2 changes: 0 additions & 2 deletions CLAUDE.md
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,6 @@ kubectl testkube run testworkflow ragas-evaluation-workflow \
--config datasetUrl="http://data-server.data-server:8000/dataset.csv" \
--config agentUrl="http://weather-agent.sample-agents:8000" \
--config metrics="nv_accuracy context_recall" \
--config workflowName="Test-Run" \
-n testkube

# Watch workflow execution
Expand Down Expand Up @@ -155,7 +154,6 @@ Observability Backend (Grafana)
- `agentUrl` - A2A endpoint of agent to evaluate
- `model` - LLM model for RAGAS evaluation (e.g., `gemini-2.5-flash-lite`)
- `metrics` - Space-separated RAGAS metrics (e.g., `faithfulness context_recall`)
- `workflowName` - Label for published metrics
- `otlpEndpoint` - OpenTelemetry collector URL (default: `http://lgtm.monitoring:4318`)
- `image` - Docker image to use (default: `ghcr.io/agentic-layer/testbench/testworkflows:latest`)

Expand Down
2 changes: 0 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -132,7 +132,6 @@ kubectl testkube run testworkflow ragas-evaluation-workflow \
--config datasetUrl="http://data-server.data-server:8000/dataset.csv" \
--config agentUrl="http://agent-gateway-krakend.agent-gateway-krakend:10000/weather-agent" \
--config metrics="nv_accuracy context_recall" \
--config workflowName="Testworkflow-Name" \
--config image="ghcr.io/agentic-layer/testbench/testworkflows:latest" \
-n testkube
```
Expand All @@ -144,7 +143,6 @@ kubectl testkube run testworkflow ragas-evaluation-workflow \
--config datasetUrl="http://data-server.data-server:8000/dataset.csv" \
--config agentUrl="http://agent-gateway-krakend.agent-gateway-krakend:10000/weather-agent" \
--config metrics="nv_accuracy context_recall" \
--config workflowName="Testworkflow-Name" \
--config image="ghcr.io/agentic-layer/testbench/testworkflows:latest" \
--config model="gemini/gemini-2.5-flash" \
--config otlpEndpoint="http://otlp-endpoint:4093" \
Expand Down
5 changes: 1 addition & 4 deletions deploy/base/templates/publish-template.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,9 +9,6 @@ metadata:
spec:
# Configuration parameters that can be overridden
config:
workflowName:
type: string
description: "Name of the test workflow (used as label)"
otlpEndpoint:
type: string
description: "URL of the OTLP endpoint"
Expand All @@ -27,5 +24,5 @@ spec:
run:
args:
- publish.py
- "{{ config.workflowName }}"
- "{{ workflow.name }}"
- "{{ config.otlpEndpoint }}"
6 changes: 0 additions & 6 deletions deploy/local/ragas-evaluation-workflow.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,11 +49,6 @@ spec:
default: "nv_accuracy context_recall"

# Publishing configuration
workflowName:
type: string
description: "Workflow name for metrics"
default: "ragas-test-workflow"

otlpEndpoint:
type: string
description: "OTLP endpoint URL"
Expand Down Expand Up @@ -97,6 +92,5 @@ spec:
template:
name: ragas-publish-template
config:
workflowName: "{{ config.workflowName }}"
otlpEndpoint: "{{ config.otlpEndpoint }}"
image: "{{ config.image }}"