Skip to content

Fix job linking and taskset lookup#356

Merged
jdchawla29 merged 14 commits intomainfrom
j/fix-connection
Feb 28, 2026
Merged

Fix job linking and taskset lookup#356
jdchawla29 merged 14 commits intomainfrom
j/fix-connection

Conversation

@jdchawla29
Copy link
Collaborator

@jdchawla29 jdchawla29 commented Feb 27, 2026

when hud eval is run with a taskset without --taskset, the job link is created but not sent to the platform


Note

Medium Risk
Changes task loading and job registration/telemetry for both local and remote eval runs, and removes HuggingFace/BYOK paths; regressions could break existing CLI workflows or platform job association.

Overview
hud eval now correctly associates jobs with platform tasksets. When the source is a platform taskset, the CLI captures the returned taskset_id and passes it through to job registration (_send_job_enter) and local execution (run_dataset/hud.eval). It also adds --taskset resolution so running a local tasks file can still link the job to an existing platform taskset.

Task loading and remote submission were simplified. HuggingFace dataset loading and the --byok/use_byok plumbing are removed, loader errors now surface as httpx exceptions, and job naming was standardized via _get_eval_name. Docs and examples were updated to reflect platform taskset usage, new/clarified flags (--taskset, --gateway, --quiet), and the SDK version bumps to 0.5.29.

Written by Cursor Bugbot for commit 7df8161. This will update automatically on new commits. Configure here.

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: e7d3d51757

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

@jdchawla29 jdchawla29 changed the title j/fix-job-linking Fix job linking and taskset lookup Feb 27, 2026
@jdchawla29 jdchawla29 marked this pull request as draft February 27, 2026 20:10
@jdchawla29 jdchawla29 marked this pull request as ready for review February 28, 2026 03:42
Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 7054a26444

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

@jdchawla29 jdchawla29 merged commit 9eb52af into main Feb 28, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant