Skip to content

Fix benchmark manifest ops CI generation#51

Draft
Copilot wants to merge 4 commits into
mainfrom
copilot/fix-benchmark-manifest-ops-sandboxing
Draft

Fix benchmark manifest ops CI generation#51
Copilot wants to merge 4 commits into
mainfrom
copilot/fix-benchmark-manifest-ops-sandboxing

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented May 15, 2026

Description

scripts/benchmark_manifest_ops.py could not reliably run in sandboxed environments, blocking CI-generated benchmark results for the public docs site.

  • Make benchmark temp-tree creation use an explicit writable --work-dir
  • Add markdown/doc update modes for regenerating the manifest benchmark table
  • Run the benchmark in the docs workflow before building GitHub Pages
  • Replace the stale docs note with an MDX-safe generated benchmark block
  • Add focused tests for work-dir usage, cleanup, and generated block replacement

Example CI invocation:

python3 scripts/benchmark_manifest_ops.py \
  --work-dir "$RUNNER_TEMP" \
  --markdown \
  --update-doc docs/src/content/docs/progress/autoloop-go-migration.mdx

Type of change

  • Bug fix
  • New feature
  • Documentation
  • Maintenance / refactor

Testing

  • Tested locally
  • All existing tests pass
  • Added tests for new functionality (if applicable)

Copilot AI linked an issue May 15, 2026 that may be closed by this pull request
Copilot AI and others added 3 commits May 15, 2026 03:48
Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix benchmark_manifest_ops.py sandboxing issue Fix benchmark manifest ops CI generation May 15, 2026
Copilot finished work on behalf of mrjf May 15, 2026 03:52
Copilot AI requested a review from mrjf May 15, 2026 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Fix benchmark_manifest_ops.py sandboxing

2 participants