You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 02bfe53
Browse filesBrowse the repository at this point in the historyBrowse files
docker tag "nvidia/cuopt:${IMAGE_TAG_PREFIX}-cuda${CUDA_SHORT}-py${PYTHON_SHORT}-${ARCH}" "nvcr.io/nvstaging/nvaie/cuopt:${IMAGE_TAG_PREFIX}-cuda${CUDA_SHORT}-py${PYTHON_SHORT}-${ARCH}"
docker tag "nvidia/cuopt:${IMAGE_TAG_PREFIX}-cuda${CUDA_SHORT}-ubi10-${ARCH}" "nvcr.io/nvstaging/nvaie/cuopt:${IMAGE_TAG_PREFIX}-cuda${CUDA_SHORT}-ubi10-${ARCH}"
docker tag "nvidia/cuopt:${IMAGE_TAG_PREFIX}-cu${CUDA_MAJOR}-ubi10-${ARCH}" "nvcr.io/nvstaging/nvaie/cuopt:${IMAGE_TAG_PREFIX}-cu${CUDA_MAJOR}-ubi10-${ARCH}"
| Overall | 98.3% — baseline ran, but no comparable score was available; uplift unavailable |94.4% — baseline ran, but no comparable score was available; uplift unavailable |
| Discoverability | 100.0% — baseline ran, but no comparable score was available; uplift unavailable |94.4% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |96.1% — baseline ran, but no comparable score was available; uplift unavailable |86.7% — baseline ran, but no comparable score was available; uplift unavailable |
38
+
| Overall | 98.3% — baseline ran, but no comparable score was available; uplift unavailable |95.9% — baseline ran, but no comparable score was available; uplift unavailable |
| Discoverability | 100.0% — baseline ran, but no comparable score was available; uplift unavailable |93.8% — baseline ran, but no comparable score was available; uplift unavailable |
| Efficiency |97.1% — baseline ran, but no comparable score was available; uplift unavailable |95.1% — baseline ran, but no comparable score was available; uplift unavailable |
44
44
45
45
**How to read this table:** baseline is the same task attempted without the target skill. Scores are rounded to one decimal; threshold-adjacent values use additional precision so their displayed band matches the verdict. Uplift is derived from those displayed scores and shown in percentage points.
46
46
@@ -52,25 +52,25 @@ Actual Tier 3 execution usage is reported for every observed agent/case pair and
52
52
53
53
| Agent | Dataset case | With skill | Without skill | Delta | Change | Coverage |
54
54
|---|---|---:|---:|---:|---:|---|
55
-
| claude-code | All cases |990,844|2,338,962|N/A|N/A| skill 8/8; base 10/10|
| codex | srv-py-eval-008-runnable-assets |80,158|143,096|-62,938|-43.98%| skill 1/1; base 1/1|
73
+
| ALL AGENTS | Dataset aggregate | 1,274,018|1,078,504|+195,514|+18.13%| skill 16/16; base 16/16|
74
74
75
75
Prompt tokens include cached reads, so total tokens are `prompt + completion` (cached is not added twice). The Efficiency score uses `(prompt - cached) + completion`. N/A means the relevant trajectory counters were not available; coverage is never estimated.
76
76
@@ -88,8 +88,8 @@ Prompt tokens include cached reads, so total tokens are `prompt + completion` (c
88
88
<summary>Show detailed findings and successful checks</summary>
89
89
90
90
-**MEDIUM** SCHEMA/frontmatter_field_placement: Root field 'version' is ignored; use 'metadata.version' (`skills/cuopt-server-api-python/SKILL.md`)
91
-
-**MEDIUM** SECURITY/Unknown (LP3): MCP Least Privilege: Without declared permissions the skill's intent is opaque and cannot be validated. (`SKILL.md:1`)
92
-
-**MEDIUM** SECURITY/Unknown (RP1): MCP Rug Pull: The Docker run command references`nvidia/cuopt:latest-cu13` (a mutable floating tag) without pinning to an immutable di (`SKILL.md:55`)
91
+
-**MEDIUM** SECURITY/Unknown (LP3): MCP Least Privilege: The skill demonstrates network-capable code (HTTP requests via `requests`, Docker networking) but declares no tool scope (`SKILL.md:1`)
92
+
-**MEDIUM** SECURITY/Unknown (RP1): MCP Rug Pull: The Docker run command uses`nvidia/cuopt:latest-cu13` (a floating/mutable tag). The skill itself acknowledges this risk (`SKILL.md:55`)
93
93
-**MEDIUM** SECURITY/External Transmission (E1): Data Exfiltration: requests.post(f"{SERVER}/cuopt/request", json= (`SKILL.md:88`)
94
94
-**MEDIUM** SECURITY/Tainted flow: 'req_id' from requests.post (line 81, network input) → requests.get (network output) (TT2): Data Flow: response = requests.get(
Copy file name to clipboardExpand all lines: skills/cuopt-server-api-python/SKILL.md
+2-2Lines changed: 2 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -56,9 +56,9 @@ docker run --gpus all -d -p 8000:8000 -e CUOPT_SERVER_PORT=8000 \
56
56
nvidia/cuopt:latest-cu13
57
57
```
58
58
59
-
Use `latest-cu12` or `latest-cu13` to match your driver's CUDA major version (`latest-cu13-ubi10` for a UBI10 base). Prefer these over the CUDA+Python-specific tags such as `latest-cuda12.9-py3.13` — those track a single Python line and go stale when it stops receiving builds.
59
+
Use `latest-cu12` or `latest-cu13` to match your driver's CUDA major version (`latest-cu13-ubi10` for a UBI10 base).
60
60
61
-
For production, pin rather than float: `latest-*` tags are mutable and can silently move to a different image. Use a full release tag (`nvidia/cuopt:<release>-cuda<cuda>-py<python>`) or an immutable digest (`nvidia/cuopt@sha256:<digest>`). Check the `nvidia/cuopt` registry for available tags.
61
+
For production, pin rather than float: `latest-*` tags are mutable and can silently move to a different image. Use a full release tag (`nvidia/cuopt:<release>-cu<cuda-major>`) or an immutable digest (`nvidia/cuopt@sha256:<digest>`). Check the `nvidia/cuopt` registry for available tags.
0 commit comments