AI News
All stories
Reported

NVIDIA open-sources SkillSpector to scan agent skills before installation

NVIDIA has released SkillSpector, an open-source scanner that checks agent skills and their supporting code for security risks before installation.

Safety & Security · · 2 min read

NVIDIA has open-sourced SkillSpector, a scanner that reviews an agent skill's instructions and supporting code before a user installs it. The company says reading a skill's description may not reveal instructions that tell a coding agent to run scripts, install dependencies, or send data to outside services. Installing a skill lets someone else's instructions shape what your coding agent does. The review therefore has to cover both what the skill says and what its files actually do.

The scanner runs three kinds of checks. Static analysis looks for suspicious instructions and dangerous code patterns. Dependency checks query the OSV vulnerability database for known vulnerabilities. An optional LLM step examines whether the skill's behavior matches its stated purpose. Each scan produces a risk score from 0 to 100 and one of three recommendations: SAFE, CAUTION or DO_NOT_INSTALL. Each finding includes source locations so a reviewer can open the flagged content. Results can be written as JSON or SARIF for automated checks.

The post illustrates the problem with a skill advertised as a test-report generator. Creating a report may require reading test results and writing a Markdown file. Uploading environment variables to an unrelated server, however, would fall outside that job. A script could contain the upload while the skill's instructions describe it as a required setup step. Reviewing only the Markdown could miss the script, and reviewing only the script could miss the instruction that persuades the agent to run it. The post also cautions that a shell command is not automatically malicious, since a testing skill may legitimately launch a test runner. The reviewer has to judge which command runs, which inputs it accepts, and whether the operation belongs in the advertised workflow.

To run a scan, users install the tool with uv from the NVIDIA GitHub repository, download the skill into a separate directory, and run skillspector scan with the --no-llm flag. That flag runs the static checks without configuring a model provider. Semantic analysis requires a configured supported provider. The post says NVIDIA documents hosted providers and local Ollama support. The scan should cover the complete skill directory so supporting scripts are included.

The post also warns about the recommendation's limits. A SAFE result does not establish that every possible behavior is safe. The scan provides evidence for an installation decision, but the agent's runtime permissions still determine what an installed skill can access. The integration detail that is easy to miss is the exit code. The default successful exit code covers both SAFE and CAUTION, so a pipeline that checks only for exit code zero can accept a result that needs review. The stricter --fail-on-findings and --fail-on-incomplete flags are available. A team can also read the recommendation from JSON and apply its own policy.

The same review applies whenever a skill changes, since a previously reviewed version can acquire a new dependency or an additional setup script. In the report-generator example, a rescan would surface the new upload script before it reaches the agent. At that point the skill would still be outside the active workflow.

What changed

NVIDIA released SkillSpector, an open-source scanner that checks agent skills and their supporting code for security risks before installation.

Type: New capability · Applies to: SkillSpector

Why it matters

Teams that let coding agents install third-party skills get a concrete way to review what a skill's files actually do, including scripts a SKILL.md may not reveal. A previously reviewed skill can gain new dependencies or setup scripts in an update, so the review needs to run again on each change.

What you can do

Scan any downloaded agent skill, including all supporting scripts, before installing it, and rescan whenever the skill is updated.

Original source

We have no link to the original source for this story yet.

Where we saw it

1 source

AI Engineering

AI wrote this summary from the sources listed, and nobody reviewed it individually before publication. Check the original source before you rely on it. How it works