spack-ai-test: AI-Assisted Package Testing

spack ai-test is a Spack extension for AI-assisted configuration testing of HPC packages. It uses Large Language Models (LLMs) to generate candidate build configurations that are deliberately targeted at high-risk, underexplored corners of a package’s configuration space — version ranges, compiler variants, and dependency combinations that standard CI pipelines never reach.

The extension integrates directly with your existing Spack installation. You can use it interactively on a workstation, or as part of a batch testing workflow on an HPC cluster.

User Guide

• Getting Started
  • Prerequisites
  • Installation
  • Configuring API Keys
  • Running Your First Test
• Basic Usage
  • Inspecting Package Metadata
  • Raw JSON Schema Export
  • Evaluating Spec Risk Scores
  • Generating Test Scenarios
  • Targeting Specific Compilers
• Advanced Workflows
  • The MAPE-K Self-Adaptive Loop
  • Testing Depth: Build and Regression Testing
  • HPC Cluster Workflows (Offline / Compute Nodes)
  • Automated Failure Bisection
  • Knowledge Base
• Configuration
  • Configuration Precedence
  • Configuration File: ai_test.yaml
  • Environment Variables
  • Supported LLM Models

Reference

• Command Reference
  • spack ai-test

Indices and tables

• Index

• Search Page