Benchmark Suite Manager
Purpose
Provides expert guidance on managing benchmark suites for algorithm engineering and experimental evaluation.
Capabilities
- Standard benchmark suite access (DIMACS, TSPLIB, etc.)
- Instance generation for specific problem classes
- Statistical analysis of results
- Performance comparison tables
- Visualization of scaling behavior
- Reproducibility support
Usage Guidelines
- Suite Selection: Choose appropriate benchmark suite
- Instance Selection: Select representative instances
- Execution: Run experiments systematically
- Analysis: Perform statistical analysis
- Reporting: Generate comparison tables and plots
Tools/Libraries
- DIMACS
- TSPLIB
- SuiteSparse Matrix Collection
- Statistical tools