UniSpector: Towards Universal Open-set Defect Recognition via Spectral-Contrastive Visual Prompting
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2026
Although industrial inspection systems should be capable of recognizing unprecedented defects, most existing ap proaches operate under a closed-set assumption, which pre vents them from detecting novel anomalies. While visual prompting offers a scalable alternative for industrial in spection, existing methods often suffer from prompt em bedding collapse due to high intra-class variance and subtle inter-class differences. To resolve this, we propose UniSpector, which shifts the focus from naive prompt-to region matching to the principled design of a semantically structured and transferable prompt topology. UniSpector employs the Spatial-Spectral Prompt Encoder to extract orientation-invariant, fine-grained representations; these serve as a solid basis for the Contrastive Prompt Encoder to explicitly regularize the prompt space into a semantically organized angular manifold. Additionally, Prompt-guided Query Selection generates adaptive object queries aligned with the prompt. We introduce Inspect Anything, the first benchmark for visual-prompt-based open-set defect local ization, where UniSpector significantly outperforms base lines by at least 19.7% and 15.8% in AP50b and AP50m, respectively. These results show that our method enable a scalable, retraining-free inspection paradigm for continu ously evolving industrial environments, while offering crit ical insights into the design of generic visual prompting.