CLIP Attention Analysis

Apr 6, 2026 · 1 min read

This repository stores the experiment code for Matched-Learning-Rate Analysis of Attention Drift and Transfer Retention in Fine-Tuned CLIP. The controlled matrix covers CLIP ViT-B/32 on EuroSAT and Oxford-IIIT Pets, four shared learning rates, and five seeds — 80 completed runs in total.

The code records attention-drift metrics, in-domain accuracy, and adapter-aware CIFAR-100 zero-shot accuracy, then rebuilds the manuscript tables from JSON histories. CUDA and Apple MPS backends are both supported.