How random.seed(42) discovered a 15-head circuit in GPT-2 small
Published:
Sometimes you don’t actually need an ML model at all. In my case, the model I used was numpy.random.seed(42). And it discovered a circuit in GPT-2 that existing methods can’t detect.