We consider the possibility that massive primordial black holes are the dominant form of dark matter. Black hole formation adds a Poisson noise to the matter density fluctuations. We use Lyα forest observations to constrain this Poisson term, which constrains the black hole masses to be less than approximately a few times 104 M. We also find that structures with less than ~103 black holes evaporate by now.