Doing Wifi Cracking Breaks SSH Connection?

I have been playing around with Wifi cracking, specifically automating it more. What is weird is that whenever I do airodump-ng or even switch the wifi card to monitor mode I loss connection and have to restart the ssh server. Does anyone know what is happening?