Retail traders are getting spooked by a market downturn. That's bad news for brokerage stocks.

While stocks across the board tumbled on Monday, the pain was acutely felt by shares of brokerages like Robinhood, Charles Schwab and Interactive Brokers.