Banks keep merging. Investors keep punishing them.

Financial institutions see an opportunity to nab scale after years of tepid dealmaking, but investors are pushing back against such efforts out of concerns about shareholder value.