Levy worked on Goldman's M&A team. He was one of four co-chairmen of the practice.
The others - Paul Parker, Tim Ingrassia and Gene Sykes - remain with the bank.
At 61, it isn't clear what will come next for Levy.
The news was reported earlier in the day by the Wall Street Journal.
Prior to joining Goldman, Levy spent more than 20 years working for Merrill Lynch.
Right now, Wall Street is getting a boost as M&A chases highs not seen since the last market top in 2007. Between Tuesday's resignation at Goldman and Deutsche Bank losing its M&A honcho Monday, it's possible even Wall Street's top dealmakers are feeling fatigued.
Elsewhere on Wall Street, dealmakers say cheap money from the Federal Reserve is going to fuel more M&A activity this year.
Wall Streeters! Have any updates or memos about boldface names on the move? You can tip us off here: jmarino@businessinsider.com.