The tourney is wild, though. People are also dinging Martin's Sweet 16 run because it came out of the First Four. So he's damned if he gets upset, and damned if he's doing the upsetting.
Again - John Groce should've taught us all a lifelong lesson on how the small sample of the tournament can translate to a full season.
If the criticism is underachieving with talent over the course of a season (as you point out with the 11 losses), then that's a fairer concern, albeit one that's been tackled quite a bit in this thread.
If you're gonna coach 9 years in D1 and your major glaring downfall is a 23-11 season, a high seed in the tournament, and a first round exit with some major players injured, then I think you're doing pretty good. You can look back at just about any great coach that has coached a decade and find far worse seasons. Tom Izzo is sitting at 14-9 with a higher rated recruiting class just this year. Everyone takes their lumps in a P5 conference eventually. The longer you coach the more warts you are going to have.