Aaaaall about perception of the program. If we're ranked, we get more media coverage and attention from the broader population. More recognition = better recruits = better program -> rinse, repeat. Are polls always accurate like Kenpom might be? Hell no. But that's not what this is about
Stated this in another reply too but true recognition comes from big ten championships and tourney success