Brown once had doubts about whether it would make the most sense for his own legacy for him to remain with the team that drafted him.