Five years later, after earning more than $25 million of that contract, Brown is a farmer who's helping to feed the hungry.
CBS News caught up with Brown in Louisburg, North Carolina, where he runs a 1,000-acre farm after learning how to grow crops on YouTube.
Brown was drafted 124th overall in 2005 and played nine seasons in the NFL before getting cut by the Rams in the spring of 2012.
At age 29, he still had plenty of NFL years ahead of him. He wasn't playing at the level he was in 2009, but his career was far from over. He had interest from a number of teams, including an offer from the Baltimore Ravens.
But he walked away from the game. The NFL world was surprised, and ESPN ran a story with the headline, "The Curious Case Of Jason Brown."
"My agent, he told me, 'You're making the biggest mistake of your life,'" Brown told CBS. "And I looked right back at him and I said, 'No I am not.'"
Brown is doing this to help the less fortunate. He grows sweet potatoes and other vegetables, and donates his harvest to food pantries. According to the New & Observer, he has given away 46,000 pounds of sweet potatoes and 10,000 pounds of cucumbers this fall.
"When you see them pop up out of the ground, man it's the most beautiful thing you could ever see," he said of harvesting the sweet potatoes.
It does look pretty fun:
Brown went to school at the University of North Carolina. He had no idea how to farm back in 2012. He learned on YouTube.
It's a great story about life after football. Watch the entire CBS report here: