Tom Brady had his own VIP section at the Patriots’ Super Bowl party, and some of his teammates felt like fans looking up at him