Maybe it's just because I get lucky, but I usually get the Battle Factory silver symbol before any others. As for gold, I only beat Noland, Lucy, and Tucker for those symbols a long time ago.
The hardest for me is the Battle Tower... It was the last silver symbol for me to get, and I only got...