'Whispers won't go away': Huge factor pushing Tom Dearden to Sydney club as feeding frenzy awaits