'Wonder if you'll ever get back': Returning Roosters star lifts lid on 'hardest part of my career'