Tom Hardy "didn't want" to leave 'Peaky Blinders'