I can't ask anyone to go back to their party, Venkaiah Naidu tells protesting members