Previous UP govts neglected sports: PM