Prime minister under fire from opponents, who say he should have taken action against Labour peer sooner