Few Pastors Say Adulterous Ministers Should Face Permanent Ban From Pulpit: Half of Protestant pastors say their colleagues should step down from the pulpit for a time if they are accused of misconduct. Most say such accusations should be kept in confidence until proven. And few think pastors who commit adultery should be permanently banned from ministry.