It was bound to happen. With each episode of ‘Late Show with Stephen Colbert’ including a put down of President Trump, it isn’t surprising that it’s viewerships just isn’t pulling in the big numbers.