Proctor's wife is safe, so why does he continue with Mary Warren's deposition?

Proctor isn't satisfied that his wife is safe until she has the child, nor is he happy with anybody being put to death. He insists that the judge hear Mary's deposition that this whole thing was a farce. Danforth won't accept her deposition though.