The Cosmic History Of X-Ray Binary Evolution