An explorer took a $48 million submarine on 3 record-breaking dives to the deepest corners of the ocean — and discovered a mysterious new species