The answer is that Esau was under the mistaken impression that the birth-right was exclusively a spiritual matter. The first-born was expected to carry on the legacy of the father.