We can't practically build a tower that tall. A space elevator would work by hanging off a counterweight (possibly more space elevator cable) which means it needs to go past geostationary orbit.