You should place “haut” before the noun, just like other adjective that describe height like grand, petit, long etc.

C’est un homme de haute taille.

haute can not describe taille because it already means “high size” in this context. You should say “grande taille”

À marée haute, l’eau vient jusqu’ici.

marée haute is considered as a subject on its own rather than subject+adjective.
Also, haute marée isn’t wrong although this is not really used