You could get the portal when you get into the first cave - quest just after sea horse mount quest.