Both goals came in the second half and despite finishing the game with 10 men after Gints Freimanis was sent off in the dying seconds, Latvia fought bravely for a point that puts them fourth in Group A with two points from three games.
Latvia's goal came via a strike from the penalty spot by Valērijs Šabala after 54 minutes, which equalised Bilal Kisa's 47th-minute strike for the visitors.
The game itself was a physical affair with six players booked in addition to Freimanis' sending off for a second bookable offense.
Latvia's next game is on November 16 in Amsterdam against the Netherlands, who on Monday slipped to a surprise 2-0 defeat away against group leaders Iceland.