Kemp scored the Dodgers' first two runs of the game, including his 11th homer leading off the second.
Pinch-hitter Justin Turner singled to open the 10th and took second on a wild pitch by David Hale (3-3). Kemp followed with the winning single to left.
J.P. Howell (3-3) got the win in relief, walking two and striking out one in one inning.
The Braves tied the game 2-2 on Justin Upton's home run off closer Kenley Jansen leading off the ninth.