The win put Cleveland back at .500, after dropping below that mark for the first time since April on Sunday.
Justin Masterson (7-8) picked up the win, giving up only one earned run in 7 1/3 innings. He allowed seven hits and struck out six.
The Indians opened the scoring in the third inning when Shin-Soo Choo hit a two-run shot off Tommy Hunter (4-5).
Baltimore's Omar Quintanilla made it 2-1 with an RBI-double in the fifth.
The Indians will begin a three-game home set against Detroit on Tuesday at 7:05 p.m. ET.
For more on the Cleveland Indians and Baltimore Orioles, head over to their respective SB Nation blogs at Let's Go Tribe and Camden Chat. More news and analysis on the world of MLB can be found over at Baseball Nation.