"It all feeds off the starting pitching," Jones said.
The Rays began the day tied for the second AL wild-card spot. Baltimore won for the sixth time in eight games.
"It's all about how we finish as a team," Gausman said.
Gausman (7-7) gave up five hits and struck out eight. He has permitted seven hits over 13 scoreless innings in two starts this season against Tampa Bay.
The right-hander is 4-1 in his last seven starts.
"Kevin was throwing strikes, and working with some tempo and command," Orioles manager Buck Showalter said.
Darren O'Day, Brad Brach and Richard Bleier completed the six-hitter.
Blake Snell (0-6) went a career-high seven-plus innings. The lefty, who entered with 19 of 30 career starts lasting five or fewer innings, allowed three runs and six hits.
"Snell was tough," Showalter said.
Jones, who also doubled and singled, has an RBI in six straight games. Manny Machado drove in two runs during a three-run eighth and Jonathan Schoop drove in a run for his eighth game in a row.
Rays catcher Wilson Ramos left in the fifth after he was struck on the head by a piece of Ruben Tejada's broken bat. The team said Ramos got six staples and will be evaluated.
"He won't start tomorrow, but we're confident that he feels good," Rays manager Kevin Cash said. "A little bit of a scare there. I think Wilson would have preferred to stay in the game. We just weren't able to stop the bleeding."
Jones opened the game with a double and went to third on a wild pitch, but Snell rebounded to strike out Machado and Jonathan Schoop, and retired Mark Trumbo on a popup.
Jones hit his 19th home run in the third.
Snell left in the eighth with two on and no outs. Sergio Romo, in his Rays debut, gave up a two-run single to Machado and Schoop's sacrifice fly. Schoop has 18 RBIs during his streak.
Tampa Bay loaded the bases with two outs in the third but Evan Longoria grounded out. Mallex Smith hit a leadoff triple in the fifth but was left stranded.
"We've just got to continue as this little bit of a funk goes," Cash said. "we've got to find a way to get ourselves out of it."
Orioles: 1B Chris Davis was out of the lineup due to illness. ... INF Ryan Flaherty (right shoulder strain) could start a rehab assignment this week.
Rays: CF Kevin Kiermaier (broken right hip) is expected to start a rehab assignment with Class A Charlotte by the weekend. Charlotte hosts Tim Tebow and the St. Lucie Mets Sunday through Tuesday. .... INF Rickie Weeks Jr. (right shoulder) was reinstated from the 10-day disabled list and released.
Romo, acquired from the Los Angeles Dodgers Saturday for cash, was added to the roster before the game. "I'm thankful for the opportunity," Romo said. "I was unable to get a lot of consistent work. What they've got going on there, which is really good, they've got young guys that are just getting the job done. I was unable to, in a sense, match those efforts."