Collmenter, who is 0-2 with a 9.82 ERA in four starts, will head to the bullpen, where he will serve as the team's long man.
The team will make a corresponding roster move when Corbin joins the team, likely on Sunday.
In four starts with Double-A Mobile, Corbin is 2-0 with a 1.67 ERA. That comes on the heels of an outstanding Spring Training in which he almost made the team.
Arizona manager Kirk Gibson was not very revealing when asked about the reasoning in choosing Corbin, but general manager Kevin Towers cited a number of factors.
"It's a tough decision," Towers said. "We've got several guys down there throwing well. He performed very well in Spring Training, he's been in pro ball maybe a little bit longer than some of the others. We've looked at the National League, and most clubs have been struggling against left-handed pitching."
It's likely that fellow Double-A hurlers Tyler Skaggs and Trevor Bauer were considered for the start.
"We just felt like he was the right guy," Towers said. "That's not to say that some of those other guys at some point in time may get an opportunity as well."