Doflamingo and Fujitora's agreement to not engage each other lasts for the moment - meaning all eyes are turned towards taking down the Straw Hats and claiming the rewards! And as Luffy starts heading to the Royal Palace along with Zoro and Law, Fujitora stands in his way!
