You should (almost) never change the z-value of UI elements. To order, change the hierarchy in Unity. In this case, it seems like the blue background is actually part of the button. Therefore, when duplicated, it will be rendered on top of any other buttons after it in the hierarchy.
To avoid other rendering issues, also make sure the z-value of all elements is 0.
↧