Spray an 8x12 pan with butter flavored non stick spray. Line the pan with parchment paper, and spray the parchment lightly.
In a bowl, stir together the brownie mix, eggs, oil, and water until just combined. Spread the brownie batter evenly into the bottom of the prepared baking dish. Press the peanut butter cups into the brownie mixture.
Bake according to package directions. Cool brownies in the pan for 15 minutes. Carefully grasp the parchment paper and transfer the brownies to a wire rack to cool completely.
For the Frosting
Place the powdered sugar in a large bowl. With a hand mixer, beat the sugar on low for a minute to break up the lumps. Add the butter and cream cheese, and beat on low to medium low until the mixture is crumbly.
Gradually add the vanilla and milk, beating the frosting until desired consistency.
Divide the frosting into two smaller bowls. Tint the bowls with gel icing color to desired shade. Stir well to blend.
Frost the brownies with a generous amount of icing, alternating colors. Using a wooden skewer or knife, create a swirl pattern in the frosting.