Preheat oven to 350°F. Brush softened butter into every groove of a 6-cavity mini bundt pan, dust with flour, and tap out the extra.
Stir the brown sugar and cinnamon together in a small bowl for the swirl; set aside.
Whisk the flour, baking powder, and salt together in a medium bowl.
In a large bowl, beat the butter and sugar together until pale and fluffy, about 3 minutes, then beat in the eggs one at a time and the vanilla.
Add the dry ingredients alternately with the milk, mixing just until smooth.
Spoon a third of the batter into each prepared cavity, sprinkle with the cinnamon sugar, then cover with the remaining batter, filling each about two-thirds full.
Drag a skewer through the batter in each cavity twice to swirl the cinnamon sugar through without mixing it in completely.
Bake for 18 to 20 minutes, until the cakes spring back when touched and a toothpick inserted in a plain part comes out clean.
Cool the cakes in the pan on a wire rack for 10 minutes, then invert onto the rack and cool completely, about 30 minutes.
Whisk the powdered sugar and milk together until smooth, then drizzle over each cooled cake and let set 10 minutes before serving.
Good to Know
Press the cinnamon sugar down lightly with a spoon before adding the top layer of batter so it does not sink straight to the bottom.