Before anything else let's make some orange sugar! In a medium bowl, combine the sugar and orange zest. Use your hands to really work the zest into the sugar. You'll smell the orange oils and the sugar will change in color--this is good. REALLY good! I do this about 10-15 minutes before the next step. This gives the sugar time to absorb the orange oils and flavors.
Preheat your oven to 325.* SEE NOTES!
In the bowl of a stand mixer (using the paddle attachment) cream together butter and orange sugar until light and fluffy, at least 4 minutes. I usually let it go for about 5 minutes. Make sure to pause about halfway through to scrape down your bowl and the attachment.
While the butter and sugar mix, whisk together flour, baking powder, and salt in a medium bowl. (I use the same one from the orange sugar because I hate extra dishes.)
After 4-5 minutes of mixing, add in your eggs one at a time. Scrape down the bowl and attachment each time! Once your eggs are added, add in the extracts, stirring briefly to combine. It might look weird and lumpy--don't freak out!
Add ⅓ of your dry ingredients to your butter and egg mixture. Mix just until incorporated.
Follow with ⅓ of your buttermilk, again mixing just until it's incorporated. Repeat the flour/buttermilk alternations until everything's added. Scrape the bowl one last time to make sure it's all combined, taking care not to overmix.
Pour your batter into a greased and lined loaf pan*. Spread the batter as evenly as possible.
Bake your loaf until a toothpick comes out with minimal crumbs or clean. Mine usually takes about 1 hour 20 minutes, but you know your oven! I start checking at 45 minutes. If you can touch the pan and the center jiggles it's too soon. Don't start testing with a toothpick until you can tell the top is set or you might collapse the cake! If you're worried the top is browning too quickly cover lightly with foil for the rest of baking.
Remove and place on a cooling rack, then start on your glaze.