Bread pudding is one of those dishes that sounds humble and tastes extraordinary when it's done right.
Brioche soaked in a vanilla, nutmeg, cinnamon, and allspice custard, baked until the center just barely jiggles, rested for 45 minutes, and finished with a sticky whisky toffee sauce and Baileys whipped cream that takes the whole thing somewhere completely different from what most people expect bread pudding to be.
Every bread pudding is a little different — it's a dish with a thousand regional versions. New Orleans is famous for theirs, and if you're ever dining there, the Commander's Palace bread pudding soufflé is a must. This toffee bread pudding is a Louisiana-rooted take on that tradition, built for the holiday table. It's the dessert from the No-BS Holiday Cookbook that makes people put down their forks and go quiet for a moment. That's the goal.
Why This Works
Brioche is the right bread for bread pudding. Its high butter and egg content means it absorbs custard without falling apart and produces a rich tender interior that plain white bread can't match. Don't substitute — the brioche is why this works.
A custard built on half-and-half instead of whole milk produces a richer creamier result. The ratio of eggs to liquid matters — too many eggs produces a rubbery texture, too few produces a pudding that never fully sets. This recipe gets the ratio right.
The spice combination matters. A pinch of Lucky Cajun 5-Spice from the Holiday Survival Kit is the easy way to layer in a warm, aromatic complexity — the note that makes people ask what's in the custard without being able to identify it. If you'd rather grate your own, fresh nutmeg, cinnamon, and fresh ground allspice do the same job. Use one approach or the other — the 5-Spice already carries those warm baking notes, so there's no need to double up. Either way, fresh matters: pre-ground spices sitting in a jar have already lost the volatile oils that carry real aroma and flavor. Start with less than you think you need.
Baking until the center just barely jiggles is the key technique. A fully set center means overcooked bread pudding. The residual heat from resting finishes the cook and produces the creamy custardy center that makes this worth making.
The 45 minute rest before serving is not optional. Cut into it too soon and it falls apart. Rest it properly and it holds clean slices while staying warm all the way through.
Ingredients
Bread Pudding:
- 4 large eggs
- 1 egg yolk
- ¾ cup sugar
- 5 cups half-and-half
- 1 tablespoon vanilla extract
- 2 tsp of Lucky Cajun 5-Spice — or ¾ tsp fresh grated nutmeg, ½ tsp cinnamon, and ¼ tsp fresh ground allspice
- ¼ teaspoon salt
- 12 oz brioche, cut into cubes
- Butter for greasing the pan
- Optional add-ins: dates, rum-soaked raisins, pecans, or walnuts
Sticky Toffee Sauce:
- ½ cup brown sugar
- ½ stick butter
- ¼ cup heavy cream
- 1 tablespoon brandy, whisky, or bourbon
Baileys Whipped Cream:
- 1 cup heavy whipping cream
- ¼ cup Baileys Irish Cream
Instructions
The Bread Pudding
1. Preheat and Prep
Preheat oven to 325°F. Butter a 13x9 inch baking dish generously.
2. Make the Custard
In a large bowl whisk together eggs, egg yolk, sugar, half-and-half, vanilla extract, your spice choice (Lucky Cajun 5-Spice or the fresh grated nutmeg, cinnamon, and allspice), and salt until smooth and fully combined.
3. Soak the Brioche
Add brioche cubes to the custard and toss until every piece is fully coated. Let sit for a few minutes so the bread absorbs the custard. This is what produces the creamy interior rather than dry pockets of bread surrounded by custard. Add optional mix-ins if using and fold in gently so they distribute evenly without breaking up the brioche.
4. Bake
Pour the soaked brioche mixture into the prepared baking dish. Bake at 325°F for 45 to 50 minutes until the center just barely jiggles when the pan is shaken gently. Do not overbake — pull it when it still has a slight jiggle, and the residual heat from resting finishes the cook.
5. Rest
Let sit for 45 minutes before cutting and serving. This rest is what allows the custard to fully set into sliceable portions that hold their shape.
The Sticky Toffee Sauce
1. Melt and Bubble
Melt butter in a saucepan over medium heat. Whisk in brown sugar until dissolved and bubbling.
2. Add Cream
Slowly add heavy cream — it will bubble aggressively, keep whisking. Continue cooking for 2 to 3 minutes until the sauce thickens into a glossy, sticky toffee.
3. Finish With Spirit
Remove from heat and stir in brandy, whisky, or bourbon. The alcohol adds depth and warmth that makes the toffee sauce taste more complex than its four ingredients suggest.
Keeping it warm: Pour into an insulated tumbler pre-warmed with hot water. The sauce stays warm for 30 to 60 minutes. Reheat gently if needed.
The Baileys Whipped Cream
Combine heavy whipping cream and Baileys Irish Cream in a chilled bowl. Whip to stiff peaks. Refrigerate until dessert time. Can be made earlier in the day — it holds well refrigerated for several hours without breaking.
To Serve
Slice the rested bread pudding into portions. Drizzle generously with warm sticky toffee sauce. Top with a spoonful of Baileys whipped cream. Serve immediately. The combination of warm bread pudding, warm toffee sauce, and cold Baileys whipped cream in the same bite is the whole point.
Variations
Bourbon bread pudding: Use bourbon in the toffee sauce for a deeper, oakier warmth — a Southern classic. See the FAQ for how to build a full bourbon sauce.
Rum raisin version: Soak raisins in dark rum overnight before folding into the brioche mixture, and swap rum into the sauce for a classic New Orleans-style rum bread pudding.
Pecan version: Fold toasted pecans into the brioche mixture before baking for crunch and nutty richness.
Date version: Add chopped Medjool dates. They soften during baking and add a natural caramel sweetness that leans this even closer to a true sticky toffee pudding.
Chocolate version: Add 4 oz of chopped dark chocolate to the brioche mixture. It melts into pockets throughout the pudding and makes the toffee sauce even more relevant.
Non-alcoholic version: Skip the Baileys in the whipped cream and the spirit in the toffee sauce. Use 1 teaspoon vanilla extract per cup of heavy cream instead.
FAQ
What is bread pudding?
A baked dessert made from cubed bread soaked in a custard of eggs, cream, sugar, vanilla, and warm spices then baked until set. Originally a way to use stale bread, it became a dish worth making from scratch. Every region has its own version — New Orleans is especially famous for theirs.
Is this a Cajun bread pudding?
At heart, yes — it's a Louisiana-rooted take on the tradition, right down to the optional pinch of Lucky Cajun 5-Spice in the custard. New Orleans bread pudding is a genuine icon of Southern dessert, and the legendary Commander's Palace bread pudding soufflé is a must if you're ever dining there. This is a holiday version of that tradition.
What bread is best for bread pudding?
Brioche. Its high butter and egg content produces a rich, tender interior that soaks up custard without falling apart. Challah is a good second choice. Avoid plain sandwich bread — it works but produces a far less complex result. Slightly stale bread absorbs custard best.
Why bake bread pudding at 325°F?
Lower temperatures produce a gentler cook that sets the custard without curdling the eggs. Higher temperatures cook the outside before the center has time to set properly.
How do you know when bread pudding is done?
The center should just barely jiggle when the pan is shaken gently. A fully set center means overcooked, rubbery bread pudding. Pull it early and let the residual heat finish the cook during the rest.
Can I make bourbon bread pudding with this recipe?
Yes. Use bourbon in place of the brandy or whisky in the toffee sauce — 1 tablespoon, or up to 2 for a stronger bourbon flavor. For a dedicated bourbon sauce, double the sauce recipe and stir in 2 tablespoons of bourbon off the heat. Bourbon's oaky, caramel notes pair perfectly with the brown sugar toffee.
Can I use rum instead of Baileys, or make a rum sauce?
Yes on both. For the whipped cream, swap the Baileys for 2 tablespoons of dark rum, or use Kahlúa for a coffee note. For a classic New Orleans rum sauce, use dark rum in the toffee sauce instead of whisky — it's the traditional pairing for rum bread pudding.
Can I make bread pudding with whisky sauce?
Absolutely — whisky is the default spirit in this toffee sauce. Stir 1 tablespoon into the finished sauce off the heat. Scotch or Irish whisky both work; bourbon leans sweeter and oakier. All three make an excellent bread pudding with whisky sauce.
What is toffee sauce made of?
Brown sugar, butter, heavy cream, and a splash of spirit. It comes together in under 5 minutes into a glossy, sticky toffee sauce that pairs naturally with bread pudding, ice cream, and any dessert that benefits from richness.
How do you make Baileys whipped cream?
Combine 1 cup cold heavy whipping cream with ¼ cup Baileys Irish Cream in a chilled bowl and whip to stiff peaks. That's it. It holds several hours refrigerated without breaking, so you can make it earlier in the day.
Why use fresh grated nutmeg and fresh ground allspice?
Both rely on volatile oils that carry real aroma and flavor. Pre-ground versions sitting in a jar have already lost most of those oils. Fresh grated nutmeg on a microplane and fresh ground allspice take under a minute and produce a completely different result.
Can I make brioche bread pudding ahead of time?
Yes. Bake completely, cool, cover, and refrigerate for up to 24 hours. Reheat covered at 300°F for 15 to 20 minutes before serving. The toffee sauce and whipped cream are best made fresh but both can be prepared earlier in the day.
Is this a good holiday dessert?
It's built to be the centerpiece dessert of the holiday table — a warm, spiced Christmas and Thanksgiving bread pudding with sticky toffee sauce and boozy whipped cream. Rich, make-ahead friendly, and dramatic enough to close a holiday meal.
What does Lucky Cajun 5-Spice add to bread pudding?
A very small pinch in the custard adds warm aromatic complexity that makes people ask what's in the custard without being able to identify it. It carries the same warm baking notes as fresh nutmeg, cinnamon, and allspice in one blend. Available in the Lucky Cajun Holiday Survival Kit.
Why Lucky Cajun
Fresh spices rely on the same principle as fresh ground seasoning — volatile oils that are still active produce real flavor that pre-ground versions sitting in a warehouse for months simply cannot. Fresh grated nutmeg, fresh ground allspice, and a pinch of Lucky Cajun 5-Spice all follow that same logic. Every Lucky Cajun bag ships with a Born-On Date so you know the seasoning is still working when it matters.
🌶️ Shop the Holiday Survival Kit
🌶️ Shop Lucky Cajun Black Label
🌶️ Read the No-BS Holiday Cookbook Article
Soak the brioche properly. Pick your spice. Pull when the center barely jiggles. Rest 45 minutes. Toffee sauce warm. Baileys whipped cream cold.
That's brioche bread pudding done right. 🌶️
