Preheat the oven to 350°F (175°C). Lightly grease a 9x5-inch loaf pan or line it with parchment paper for easy removal.
Whisk together the flour, baking soda, baking powder, cinnamon, nutmeg, cloves, and salt in a medium bowl until evenly combined.
In a separate large bowl, whisk the pumpkin puree, brown sugar, granulated sugar, eggs, vegetable oil, vanilla extract, and milk until smooth.
Fold the dry ingredients into the wet mixture just until no streaks of flour remain. Gently stir in the diced apples, taking care not to overmix the batter.
Transfer the batter to the prepared loaf pan and smooth the top. Sprinkle with chopped pecans or coarse sugar if using.
Bake until the loaf is deeply golden and a toothpick inserted into the center comes out clean or with a few moist crumbs, about 55 to 60 minutes.
Allow the bread to cool in the pan for 15 minutes before transferring it to a wire rack to cool completely. Slice and enjoy once cooled.