There was a recipe in the diary that lists the ingredients except for one, and I never figured out what the missing ingredient was. I just used the spicy Peppers, like you.
Do you have to give him a special recipe for him to give you the warm doublet? I was never able to figure out what the recipe was, so I have always had to get the warm doublet from the chest.