I would say if you could turn the diffuse copy into a photo normal map and blend it with your current normal, and smooth out the diffuse, you might get a better result, unless you want it to look bumpy but shiny. I would still give the normal just a touch of the bump in the diffuse.
Do you have a in game shot of it yet?
Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz, 2400 Mhz, 4 Core(s), 4 Logical Processor(s), 8gb RAM, Nvidia gtx660, Windows 7 Pro 64bit