I find this kind of noodling around can be really rewarding, particularly if it takes the story in a more interesting direction and/or makes it tighter, clearer, etc. I hope you're enjoying the process. :-)