This is a grey area. If you are using Chicago style, you would list it in the bibliography as a way to show where you got ideas. In MLA and APA, the standard is that you only cite the sources you used and anything listed as References should be actively used in the text. If you really built upon the original inspiration and took it in a brand new direction, though, you are likely safe in not citing.
