Jeremy Gray has a terrific article showing not only the lack of good
evidence for the story, but also how the legend spread despite that. See
Gray, J. 1991 "Did Poincare say 'set theory is a disease'?", Mathematical
Intelligencer 13 no.1, 19-22.
Colin McLarty