I forget now and can't find the code, but if I recall correctly, I had each tokenized word map to its syllables and used that in calculating the next word.

I wasn't able to get far enough to make each haiku make perfect grammatical sense, but it very often produced interesting results.