I've found models to be incredibly fixed and repetitive for creative writing. I have this project based around a cyberpunk city, and have been experimenting with LLMs for content generation.
The same names and themes continually crop up, despite promoting variations.
I find it to work pretty well if I both feed it a bunch of context about the story and characters, and give it a summary of what has to happen in the next three paragraphs.