I saw an interesting hypothesis in the comments on mangastream.
He explained how that the quincys have been living the shadows for centuries, right? what if Gremmy imagined Yachiru? and when Gremmy died, everything he imagined has disappeared.
And the 2nd one was, that yachiru was apart of...