At some point, all of the dragons will meet up. This doesn't have to be at the beginning. They can wander around for a few days, maybe meet one person or a whole group. Eventually, everyone will meet up somewhere.
“And how shall I think of you?' He considered a moment and then laughed. 'Think of me with my nose in a book!” — Susanna Clarke, Jonathan Strange & Mr Norrell