A grid is a promise to the reader: things in similar places mean similar things.
Break the grid only with intent. Every deviation is a signal — make sure it's the signal you mean.
Rhythm matters too: consistent spacing creates the same comfort that meter creates in poetry. Inconsistent spacing reads as anxiety even when the content is calm.
Related: typography-is-invisible