Leave room for an important lyric
Listen to the whole phrase before deciding where a fill belongs.
If a fill competes with a lyric you want people to follow, record that passage twice at rehearsal. Play the planned fill once, then keep the groove through the same phrase. Ask the singer and leader which version supports the words.
A song’s title line is one useful place to try this, but it does not automatically require fewer drums. Sometimes a coordinated band accent strengthens the lyric. Listen to where the phrase begins and ends, including any words that continue across the next downbeat.
If the simpler version works better, mark “keep groove” beside that phrase on your chart. Keep the kick and snare pattern the arrangement needs; removing a fill does not require removing the whole beat. Practice the phrase and the following entrance so you know how the next section starts.