There are certain spots on the terrain where it happens, it seems to change when you change the terrain geometry.
Here is an example how it looks normally:

Now I rotate the view a bit and some terrain cells disappear from being rendered:

So far I just changed the terrain geometry of the terrain so long until those spots did not occur anymore, but this cannot be a long term solution, so maybe someone here got an idea what the issue is.