I've seen that others have noticed problems merging indexes, so I thought I'd share mine in the loop.
I presume the present solution is to delete/rebuild the index entirely, but I'm sure this isn't ideal!
Maybe with more data we can get to a real solution sooner.