Carefully removing? You mean press Enter gently after typing DROP INDEX? Err, no!
The reasoning is that it takes a long time to build an index and a short time to drop it.
What we want is a way of removing an index so that if we discover that removing it was a mistake, we can put the index back again quickly.