No need to remove flowers from chili plants. It won't effact growth as thay will continue growing, producing flowers and fruits as long as the temperatures are high enough.
It is sometimes suggested to remove the "king" fruit and restrict the number of fruits from sweet pepper plants but not from chilies, again this is not necessary unless you are emulating those on supermarket shelves or growing for the show bench.
Chilies are one of the mose rewading crops you can grow.