I get this frequently. Butternuts are of the 'cucurbita moschata' species of squash, and they are the most warmth loving of the squashes. Quite often it is too cool here for proper pollination. But the plants have a tendency to 'think' they have been pollinated, when they haven't and as a result they will still grow fruit.