It may happen if your packet processing code is incredibly slow. In this case internal driver packets queue reaches its maximum size and all newly coming packets are dropped.
If you use high speed connection I recommend to use ReadPackets API instead ReadPacket (refer PackThru sample) and optimize your packet processing code.