The reason for the delayed response is most likely that the Hodgkin–Huxley neuron model consists of a set of nonlinear differential equations similar to those of an electrical circuit. All types of differential equations exhibit transient responses. In other words, even though the stimuli have stopped, the excitations from the last signal will persist in the dynamics of the Hodgkin–Huxley neuron model.
