I didnt read your paper. So I am not sure that what I say is what referee wanted. I conjecture the dataset you deal with must be large. In recent literature, the factor model are introduced in time series to take into account the strong dependence of the series over cross-section. See Bai Jushan's papers