Can you explain why 'ago' is an adverb in the sentence please?

Ago is modifying the noun 'time' in this case, as it does in phrases like 'three months ago'. As i understand it, 'ago' used to be the past participle 'agone', which has dropped out of favor in more recent times.