this can also be an answer is "we had come one month ago"

that, I had gone to delhi 3 years ago, is wrong sentence

No! I think, it should be:- We came one month ago. It's correct because if the past time is given in any sentence then we generally use "simple past tense" for those types of sentences.