i have lack of confidence to speak with other person

Don't stop at the listening portion, and when you study, don't just listen. Speak out loud the material you are listening to and practice what you hear. Practice speaking out loud until your mouth and brain can do it without any effort. By doing so, you will be able to speak English fluently.