You truly must live amongst the locals to speak colloquially. French isn’t an easy language — I know, I studied it. I once was very good at reading and writing, fair at understanding, horrible at speaking. Sigh. I tried. I am surrounded by Spanish-speakers and have studied that language with a tutor and still can’t participate in the most elementary of languages.
However, I find understanding a language is not necessary to understanding music in that language.