You're doing very well.
I know I have found I can't really learn to speak unless I have someone to speak with. I can write, I can form sentences, I can think in my mind. But unless I practice speaking I don't really learn.
I tried a language once that no one really spoke in the area I lived in- and so I just couldn't get it. Then one day I had a language immersion in which we had to speak only that language and nothing else. If we didn't know a word, we wrote it down in English so someone could tell us what the word was. This one day made so much difference.