I had a similar issue with elixir_ls constantly fetching deps, I discovered it was because installing one of the dependencies was failing due to some build error. I quit my editor, deleted the .elixir_ls folder and reopened my editor and that resolved the problem. Maybe try that?