Do you have many files in your project root folder? That could be the issue.
I initially had the same issues you are describing. Performing simple tasks such as moving, deleting, or renaming files took 5 - 15 min. For my project, I initially had log/output folders (not in project, untracked) buried in the project root folder. The output folders contained around 15000 output files. Deleting the output files or saving the output files outside of the project root folder resolved the issue for me; it takes only ~5 s for simple tasks. It seems like it doesn't matter whether the files are added to the project / tracked.
