OK, I'm getting a little confused here. Now you're talking about "a way to make it faster", but your original post is about seeing .svn folders in the directory view.
I'm using GNU/Linux too. I have put ".svn/" (without the quotes) in "Exclude filespecs" when I've used wildcards to define my project. I don't see .svn directories in the directory view (Projects tool window, Auto Folder > Directory View).
Have you tried that, and are you still seeing the .svn folders?
Regards
John Hurst
Wellington, New Zealand