I have stumbled upon this slow performace problem using my local installed SQL Server 2008 Express. (For complete background see my other SO post: EF query against Database View is very slow)
Instead, when I use SQL Server 2005 as the backend, I have no issues at all.
So, my question is: what is the problem between EF4.0 and SQL Server Express?