The little premature optimization bug in my head tells me that I should port my existing x86 C# application to x64 because of the x64 release of an unmanaged DLL on which it relies. I know the answer is probably to do it, test and see what happens, but I wanted to see the what benefits to expect generally are. I found a lot of posts from two to four years ago that complain that the x64 CLR speed is slower than the x86 CLR.
What are areas when one could expect to speed up with x64 code? Is it worthwhile to port, except if you need more than 2 GB of memory? My code is mainly network oriented, dealing with medium sized byte arrays and encryption algorithms.