I extract an xap file using winzip and edit some resources.
Is there any way I can pack the dlls back into the xap file?
You can easily do that using 7-Zip. Just use 'Open Archive' on the xap and then drag and drop files into it.