Processing huge XML files

Asked Jun 22 '20 at 20:07

Active Jun 22 '20 at 20:07

Viewed 101 times

I am working on an application which has below requirements -

Download a ZIP file from a server.
Uncompress the ZIP file, get the content (which is in XML format) from this file.
Process the content and insert it into DB.

The concern here is that the XML file may be of Huge size say like 2 GB!

What's the Laravel/PHP way of doing that without killing the server?

asked Jun 22 '20 at 20:07

OurBG

Have you seen https://stackoverflow.com/questions/911663/parsing-huge-xml-files-in-php? – Don't Panic Jun 22 '20 at 20:46
Yes @Don'tPanic, or the use of file streaming. – Dimitri Mostrey Jun 23 '20 at 09:55
You should look into a new-ish PHP structure called a Generator. It allows you to generate each successive piece of data as you need it, rather than loading the entire pile of data into memory. – Stephen R Jun 25 '20 at 17:01

0 Answers0