Reading Data From Excel vs DB in Java

Question

I have an excel file with one or two sheets and 30K+ rows in each sheet. I need to parse each row into a DTO, then generate a unique number for each of them and then store everything in DB.

I can convert data to DTOs in 2 ways:

Either, read data directly from excel using Apache.poi,
Or, import data into DB (using DB Tools) and read from DB (by creating appropriate entity and then converting it to DTO).

My questions is: which option is preferable/optimal/faster/better?

My concern is that reading from excel would be slower but each row could have about 100 cells so creating the appropriate table and entity class with those fields may also take time considering that the functionality may be executed very seldom.

score 0 · Answer 1 · answered Mar 11 '20 at 12:24

0

IMO best approach will be using apache-poi. You can use this link [1], on how to do it.

Because if you are going to store everything to a DB will take considerable amount of time and then again you have to generate DTO by reading the data tables.

[1] How to convert my xlsx sheet to java object using Apache POI

answered Mar 11 '20 at 12:24

Pramodya Mendis

686
8
24

1

I know how to do it, I just doubt that reading from excel 30000+ rows would be slower than reading the same amount of rows from DB. – Armine Mar 11 '20 at 12:29
Anyway you have to read that excel file to populate the data tables right? – Pramodya Mendis Mar 11 '20 at 12:30
1

No, I just can do an import, for example, by using Toad or MS SQL Server, or whatever... – Armine Mar 11 '20 at 12:31
But that would be slow compared to direct generating DTOs – Pramodya Mendis Mar 11 '20 at 12:37
2

The implementation would take some more time, but the execution may be much more faster. – Armine Mar 11 '20 at 12:43

Reading Data From Excel vs DB in Java

1 Answers1