how can insert 1000000 row from textarea into database in laravel?

Question

how can insert 1000000 row from textarea into database in laravel 8 ???????

i write this code and just can insert 30000 row and then browser give me HTTP ERROR 500

i set max_execution_time to 300 in php.ini

this is my code please help me . thanks

public function mobile_store(Request $request)
{
    $data = $request->validate([
        'mobile' => ['required', 'string', 'unique:mobiles,mobile'],
    ]);
    $textAr = collect(explode("\r\n", $data['mobile']));
    $ALL = $textAr->unique();
    $Filter = $ALL->filter()->all();
    $counter_unique = count($Filter);
    $counter = count($textAr);
    $insert_data = collect();
    foreach ($Filter as $line) {
        if (strlen($line) >= 10) {
            $final = '+98' . substr($line, -10);
        }
        $insert_data->push([
            'mobile' => $final,
            'created_at' => Carbon::now(),
            'updated_at' => Carbon::now(),
        ]);
    }
    foreach ($insert_data->chunk(5000) as $chunk) {
        Mobile::insert($chunk->toArray());
    }
    return redirect()->back()->with('success', "There were $counter_unique rows in the list and $counter non-duplicate rows were entered");
}

_"and then browser give me HTTP ERROR 500"_ - then go check what the error log has to say first of all. — CBroe, Feb 24 '22 at 08:04
log: local.ERROR: Allowed memory size of 134217728 bytes exhausted (tried to allocate 2097160 bytes) {"userId":1,"exception":"[object] (Symfony\\Component\\ErrorHandler\\Error\\FatalError(code: 0): Allowed memory size of 134217728 bytes exhausted (tried to allocate 2097160 bytes) — ProSonic, Feb 24 '22 at 08:17

score 0 · Accepted Answer · answered Feb 24 '22 at 08:31

Don't store all of the data first, just use 1 foreach and every 5000 records store the data and then reset the array and do the next batch of records.

$insert_data = collect();
$totalRecords = 0;
$batchCount = 0;
foreach ($Filter as $line) {
    if (strlen($line) >= 10) {
        $final = '+98' . substr($line, -10);
    }
    $insert_data->push([
        'mobile' => $final,
        'created_at' => Carbon::now(),
        'updated_at' => Carbon::now(),
    ]);
    if ( $batchCount++ == 5000 )  {
        // Insert data
        Mobile::insert($insert_data->toArray());
        // Reset batch collection
        $insert_data = collect();
        // Reset counter of current batch
        $batchCount = 0;
    }
    // Count of all records
    $totalRecords++;
}
// Insert remaining records
if( $insert_data->count() > 0 )
    Mobile::insert($insert_data->toArray());
}

how can insert 1000000 row from textarea into database in laravel?

1 Answers1