Search code examples
mysqlmyisamtokudb

improve mysql load data

Is there any mysql parameter to improve the speed of "LOAD DATA INFILE " ?

I am using 1 MyISAM and 1 TokuDB table. The data is saved as Tab separated text file.

Solution

  • There are a number of ways to speed this up. http://dev.mysql.com/doc/refman/5.1/en/insert-speed.html

    For large inserts it's usually the index updating that slows things down. So even using techniques like locking the table, turning off index updates, it can still take a long time when the indexes have to be created. Index creation, and thus inserts, on MyISAM tables can be sped up by increasing the value of the key_buffer_size. Make this large enough to hold the index(es) and your inserts can speed up by orders of magnitude. You can reduce it after the insert if need be.