In a previous post, I presented an Unexpected Memory Consumption for Bulk Index Creation in InnoDB. This was triggered by an increased innodb_sort_buffer_size and as stated in another post: "the sorting algorithm does not scale well with large sort buffers". In this post, I will present why it does not scale well and I will suggest solutions.
Showing posts with label Index. Show all posts
Showing posts with label Index. Show all posts
Saturday, July 16, 2016
Saturday, August 29, 2015
Unexpected Memory Consumption for Bulk Index Creation in InnoDB (MySQL)
In my last Booking.com Hackathon, I worked on MyISAM vs InnoDB for data loading (LOAD DATA IN FILE) and bulk index creation. My motivation was the following: knowing that some are still using MyISAM for this particular use-case, I wanted to verify/understand if/why InnoDB is slower than MyISAM. I do not yet have complete results on this specific subject but I found some interesting things that are worth sharing.
Subscribe to:
Posts (Atom)