In these times, the days leading up to Christmas and the holiday season, we thought it would be appropriate and interesting to use our set of tools in our analytical toolbox and take a closer look at one of the holidays core ingredients . We are going to take an introductory look (or listen?) at... Continue Reading →
Working with large csv-files in pandas? Create a SQL-database by reading files in chunks
It is not uncommon to have to deal with for instance csv-files containing millions of rows. Searching, filtering and slicing can therefore be time-consuming tasks. So, the question is then: Are there any ways to speed up the process? If so, this could save a considerable amount of time for any data scientist needing to... Continue Reading →