How to work with big data files (5gb+) in Python Pandas!

In this video, we quickly go over how to work with large CSV/Excel files in Python Pandas. Instead of trying to load the full file at once, you should load the data in chunks. This is especially useful for files that are a gigabyte or larger. Let me know if you have any questions :). Source code on Github: Raw data used (from Kaggle): I want to start uploading data science tips & exercises to this channel more frequently. What should I make videos on?? ------------------------- Follow me on social media! Instagram | Twitter | TikTok | @keithgalli ------------------------- If you are curious to learn how I make my tutorials, check out this video: Practice your Python Pandas data science skills with problems on StrataScra
Back to Top