Week 13 Info: Working With Large Datasets
Hello Class,
Week 13 has begun. In Week 13 we will begin a two part module where we learn tools for workin with large datasets and also how to work in distributed computing frameworks. We will learn a little bit about computer architecture and then learn about an R package called data.table which is outside the tidyverse but which has several key advantages, including a syntax that some people find easier to use (if harder to learn at first) and very high efficiency and speed when working with certain types of large data sets and data wrangling problems.
The two primary readings for the week are:
- Data Table Vignette
- Why R is Slow - This is a short section from the first version of Hadley Wickham’s Advanced R book.
See Module 13 for mode info: Module 13.
This week, we will finish the github assignment with the tidyverse extend assignment. You can read more about the tidyverse extend assignment here: tidyverse extend . We will cover the material on Data.Table in the last lab assignment. After this week, there will be one more lab (on big data/cloud computing) and your final project.