Week 14 Info: Distributed Computing
Hello Class,
Week 14 has begun. In Week 14 we will complete part 2 of a module where we learn tools for working with large datasets and within distributed computing frameworks. We will learn about the architecture of distributed computing clusters and file systems and learn about a computing framework called Apache spark which enables fast data management and analysis on cloud computing clusters. We will work with Spark using an R package called sparlyr, which is part of the tidyverse.
The primary reading for the week is:
See Module 13 for mode info: Module 13.
This week, we will complete our final lab assignment, lab 10. This Lab will cover the basics of data.table and sparlyr. Also you should continue working on your project.
Finally, Frank Kovacs will join us for the meetup this week for a special presentation on spark. I hope that all of you can attend!