Media Summary: Review - Math review - Numpy and Spark - Lambda functions. Text Analysis - Text similarity of Entity Resolution - Weighted bag-of-words - Cosine similarity - Scalable Entity Resolution ... Notebook usage - Intro to spark and pySpark API - Using RDDs - Lambda functions - RDD actions, transformation, caching ...
Hackon Data 2017 Workshop 5 - Detailed Analysis & Overview
Review - Math review - Numpy and Spark - Lambda functions. Text Analysis - Text similarity of Entity Resolution - Weighted bag-of-words - Cosine similarity - Scalable Entity Resolution ... Notebook usage - Intro to spark and pySpark API - Using RDDs - Lambda functions - RDD actions, transformation, caching ... Create a RDD and pair RDD - Counting words - Finding unique words and mean value - Reference to regular expressions ... 2017 Penn State Altoona Data Science Workshop By Nick Felker How do we make better hackathons? With
