Spec

Winter Quarter Project:

Topic: Analyze Smart/Home Devices reviews on various website

Pipeline:

Topic Selection --> Scraping --> Analysis --> Web Dev --> Publish

Major Files:

Amazon_Review_Scraper : Scrapes Amazon Reviews

Google_Review_Scraper: Scrapes Google Reviews

Research Questions:

• What are the most common words people use?
• Most common themes (categories) that people say.
• Who are the demographics of the people leaving comments?
• Looking at commercials and seeing if that matches.
• Seasonality of reviews.
• Distribution of star ratings.
• Does the sentiment analysis match the rating given by each review?
• Difference between amazon and google product reviews.
• Measure uncertainty, are people scared by it.
• Trying to get to the “why?” of peoples reviews, especially at the boundaries.
• Find the most negative and most positive reviews.

References:

• Amazon
• Amazon Scrape Guide
• lxml Documentation
• Scraping guide with lxml
• Our github