AE 25: Web scraping

Community Survey

https://duke.qualtrics.com/jfe/form/SV_bOEgZLIPYZg93X7

Announcements

Assignments

• Written report due Sun, Nov 15 at 11:59p
• Video presentation due Tue, Nov 17 at 11:59p
  • Presentation slides
• Final repo due Tue, Nov 17 at 11:59p
  • Includes codebook (a list of variables and their definitions) in the data folder
• Watch and comment on presentations Nov 18 - Nov 20

Web scraping

Add SelectorGadget to bookmark bar

Scrape IMDB Top 250 movies

URL: http://www.imdb.com/chart/top

R Script: appex-25-web-scrape-movies.R

Scrape Top 100 TV shows

URL: http://www.imdb.com/chart/tvmeter

R Script: appex-25-web-scrape-tv.R

---

IMDB exercises from Data Science in a Box