Week 6 - Web scraping and programming

Harvesting data from the web, writing functions, and iteration 🕸

Last updated on 1 Nov 2020

Tasks

Watch the videos
Complete the readings
Complete the assignments
(Optional) Complete the Course feedback survey by 5pm on Friday, 30th October (not graded)

Videos

You have two options for watching the course videos, on YouTube or on MediaHopper. You can also find a playlists for all course videos on YouTube here and on MediaHopper here.

No.	Title	Length
01	Keeping up with IDS: Week 6	9:38
02	Web scraping	14:25
03	Scraping top 250 movies on IMDB	24:15
04	Web scraping considerations	8:54
05	AE: IMDB + Web scraping	34:47
06	Functions	21:58
07	Iteration	13:54

Assignments

Assignment	Title	Due
Due this week
Project	Proposal	Tue, 27 Oct, 16:00 UK
HW 02	Majors + legos	Thur, 29 Oct, 16:00 UK
OQ 05	Scrape + iterate	Sun, 1 Nov, 23:59 UK
Due next week
Lab 04	UoE Art Collection	Tue, 3 Nov, 16:00 UK
Feedback	Peer evaluation 02 (emailed via TEAMMATES)	Wed, 4 Nov, 16:00 UK
Project	Proposal, take 2 (Optional)	Fri, 6 Nov, 16:00 UK

Readings


📄	Selector Gadget	Required
📖	R4DS: Chp 19, Functions	Required
📖	R4DS: Chp 21, Iteration - Only the following sections: 21.1, 21.2, 21.5.1, and 21.5.2	Optional

Code-along

You can find starter code for this session on RStudio Cloud, in the project titled Code Along 06 - First Minister’s COVID-19 Speeches.


Recording
Session artifacts	`.Rmd` `.md` `.R`

Interactive R tutorials

The following are interactive R tutorials, designed to give you more practice with R. These are optional, but they will show up in your next homework assignment, so you should gain familiarity with it. If you’re struggling with any of the topics covered this week, we strongly recommend you work through the interactive tutorials.


Money in US Politics	Related to HW 03
Write functions (Function basics, How to write a function, and Arguments)	Optional
Iterate (Introduction to iteration, Map, and Map shortcuts)	Optional