Lec-5.1 Overview of Web Scraping (Arif Butt @ Data Science)
01:05 Public Data Set Repositories 02:05 Overview of Web Scraping 02:50 Using APIs to Acquire Data from Websites 06:18 What is Web Scraping? 06:54 How Web Scraping Works? 09:05 BeautifulSoup vs Selenium vs Scrapy 11:22 Is Web Scraping Legal? 14:07 A bit of Motivation 16:30 Overview of a Web Application Architecture 21:08 The Anatomy of a Web Page 24:48 The Document Object Model (DOM) 29:03 Google Chrome Developer Tools 51:41 The Python urllib Package 58:06 The requests Library email: arif.ds@pu.edu.pk, arif@pucit.edu.pk, arifpucit@gmail.com Lecture Slides and Resources: http://arifbutt.me Jupyter notebooks: https://github.com/arifpucit/data-science/
01:05 Public Data Set Repositories 02:05 Overview of Web Scraping 02:50 Using APIs to Acquire Data from Websites 06:18 What is Web Scraping? 06:54 How Web Scraping Works? 09:05 BeautifulSoup vs Selenium vs Scrapy 11:22 Is Web Scraping Legal? 14:07 A bit of Motivation 16:30 Overview of a Web Application Architecture 21:08 The Anatomy of a Web Page 24:48 The Document Object Model (DOM) 29:03 Google Chrome Developer Tools 51:41 The Python urllib Package 58:06 The requests Library email: arif.ds@pu.edu.pk, arif@pucit.edu.pk, arifpucit@gmail.com Lecture Slides and Resources: http://arifbutt.me Jupyter notebooks: https://github.com/arifpucit/data-science/