Data Scraping Example: Harvard Courses

library(rvest)

## Warning: package 'rvest' was built under R version 4.1.2

url = "https://pll.harvard.edu/trending"
webpage = read_html(url, encoding = "UTF-8")
nodes <- html_nodes(webpage,xpath = '//h3/a')
for (node in nodes)
  print(html_text(node))

## [1] "Introduction to Family Engagement in Education"
## [1] "Beethoven's 9th Symphony and the 19th Century Orchestra"
## [1] "Innovating in Health Care"
## [1] "Monteverdi’s L’Orfeo and the Birth of Opera"
## [1] "Ancient Masterpieces of World Literature"
## [1] "U.S. Public Policy: Social, Economic, and Foreign Policies"
## [1] "Mechanical Ventilation for COVID-19"
## [1] "Food Fermentation: The Science of Cooking with Microbes"
## [1] "Improving Your Sleep"
## [1] "United States Health Policy"
## [1] "Religious Literacy: Traditions and Scriptures"
## [1] "Humanitarian Response to Conflict and Disaster"
## [1] "Religion, Conflict and Peace"
## [1] "Shakespeare’s Othello: The Moor"
## [1] "Free Business Lessons from Harvard Business School Online"