Jovian
Sign In

Web Scraping Nintendolife 71269

Scraping The Top Games from Nintendolife.com using BeautifulSoup

By Uday Sidhu

Objective: To Retrieve the names, ratings, and page URLs for the top games listed on nintendolife.com.

Nintendolife.com is a website pertaining to everything Nintendo. It hosts the latest news, announcements, guides, and reviews of the latest games released or coming to a Nintendo platform. It also hosts a list of the top rated games of all time. This is the list that we are going to be scraping in this project.

logo

What is web scraping?

Web scraping is the process of collecting structured web data in an automated fashion. It’s also called web data extraction. Some of the main use cases of web scraping include price monitoring, price intelligence, news monitoring, lead generation, and market research among many others. In this project we use python libraries requests and BeautifulSoup4 to retrive and parse HTML pages and obtain the desired information.

https://www.zyte.com/learn/what-is-web-scraping/

webscraping_image

Outline

  1. Retrieve web-page using requests.
  2. Import BeautifulSoup4 to parse the webpage thus obtained.
  3. Obtain the required information such as game name, game page URL, and rating.
  4. Store obtained information in the form of a dictionary.
  5. Write extracted information to a .csv file.
  6. Consolidate the code into functions and get entries from a specific page number.
!pip install jovian --upgrade --quiet
import jovian
# Execute this to save new versions of the notebook
jovian.commit(project="Web-Scraping-nintendolife.com")
[jovian] Creating a new project "udaysidhu1/Web-Scraping-nintendolife.com" [jovian] Committed successfully! https://jovian.ai/udaysidhu1/web-scraping-nintendolife-71269 
'https://jovian.ai/udaysidhu1/web-scraping-nintendolife-71269'
import requests
udaysidhu1
Uday Sidhu6 months ago