Jovian
Sign In

Webscrapping Using Selenium

Webscrapping tutorial using Selenium in Mercadolibre, the biggest marketplace in latinamerica

The following notebook aims to use the powerful library of Selenium, what makes really interesting of this one is the capacity to automized the interaction of any website. Nowadays, most of the websites do not display in a flat or static order, they are so dynamic.

The following tutorial is divided in the following sections:

-Import the necessary libraries to run BeautifulSoup and Selenium are imported

-We should loop for the initial clicks due the box categories

-Define the the elements who will

-Convert the data into a CSV File

Recall the necessary libraries

import jovian
import pandas as pd
import random
from time import sleep
from selenium import webdriver

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from selenium.webdriver.common.by import By
from selenium.common.exceptions import NoSuchElementException