I'm trying to scrape this Page https://rarity.tools/thecryptodads Using Selenium in python.
At the top of the right of each card below, there's the owner name that contains a link once pressed, it takes you to that owner's page.
When I inspect the element I can clearly see the a tag with the href link as shown below:
However, When I try to scrape it. it gets neither that text within the a tag nor the href. I tried to get the div above it which contains this a tag along with another div that contains the number on the card located top left, but when I get the innerText of the div. it only gets the text of the first div AKA the number. (prints 1 for the first card).
here's the code on how I'm trying to get the link:
PATH = "C:\Program Files (x86)\chromedriver"
driver = webdriver.Chrome(PATH)
driver.implicitly_wait(10)
driver.get("https://rarity.tools/thecryptodads")try:click = WebDriverWait(driver, 10).until(EC.presence_of_element_located((By.XPATH, "/html/body/div/div/div/div[2]/div[2]/div[8]/div[1]/div[1]/div/div[1]/a")))print(click.text)
except:print()
I tried to get the item by class name, css selector, xpath, full xpath. still cant get the href. BUT when I go into the debug mood and go through it line by line, I can see that this object is holding the text I want and it prints it at the end of the execution. which is so weird to me. I assume that this text is using some sort of encryption! that prevents me form scaping it!