I have a HTML Page with multiple divs like:

<div class="post-info-wrap"><h2 class="post-title"><a href="https://www.example.com/blog/111/this-is-1st-post/" title="Example of 1st post &#8211; Example 1 Post" rel="bookmark">sample post &#8211; example 1 post</a></h2><div class="post-meta clearfix"><div class="post-info-wrap"><h2 class="post-title"><a href="https://www.example.com/blog/111/this-is-2nd-post/" title="Example of 2nd post &#8211; Example 2 Post" rel="bookmark">sample post &#8211; example 2 post</a></h2><div class="post-meta clearfix">

and I need to get the value for all the divs with class post-info-wrap I am new to BeautifulSoup

so I need these urls:

• https://www.example.com/blog/111/this-is-1st-post/

• https://www.example.com/blog/111/this-is-2nd-post/

• and so on...

I have tried:

import re
import requests
from bs4 import BeautifulSoupr = requests.get("https://www.example.com/blog/author/abc") 
data = r.content  # Content of responsesoup = BeautifulSoup(data, "html.parser")
for link in soup.select('.post-info-wrap'):print link.find('a').attrs['href']

This code doesnt seem to be working. I am new to beautiful soup. How can i extract the links?

You can use soup.find_all:

from bs4 import BeautifulSoup as soup
r = [i.a['href'] for i in soup(html, 'html.parser').find_all('div', {'class':'post-info-wrap'})]

Output:

['https://www.example.com/blog/111/this-is-1st-post/', 'https://www.example.com/blog/111/this-is-2nd-post/']