Search code examples
beautifulsoupweb-crawlerurllib

Why do I get "www.hankyung.com" in this script? Can I have any method to get a class = "info" not class ="info press"?

Why do I get "www.hankyung.com" url in this script? Can I have any method to get a class = "info" not class ="info press"?

links[0]

<div class="info_group"> <a class="info press" href="http://www.hankyung.com/" onclick="return goOtherCR(this, 'a=nws*a.prof&amp;r=1&amp;i=88000107_000000000000000004520785&amp;g=015.0004520785&amp;u='+urlencode(this.href));" target="_blank"><span class="thumb_box"><img alt="" class="thumb" height="20" onerror="this.src='data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7';this.className='thumb bg_default_press'" src="https://search.pstatic.net/common/?src=https%3A%2F%2Fmimgnews.pstatic.net%2Fimage%2Fupload%2Foffice_logo%2F015%2F2018%2F08%2F01%2Flogo_015_18_20180801163901.png&amp;type=f54_54&amp;expire=24&amp;refresh=true" width="20"/></span>한국경제</a><span class="info">1시간 전</span><a class="info" href="https://news.naver.com/main/read.nhn?mode=LSD&amp;mid=sec&amp;sid1=105&amp;oid=015&amp;aid=0004520785" onclick="return goOtherCR(this, 'a=nws*a.nav&amp;r=1&amp;i=88000107_000000000000000004520785&amp;u='+urlencode(this.href));" target="_blank">네이버뉴스</a> </div>

news_url = links[0].find("a", {"class":"info"}).get("href")
news_url
>>>'http://www.hankyung.com/'
Solution

  • You can use :not to the exclude the unwanted class (bs4 4.7.1+)

    news_url = links[0].select_one('a.info:not(.press)')['href']
news_url