excelvbaweb-scrapingscreen-scraping
Having difficulty in scraping product href from website
I am having difficulty in trying to pull the href from a website. I have been stuck on it for a few days nows. As the image below shows I can get all the other required information. I have tried several variations for the class as well as trying to get it via the a Tag, however I can not work it out.
This is my latest attempt, still can not work it out
Question, Can someone please point out the correct Class?
If element.getElementsByClassName("product-card ")(0).getElementsByClassName("listing-fpa-link")(0) Is Nothing Then
wsSheet.Cells(sht.Cells(sht.Rows.Count, "A").End(xlUp).Row + 1, "A").Value = "-"
Else
HtmlText = element.getElementsByClassName("product-card")(0).getElementsByClassName("listing-fpa-link")(0).href
wsSheet.Cells(sht.Cells(sht.Rows.Count, "A").End(xlUp).Row + 1, "A").Value = HtmlText
End If
Results
<article data-standout-type="featured-listing" class="product-card js-standout-listing">
<div class="product-card__inner">
<section class="product-card-image ">
<div class="listing-image-count">
<i data-label="search appearance click " class="listing-image-icon">
<svg>
<use xlink:href="/templates/_generated/svg_icons/search-listings.svg#icon-camera"></use>
</svg>
</i> 12
<!--replace with hasSpin-->
</div>
<img class="product-card-image__image product-card-image__main-image" alt="" srcset="
https://m.atcdn.co.uk/a/media/w262h198pf7f7f5/db56983925c647b6bbcaa526f9248a99.jpg 262w,
https://m.atcdn.co.uk/a/media/w340h255pf7f7f5/db56983925c647b6bbcaa526f9248a99.jpg
" sizes=" (max-width: 1024px) 262px, 340px
" src="https://m.atcdn.co.uk/a/media/w340h255pf7f7f5/db56983925c647b6bbcaa526f9248a99.jpg" loading="lazy" data-label="search appearance click ">
<div class="product-card-image__thumbnails">
<img class="product-card-image__image" loading="lazy" data-label="search appearance click " srcset="
https://m.atcdn.co.uk/a/media/w84h63pf7f7f5/e301a4730db94209afbd2f44d4cfb314.jpg 84w,
https://m.atcdn.co.uk/a/media/w108h81pf7f7f5/e301a4730db94209afbd2f44d4cfb314.jpg
" sizes="(max-width: 1024px) 84px,108px
" src="https://m.atcdn.co.uk/a/media/w108h81pdfdfdf/e301a4730db94209afbd2f44d4cfb314.jpg" alt="">
<img class="product-card-image__image" loading="lazy" data-label="search appearance click " srcset="
https://m.atcdn.co.uk/a/media/w84h63pf7f7f5/28f4022b7f20457b9fc76a392d11191d.jpg 84w,
https://m.atcdn.co.uk/a/media/w108h81pf7f7f5/28f4022b7f20457b9fc76a392d11191d.jpg " sizes="
(max-width: 1024px) 84px, 108px
" src="https://m.atcdn.co.uk/a/media/w108h81pdfdfdf/28f4022b7f20457b9fc76a392d11191d.jpg" alt="">
<img class="product-card-image__image" loading="lazy" data-label="search appearance click " srcset="
https://m.atcdn.co.uk/a/media/w84h63pf7f7f5/fa16468ed0e54f6fb0dbd6661d84016e.jpg 84w,
https://m.atcdn.co.uk/a/media/w108h81pf7f7f5/fa16468ed0e54f6fb0dbd6661d84016e.jpg " sizes="
(max-width: 1024px) 84px, 108px"
src="https://m.atcdn.co.uk/a/media/w108h81pdfdfdf/fa16468ed0e54f6fb0dbd6661d84016e.jpg" alt="">
</div>
</section>
<div class="product-card-content">
<div class="product-card-content__car-info">
<ol class="badge-group">
<li class="badge-group__item" data-category="priceIndicator-GOOD">
Good price
</li>
<li class="badge-group__item">
No admin fees
</li>
<li class="badge-group__item">
Finance available
</li>
</ol>
<section class="product-card-pricing">
<div class="product-card-pricing__content">
<div class="product-card-pricing__price">
<span>£6,607</span>
</div>
</div>
</section>
<section class="product-card-details">
<h3 class="product-card-details__title">
Renault Clio
</h3>
<p class="product-card-details__subtitle">
0.9 TCe Play (s/s) 5dr
</p>
<p class="product-card-details__attention-grabber">
£550 OF EXTRAS • BLUETOOTH
</p>
<ul class="listing-key-specs">
<li class="atc-type-picanto--medium">2018 (68 reg)</li>
<li class="atc-type-picanto--medium">Hatchback</li>
<li class="atc-type-picanto--medium">61,671 miles</li>
<li class="atc-type-picanto--medium">0.9L</li>
<li class="atc-type-picanto--medium">76PS</li>
<li class="atc-type-picanto--medium">Manual</li>
<li class="atc-type-picanto--medium">Petrol</li>
<li class="atc-type-picanto--medium">1 owner</li>
<li class="atc-type-picanto--medium">ULEZ</li>
</ul>
</section>
</div>
<div class="product-card-seller-info">
<div class="product-card-seller-info__details">
<div class="product-card-seller-info__name-container">
<h3 class="product-card-seller-info__name atc-type-picanto">Carbase Bristol</h3>
<a class="dealer-profile-link atc-type-picanto" href="/dealers/gloucestershire/bristol/carbase-bristol-2445554" rel="nofollow" target="_blank">See all 780 cars</a>
</div>
<ul class="product-card-seller-info__specs">
<li class="product-card-seller-info__spec-item atc-type-picanto">
<svg width="16" height="16" viewBox="0 0 16 16" fill="#242D3D" xmlns="http://www.w3.org/2000/svg">
<path fill-rule="evenodd" clip-rule="evenodd" d="M10.6689 8.907L9.93491 9.47L10.2069 10.355L11.1309 13.363L8.81291 11.582L7.99991 10.958L7.18791 11.582L4.86891 13.363L5.79291 10.355L6.06491 9.47L5.33091 8.907L2.80991 6.969H5.84891H6.83391L7.12291 6.027L7.99991 3.173L8.87691 6.027L9.16591 6.969H10.1509H13.1899L10.6689 8.907ZM15.4299 5.636H10.1509L8.54391 0.403C8.46191 0.135 8.23091 0 7.99991 0C7.76991 0 7.53891 0.135 7.45591 0.403L5.84891 5.636H0.569911C0.0249108 5.636 -0.208089 6.331 0.224911 6.664L4.51891 9.965L2.89391 15.255C2.77091 15.657 3.08791 16 3.43991 16C3.55591 16 3.67491 15.963 3.78391 15.88L7.99991 12.639L12.2159 15.88C12.3249 15.963 12.4439 16 12.5599 16C12.9119 16 13.2299 15.657 13.1069 15.255L11.4809 9.965L15.7749 6.664C16.2079 6.331 15.9749 5.636 15.4299 5.636Z"></path></svg>
<span class="product-card-seller-info__spec-item-copy">4.5</span> (
<a class="product-card-seller-info__review-count dealer-profile-link" href="/dealers/gloucestershire/bristol/carbase-bristol-2445554#reviews-container">5409 reviews</a>)
</li>
<li class="product-card-seller-info__spec-item atc-type-picanto">
<svg width="16" height="16" viewBox="0 0 16 16" fill="#242D3D" xmlns="http://www.w3.org/2000/svg">
<path fill-rule="evenodd" clip-rule="evenodd" d="M8 4.0001C6.896 4.0001 6 4.8961 6 6.0001C6 7.1041 6.896 8.0001 8 8.0001C9.104 8.0001 10 7.1041 10 6.0001C10 4.8961 9.104 4.0001 8 4.0001ZM7.999 14.13C6.174 12.23 3.333 8.699 3.333 6C3.333 3.427 5.427 1.333 8 1.333C10.573 1.333 12.667 3.427 12.667 6C12.667 8.692 9.824 12.228 7.999 14.13ZM8 0C4.686 0 2 2.687 2 6C2 10.5 8 16 8 16C8 16 14 10.5 14 6C14 2.687 11.313 0 8 0Z"></path></svg>
<span class="product-card-seller-info__spec-item-copy">bristol</span> (77 miles)
</li>
</ul>
</div>
<div class="product-card-seller-info__logo">
<img src="https://dealerlogo.atcdn.co.uk/at2/adbranding/2445554/images/searchlogo.gif" alt="Advertiser Logo Carbase Bristol">
</div>
</div>
</div>
</div>
<a class="js-click-handler listing-fpa-link tracking-standard-link" data-results-nav-fpa="" data-label="search appearance click " rel="nofollow" href="/car-details/202103170253503?include-delivery-option=on&postcode=b94ta&radius=1500&sort=relevance&onesearchad=New&onesearchad=Nearly%20New&onesearchad=Used&advertising-location=at_cars&page=1"></a>
</article>As always thanks in advance.
Solution
It ok, I have fixed the issue. I changed the parent class to Set elements = HTML.getElementsByClassName("search-page__result")
Then changed my code to
If element.getElementsByClassName("js-click-handler listing-fpa-link tracking-standard-link")(0) Is Nothing Then
wsSheet.Cells(sht.Cells(sht.Rows.Count, "A").End(xlUp).Row + 1, "A").Value = "-"
Else
HtmlText = element.getElementsByClassName("js-click-handler listing-fpa-link tracking-standard-link")(0).href
wsSheet.Cells(sht.Cells(sht.Rows.Count, "A").End(xlUp).Row + 1, "A").Value = HtmlText
End If
Results
- How to make Colors Mixer in vba
- How to get HEX color value from cell color?
- SSIS: Insert multiple Excel files with same format but different file name to multiple database table destinations based on the Excel filename
- How to randomize Excel rows
- VLOOKUP Returns 0 even though there is a value in the line below the first result
- transpose a table with multiple values in excel
- Trying to late bind outlook to but getting type mismatch error after create object line
- Power Query Transform a Column based on Another Column
- Apply FILTER formula to array (and use filter criteria on specific column in the array)
- Bitly API call using VBA Excel Macro
- excel vba projects not closing
- In a standard MS Access SQL query output that does not have any aliases, how do I replace the full names by their "first-letters" aliases?
- Sigma or Summation function in Excel
- Problem getting the value from a cell using M in excel
- INDEX MATCH to also pull through notes
- Move formatted data in selection from Excel into Word tables
- Excel VBA function to remove letters at end of string
- Can't get all excel processes to stop when closing through Powershell
- Excel function to construct an array from values without VBA
- Alternative method to delete file with out having to add MS Scripting Runtime Reference
- Add new button to worksheet with Excel Add-in
- Apply outline border only to range of cells with openpyxl
- How to Separate Data with Inconsistent Patterns into a Structured Format in Excel
- Excel - Aggregate dynamically values in a Table using array formulas (MAP, BYROW, CHOOSECOLS, TEXTJOIN, LAMBDA, FILTER, HSTACK) in a single Cell
- How to reference the current User\Desktop location in VBA
- Powerpoint chart to excel relative link
- EXCEL: How do I return multiple columns using XLOOKUP, when the lookup_value is a range?
- VBA: How to Loop IF Statement through a Cell and Chart Series
- Incorporating Checkbox to lines of code rather than Cell value
- How do I remove a character from a column of data in Excel