Search code examples
javascripthtmlscreen-scrapingwysiwygweb-crawler

WYSIWYG web scraping/crawling setup using Javascript/html5?


My goal is to allow less experienced people to setup the required parameters needed to scrape some information from a website.

The idea is that a user enters an URL, after which this URL is loaded in a frame. The user should then be able to select text within this frame, which should give me enough information to scrape this information again when this specific text changes dynamically.

The question is, if it's even possible to detect what part of the source of an external site corresponds to the selection of the user in a frame?

If not, are there any alternatives ?

Thanks in advance.

Regards, Tom


Solution

  • The short answer is no. If you don't control the content in the iframe, there's not much you can do to interact with it.

    However, you could make a bookmarklet that does something like you're describing, or a browser plugin.