Search code examples
yahooyqlblacklist

YQL Blacklisting

I'm developing an online deck editor, Proxymang, and YQL can't handle the number of requests per second. The requests are one per Magic card, they're cached, and they're spaced out. What should I do?

GitHub

Solution

  • I never resolved the problem; I eventually decided to use the Gatherer's meager API instead.

    The problem seems to one of the following:

    • YQL blacklisted YelloSoft after too many requests/second
    • MagicCards.info blacklisted YQL after too many requests/second
    • MagicCards.info has a strict robots.txt which blocks HTML scraping, but not always