
{"id":580,"date":"2009-09-02T09:31:01","date_gmt":"2009-09-02T16:31:01","guid":{"rendered":"http:\/\/briantroy.com\/blog\/2009\/09\/02\/something-is-definitely-not-right-with-twitter-search\/"},"modified":"2009-09-02T09:31:01","modified_gmt":"2009-09-02T16:31:01","slug":"something-is-definitely-not-right-with-twitter-search","status":"publish","type":"post","link":"https:\/\/blogarchive.briantroy.com\/index.php\/2009\/09\/02\/something-is-definitely-not-right-with-twitter-search\/","title":{"rendered":"Something is DEFINITELY Not Right with Twitter Search"},"content":{"rendered":"<p>I get hourly emails that show me (graphically) how much justSignal &#8220;collects&#8221; total from each of the services (Twitter, Blog Search, Backtype, etc). The thing about these graphs is they are amazingly consistent over time &#8211; that is why we use them&#8230; you can quickly see a change in the normal trend.<\/p>\n<p \/>\n<div>Yesterday I noticed that Twitter&#8217;s graph looked funny and that the volume was way down from a typical day (on a typical day we collect ~150 thousand tweets). This morning that trend has continued:<\/div>\n<p \/>\n<div><\/div>\n<div style='padding:5px 5px 10px;margin-top:5px;border:1px solid #ddd;background-color:#fff;line-height:16px;'>\n<div style=\"float:left;margin-right:5px;overflow:visible;\"><a href='http:\/\/posterous.com\/getfile\/files.posterous.com\/justsignal\/lPwL3U0u0puOL7NBHRtvCZ77JFgtNkBtijOmvg0aABMXGeOTqjLIdlurs6MP\/PastedGraphic-1.pdf' style='color:#bc7134;'><img src='http:\/\/posterous.com\/images\/filetypes\/pdf.png' style='border:none;' \/><\/a><\/div>\n<div style=\"font-size:10px;color:#424037;line-height:16px;\">Download now or <a href='http:\/\/justsignal.posterous.com\/something-is-definitely-not-right-with-twitte' style='color:#bc7134;'>preview on posterous<\/a><\/div>\n<p>       <b><a href='http:\/\/posterous.com\/getfile\/files.posterous.com\/justsignal\/lPwL3U0u0puOL7NBHRtvCZ77JFgtNkBtijOmvg0aABMXGeOTqjLIdlurs6MP\/PastedGraphic-1.pdf' style='color:#bc7134;'>PastedGraphic-1.pdf<\/a><\/b> <span style=\"font-size:10px;color:#424037;\">(57 KB)<\/span>       <br style=\"clear:both;\" \/><\/div>\n<\/p>\n<div><\/div>\n<p \/>\n<div>A normal day is a nice smooth curve up from about 2 or 3 am through mid day&#8230; like this:<\/div>\n<p \/>\n<div><\/div>\n<div style='padding:5px 5px 10px;margin-top:5px;border:1px solid #ddd;background-color:#fff;line-height:16px;'>\n<div style=\"float:left;margin-right:5px;overflow:visible;\"><a href='http:\/\/posterous.com\/getfile\/files.posterous.com\/justsignal\/9jU9dTacxSPW0R296ErRfRubDpMsa5imMBGOqUgiLNGhkg84Rv2VixWFH0M8\/PastedGraphic-2.pdf' style='color:#bc7134;'><img src='http:\/\/posterous.com\/images\/filetypes\/pdf.png' style='border:none;' \/><\/a><\/div>\n<div style=\"font-size:10px;color:#424037;line-height:16px;\">Download now or <a href='http:\/\/justsignal.posterous.com\/something-is-definitely-not-right-with-twitte' style='color:#bc7134;'>preview on posterous<\/a><\/div>\n<p>       <b><a href='http:\/\/posterous.com\/getfile\/files.posterous.com\/justsignal\/9jU9dTacxSPW0R296ErRfRubDpMsa5imMBGOqUgiLNGhkg84Rv2VixWFH0M8\/PastedGraphic-2.pdf' style='color:#bc7134;'>PastedGraphic-2.pdf<\/a><\/b> <span style=\"font-size:10px;color:#424037;\">(50 KB)<\/span>       <br style=\"clear:both;\" \/><\/div>\n<\/p>\n<div><\/div>\n<p \/>\n<div>Also worth noting, our total volume of Tweets collected yesterday was the lowest it has been in 60 days. Normally I would chalk this up to normal variation, but the percentage change from Monday to Tuesday was 50% &#8211; and that is unprecedented day over day change. You should also note that <a href=\"http:\/\/search.twitter.com\">http:\/\/search.twitter.com<\/a> provides an exact tweet for tweet match (in our limited sampling) to what we are collecting via the API &#8211; so this appears to be a global Twitter Search issue.<\/div>\n<p \/>\n<div>This seems to be affecting Trackers with high volume traffic on Twitter &#8211; so many of you will not notice any change. If however, your tracker regularly pulls in 10,000 tweets per day it appears that your volume will be cut (roughly) in half.<\/div>\n<p \/>\n<div>Obviously all of this is anecdotal and I&#8217;ve received no confirmation from Twitter that there is any issue. We will stay on top of it and keep you updated.<\/div>\n<p \/>\n<div>NOTE: No, we are not being rate limited &#8211; we are, in fact, using less than 10% of our whitelisted request limit per hour. All requests to Twitter Search API are returning normal response codes and, in most cases, tweets &#8211; just not nearly as many as just 2 days ago.<\/p>\n<div> <span style=\"font-size:12px;\" \/><\/p>\n<div><span \/><\/p>\n<p \/><\/span><\/div>\n<p><\/span> <\/div>\n<p><\/div>\n<p style=\"font-size:10px;\">  <a href=\"http:\/\/posterous.com\">Posted via email<\/a>   from <a href=\"http:\/\/justsignal.posterous.com\/something-is-definitely-not-right-with-twitte\">justSignal Status &amp; Updates Blog<\/a>  <\/p>\n","protected":false},"excerpt":{"rendered":"<p>I get hourly emails that show me (graphically) how much justSignal &#8220;collects&#8221; total from each of the services (Twitter, Blog Search, Backtype, etc). The thing about these graphs is they are amazingly consistent over time &#8211; that is why we use them&#8230; you can quickly see a change in the normal trend. Yesterday I noticed&hellip; <a class=\"more-link\" href=\"https:\/\/blogarchive.briantroy.com\/index.php\/2009\/09\/02\/something-is-definitely-not-right-with-twitter-search\/\">Continue reading <span class=\"screen-reader-text\">Something is DEFINITELY Not Right with Twitter Search<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[28,1],"tags":[173,250,286],"_links":{"self":[{"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/posts\/580"}],"collection":[{"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/comments?post=580"}],"version-history":[{"count":0,"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/posts\/580\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/media?parent=580"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/categories?post=580"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogarchive.briantroy.com\/index.php\/wp-json\/wp\/v2\/tags?post=580"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}