Free versus premium social data


With DiscoverText, you can import free or premium social data from a variety of sources.

Free social data

Import free social data from several sources such as the Twitter Search API or Facebook. The amount of accessible data will be "rate" limited by the publisher.

In the case of Facebook, a complex set of factors determine what data may be available over the public "Open Graph" API inside of DiscoverText and your own network and settings will impact the results.

For the Search API on Twitter, the total number of "fetches" per unit of time and the percent of available data are both factors determined by Twitter.

Premium social data

For more comprehensive results from Twitter, access premium social data via Twitter PowerTrack-enabled (previously called Gnip) data streams, which includes enhanced metadata features and powerful query filters. The PowerTrack capability is available day-forward for Twitter. There are more than 50 PowerTrack filtering rules. For example, you can create rules with operators such as "contains:" or "lang:".

  • contains:time - Returns a pure substring match such as "timepiece" or "tim eastwood".
  • lang:en - Returns activities identified by PowerTrack as being English.

To import premium social data, you must have available Gnip PowerTrack credits, which are sold directly via on the site in blocks of 10,000.

For more PowerTrack information, including pricing for credits, see the Gnip PowerTrack pricing page on the DiscoverText website.

Note: The 3-day free trial does not include exports of live data feeds from Twitter or other sources. For more information, please see our feature comparison.

See the 3-day free trial article for more information.

We currently do not have access to the Facebook Firehose for Gnip. However, you can pull in Facebook data via the public API inside of DiscoverText, and we have found that it does a reasonable job of obtaining most, if not all, posts and comments for a particular page and/or query. With this, it will only allow you to go back at most 6 to 12 months depending on the amount of data).


Unfortunately, the Sifter service and website has been decommissioned as of September 30, 2018. Thanks to our 6,970 users who created 16,128 free estimates from the complete, undeleted history of Twitter between 1/14/2014 and 9/29/2018.

Please contact Twitter for approval of future academic or commercial use cases. If you can get an approved use case from Twitter, we can still help you work with the data inside DiscoverText.

@DiscoverText remains open and is still the top-ranked text analysis platform on the Internet.

All paid jobs prior to the decommissioning will still be honored.


Have more questions? Submit a request


Powered by Zendesk