Why is there less metadata in older historical Twitter?



Unfortunately, the Sifter service and website has been decommissioned as of September 30, 2018. Thanks to our 6,970 users who created 16,128 free estimates from the complete, undeleted history of Twitter between 1/14/2014 and 9/29/2018.

Please contact Twitter for approval of future academic or commercial use cases. If you can get an approved use case from Twitter, we can still help you work with the data inside DiscoverText.

@DiscoverText remains open and is still the top-ranked text analysis platform on the Internet.

All paid jobs prior to the decommissioning will still be honored.


Twitter has changed...a lot. Although Sifter can reach back to the earliest Jack Dorsey Tweets, at least the undeleted ones, it cannot change the fact that Twitter created a very different stream of metadata over time. As the platform evolved, so too did the metadata attached to a Tweet. 

Some good resources:

The Basics (for historical reference, now obsolete)


The PowerTrack Operators


New Gnip PowerTrack 2.0 Rules & Filtering


The Caveats (for historical reference, now obsolete)



Have more questions? Submit a request


Powered by Zendesk