Why is my Sifter data broken up into 50,000 item archives? Can I regroup them altogether?



Unfortunately, the Sifter service and website has been decommissioned as of September 30, 2018. Thanks to our 6,970 users who created 16,128 free estimates from the complete, undeleted history of Twitter between 1/14/2014 and 9/29/2018.

Please contact Twitter for approval of future academic or commercial use cases. If you can get an approved use case from Twitter, we can still help you work with the data inside DiscoverText.

@DiscoverText remains open and is still the top-ranked text analysis platform on the Internet.

All paid jobs prior to the decommissioning will still be honored.


We break Sifter jobs into 50,000 item archives in DiscoverText to make them Twitter-approved (i.e., legal under Twitter's Terms of Service) and to make Save as CSV actions easier. Also, some of our tools work better on archives that are 50,000 items or less.

You can create a "bucket" and add all your archives to it. Then you can convert the bucket to a new archive. You can also click on the project name in the left navigation and that list will include every item in the project.

Have more questions? Submit a request


Powered by Zendesk