Unfortunately, the Sifter service and website has been decommissioned as of September 30, 2018. Thanks to our 6,970 users who created 16,128 free estimates from the complete, undeleted history of Twitter between 1/14/2014 and 9/29/2018.
Please contact Twitter for approval of future academic or commercial use cases. If you can get an approved use case from Twitter, we can still help you work with the data inside DiscoverText.
@DiscoverText remains open and is still the top-ranked text analysis platform on the Internet.
All paid jobs prior to the decommissioning will still be honored.
Sifter is a tool for searching the full history of Twitter. The power of Sifter derives from the PowerTrack filtering capabilities. Watch a video introduction to how the filters work.
You must have a Sifter account. You can register for a free account at: http://sifter.texifter.com/
1. Log into your account on Sifter.
2. From the landing page, please select the option to create a new estimate.
3. Enter a job title and select Continue.
4. Select the start date and end date. Select Continue.
5. A cost estimate will be generated based on the number of days entered. Pricing for historical Twitter is based both on the number of days and the number of tweets. Select the Continue button.
6. A page will appear that will explain the process. The interactive filters are optional and queries can be entered without using these filters. However, the filters are very powerful. Select the Continue button when done.
7. The create new estimate page will display. Queries can be entered directly into the Rule Text section.
8. The optional filters below the Rule Text section can create filters or negation filters and string together boolean rules to build a Gnip-enabled historical PowerTrack rule.
NOTE: That can be quite a complex endeavor, there are certain things you can and cannot do. We encourage you to read carefully the list of Twitter PowerTrack Operators and come to understand this is just the top of the list. There are about 50. The dropdown menus allow you to construct more nuanced rules and to do it in a way where the system will give you a little bit of assistance.
NOTE: The new PowerTrack syntax uses different operators in some cases. For example:
place_country: replaces the version 1.0 country_code operator
For more information, please review this documentation from Twitter.
9. You can select the particular rule from the dropdown and put the value you in the box.
a. OPTION 1: Hit the plus sign to add that rule.
b. OPTION 2: Also use the minus signs to take rules away.
10. Once you get the rule set just the way you want it, click the blue Translate button. That will put the rule you created together for you in a way that will be valid and will go through the system.
11. The translated rule will appear. Next select the Complete button.
12. Please read the terms of service then click Submit.
13. If the rule was valid and an estimate was successfully created, a validation screen will appear. The estimate will now appear in the list of estimates. An email will be sent to the user when the estimate is ready.
We do not currently subscribe to the Gnip "profile" keywords (such as profile_country, profile_region, and profile_geo). Attempting to use them will return an error.