🚀 Why Use This Twitter Advanced Search Comments Scraper?
- 🔍 Collect replies from tweets matching advanced search conditions
- 💬 Capture conversation-level data, not just original tweets
- 📊 Analyze engagement, discussion patterns, and reactions
- 🧠 Support social listening, brand monitoring, and research
- 📁 Export structured datasets for reporting or analysis
Ideal for tracking how users respond to specific topics, keywords, or accounts.
Data Preview
Query_Str | Post_URL | Author_Name | Author_Web_Page_URL | Author_Handle | Verified_Status | UTC_Time | Ads | Tweet_Content | Post_ID | Tweet_URL | Reply_Count | Repost_Count | Like_Count | View_Count | Bookmark_Count | Tweet_Image_URL | Replying_to | Reply_to_Whom | Reply_to_Whom_URL | Reply_to_Whom_Username | Reply_to_Whom_Handle | Language | Tweet_Website | Tweet_Author | Author_Profile_URL | Posted_UTC_Time | Tweet_Text | Tweet_image_URL | Tweet_Likes | Tweet_Retweets | Tweet_Replies | Comment_Website | Comment_Author_name | Comment_Author_URL | Comment_Timestamp | Comment_Content | Comment_Image_URL | Comment_Likes | Comment_Retweets | Comment_Replies | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/NuffSaidThis/status/1907190391423590527 | NuffSaidThis | https://x.com/NuffSaidThis | Tue Apr 01 21:56:37 +0000 2025 | @BBCNewsnight Protectionist EU tariffs been ok then for ever and a day??! | 6 | 0 | 4 | ||||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/msectors/status/1628046891194654721 | msectors | https://x.com/msectors | Tue Feb 21 15:00:01 +0000 2023 | New 3x Leveraged and -3x Inverse Leveraged #Energy ETNs are now trading. For sophisticated traders only. $WTIU & $WTID Learn more: https://t.co/9hZuGIkvOG https://t.co/IihFa6y3Ew | https://pbs.twimg.com/media/Fpf8BSnXwAAdHiC.jpg | 260 | 48 | 13 | |||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/haigh_jimmy/status/1907349171448729742 | haigh_jimmy | https://x.com/haigh_jimmy | Wed Apr 02 08:27:33 +0000 2025 | @BBCNewsnight "Experts", eh? | 6 | 0 | 0 | ||||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/CalJamieson/status/1907503267900187003 | CalJamieson | https://x.com/CalJamieson | Wed Apr 02 18:39:53 +0000 2025 | @BBCNewsnight Look here @BBCNewsnight @vicderbyshire - your panels are full of establishment blowhards - how about balancing them with anti-establishment voices - academics - politicians - campaigners, etc.!!! | 6 | 0 | 0 | ||||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/greentree1001/status/1907222401970036776 | greentree1001 | https://x.com/greentree1001 | Wed Apr 02 00:03:49 +0000 2025 | @BBCNewsnight BBC managers are disgusting taking liberties, fixing it for Huw Edwards and Owen Jones, ex PM Boris Johnson was driven out of office by the BBC and Starmer for eating a piece of his own birthday cake 2020, if there’s a £22 billion black hole there should be a public inquiry.👨🏻⚖️ https://t.co/aRrfaE6UPj | https://pbs.twimg.com/media/GnfQqi_XAAABsqD.jpg;https://pbs.twimg.com/media/GnfQqjDWkAAU22M.jpg;https://pbs.twimg.com/media/GnfQqi8XEAAh0hO.jpg | 5 | 0 | 1 | |||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/jack_the37589/status/1907228935152169075 | jack_the37589 | https://x.com/jack_the37589 | Wed Apr 02 00:29:47 +0000 2025 | @BBCNewsnight She is absolutely right. What Trump is doing is to trigger a major economic crisis as a prerequisite to the effective dismantling of the constitution and the institution of a populist tyranny. | 3 | 0 | 4 | ||||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/KetzKK/status/1907536269413945452 | KetzKK | https://x.com/KetzKK | Wed Apr 02 20:51:01 +0000 2025 | @BBCNewsnight Such short sighted and small minded economic framing...Just remove all tariffs and USA will reciprocate == Voila a headwind becomes a huge positive tailwind for the UK Economy (are starmer & Rachel smart enough??) | 2 | 0 | 0 | ||||||
"trade war" | https://x.com/search?q="trade war" until:2025-04-02 since:2025-04-01&src=typed_query | BBC Newsnight | https://x.com/BBCNewsnight | BBCNewsnight | True | 2025-04-01 21:47:01+00:00 | False | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | 1907187972686115037 | https://x.com/BBCNewsnight/status/1907187972686115037 | 49 | 109 | 314 | 53930 | 29 | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | False | en | https://x.com/BBCNewsnight/status/1907187972686115037 | BBC Newsnight | https://x.com/BBCNewsnight | Tue Apr 01 21:47:01 +0000 2025 | “I think there’s going to be a global trade war…I think it’s going to be brutal.” Financial Times’ columnist Gillian Tett predicts higher inflation if the US imposes widespread tariffs and says it’s a “fallacy” for the UK to believe it could escape the effects. #Newsnight https://t.co/R4Y1xVRhjX | https://pbs.twimg.com/amplify_video_thumb/1907186129826172928/img/R1gnLjKuKs77va2O.jpg | 314 | 109 | 49 | https://x.com/Kitty29784/status/1907538492021944771 | Kitty29784 | https://x.com/Kitty29784 | Wed Apr 02 20:59:51 +0000 2025 | @BBCNewsnight https://t.co/5DiGspSbvb | https://pbs.twimg.com/media/GnjwJWxakAAg26z.jpg | 2 | 0 | 0 | |||||
📊 Data You Can Extract
Depending on what Twitter/X publicly displays, this template can extract:
- 📝 Tweet / reply text
- 👤 Username
- 🗓 Publish time
- ❤️ Likes
- 🔁 Retweets
- 💬 Reply count
- 🔗 Tweet URL
All data is exported in a structured, analysis-ready format.
Ready to Start Scraping?
No coding. No setup. Works immediately.
👥 Who Should Use This Template?
📣 Social Media & Brand Teams — Monitor conversations and replies
📊 Research & Analytics Teams — Study sentiment and engagement
🧩 Agencies & Strategists — Track campaign reactions
📈 Business & Market Analysts — Observe public discourse trends
🔗 Related Templates
Template | What to Scrape | What to Input | Where to Scrape |
|---|---|---|---|
Tweets related data only | Anything works on https://x.com/search?... | ||
Both tweets and comments data | Tweet URL | ||
Tweets related data only | Twitter Account URL | ||
Tweets related data only | Hashtags | ||
Cookies for Twitter Follower & Following Scraper | Twitter account and password | / | |
Follower and Following | Twitter Account URL + Cookies |
🐙 Why Octoparse?
🧩 No-Code Required — You don't need programming knowledge; just input keywords and locations, and run the scraper.
🔄 Automatic Workflow & Pagination Handling — Octoparse handles navigation through search results, page loading, and data extraction for you.
📁 Easy Export Formats — Export scraped results directly to Excel, CSV or JSON for easy analysis or integration into CRMs and databases.
👩💻 Beginner-Friendly UI — Ready to use out of the box. Just enter your keywords and run.
Start Scraping Twitter Data in Under 60 Seconds.
Join 100,000+ users extracting Twitter insights with Octoparse.
⚠️ Important Notes & Best Practices
- Use responsibly and respect Twitter/X's Terms of Service.
- Twitter/X rate limits may apply.
- Ensure personal data is handled ethically.
- If a sub-task shows a “Stopped” status, please re-run it, as this usually occurs due to temporary network fluctuations.
- Select the scraping mode based on your specific data needs.
- Do not input keywords and hashtags at the same time, as this will disable the time-range filter and may result in duplicate data.
How Many Tweets & How Long by Different Scraping Mode?
The data in this sheet is for reference only and does not reflect the actual situation.
Scraping Mode | Twitter Scraper (by keywords) | Time Spent | Parameter input |
|---|---|---|---|
month | 851 | 6m 41s | wukong 2023-08-26 2024-08-26 en |
week | 4013 | 27m 36s | wukong 2023-08-26 2024-08-26 en |
day | 14519 | 6h 52m 21s | wukong 2023-08-26 2024-08-26 en |
❓ FAQs
Can I scrape private or protected tweets?
No, only public tweets are accessible.
Can I schedule automatic Twitter scraping?
Yes! Use cloud-based scheduled runs to scrape Twitter data automatically at set intervals (hourly, daily, weekly).
How many tweets can be scraped at one time?
You can extract unlimited tweets based on your search parameters. However, Twitter/X rate limits may apply. For best results, we recommend batching large datasets.
How fast can I scrape Twitter data?
Our scraper can extract hundreds of tweets in minutes, depending on your search criteria and date range.
Do I need a Twitter API key to use this scraper?
No! Unlike Twitter's official API, Octoparse scrapes public data without requiring API keys, developer accounts, or authentication.
🛠 How to Use: Step-by-Step Guide
1. Start the template
Click "Try it!" or "Start" to load the template.
2. Enter your scraping parameters
On the input screen, fill in your keyword and filter options.
✍🏻 Input Fields Explained
Parameter | Required? | Description | Example |
|---|---|---|---|
Start Date (From) | Yes | Only include tweets posted on or after this date. | 2024-01-01 |
End Date (To) | Yes | Only include tweets posted on or before this date. | 2024-10-15 |
All of These Words | Optional | Tweets must contain all of the specified words. | wukong |
Exact Phrase | Optional | Tweets must contain this exact word or phrase. | AI agent |
Any of These Words | Optional | Tweets may contain any of these words. | agent, bot |
Exclude These Words | Optional | Tweets must not contain these words. | crypto |
Hashtags | Optional | Filter tweets by hashtags. | #Deepseek |
From These Accounts | Optional | Only include tweets posted by these accounts. | @octoparse |
To These Accounts | Optional | Only include tweets sent to or replying to these accounts. | @elonmusk |
Mentioning These Accounts | Optional | Only include tweets that mention these accounts. | @OctoparseAI |
Minimum Replies | Optional | Only include tweets with at least this number of replies. | 10 |
Minimum Likes | Optional | Only include tweets with at least this number of likes. | 50 |
Minimum Reposts | Optional | Only include tweets with at least this number of reposts. | 5 |
Language | Optional | Filter by one language code at a time. Use any for no filter. | en |
Max Tweets to Extract | Optional | Set the maximum number of tweets to scrape. | 5000 |
Include “Latest” Results | Optional | Include results from the Latest tab in addition to Top results. | Yes |
3. Run the scraper
- Click "Start" and select a run mode. (Greyed-out modes are not supported for this template.)
- Octoparse will automatically browse Twitter, load search results, scroll pages, and extract all matching products.
4. Monitor & Handle Interruptions
- Scraping duration may vary based on the number of products returned for your search.
- If a CAPTCHA appears, pause the task, solve it manually, then resume the run.
5. Export your data
- Once scraping completes, go to the "Data Preview" or output section to review.
- Export the results - e.g. as CSV or Excel - for further analysis, filtering, or storage.