Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retweets cut off even while using extended tweet mode #329

Closed
harshbhatt opened this issue May 20, 2020 · 4 comments
Closed

Retweets cut off even while using extended tweet mode #329

harshbhatt opened this issue May 20, 2020 · 4 comments

Comments

@harshbhatt
Copy link

harshbhatt commented May 20, 2020

Mainly want to know if I'm doing something wrong if this is expected behavior. Any retweet appears to be cut off with ... at the end. However, on the person's timeline the full (re)tweet appears. Is there any way to extract it?

I've attached a sample generated CSV file, and here is the command I used:
twarc --app_auth --format csv --tweet_mode extended --output w01_2020-01-26_TEST.csv

w01_2020-01-26_TEST.csv.zip

@edsu
Copy link
Member

edsu commented May 25, 2020

@harshbhatt thanks for reporting this. Can you include the actual command you used? The one you supplied is not complete.

@edsu edsu closed this as completed in 2cff2c2 May 26, 2020
@edsu
Copy link
Member

edsu commented May 26, 2020

@harshbhatt thanks again for reporting this. After reviewing the Twitter documentation about Extended Tweets it appears our logic for extracting the text of the tweet was not correct because it wasn't getting the text from the enclosed tweet:

Again, when parsing Retweets, it is key to parse the "retweeted_status" object for complete (original) Tweet message and entity metadata.

This has been updated in v1.8.4 which was just released. Could you upgrade and give it a try, and reopen this ticket if you continue to have questions?

pip install --upgrade twarc

@harshbhatt
Copy link
Author

Verified, works now. Thanks for this great tool and for closing out this issue!

@edsu
Copy link
Member

edsu commented May 26, 2020

Exellent, thanks @harshbhatt!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants