Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

no post_url, skipping #115

Open
saqtam66 opened this issue Jun 1, 2024 · 9 comments
Open

no post_url, skipping #115

saqtam66 opened this issue Jun 1, 2024 · 9 comments

Comments

@saqtam66
Copy link

saqtam66 commented Jun 1, 2024

Hello
When running the scarper: i got the following error "no post_url, skipping" repeatdly,
no post scraped
I am using "firefox" browser.
Is there a solution?

@moda20
Copy link

moda20 commented Jun 5, 2024

@saqtam66 It seems this repo doesn't find post urls anymore, facebook changed their website

@shaikhsajid1111
Copy link
Owner

@moda20 that's right. Facebook has had drastic changes in its UI. I'm trying to figure out if there's currently a way

@moda20
Copy link

moda20 commented Jun 7, 2024

@shaikhsajid1111 I created a fork that can parse the url and postTime and other identifiers :
https://github.com/moda20/facebook_page_scraper

@shaikhsajid1111
Copy link
Owner

@moda20 I see crawler hovering over dates but still in result it is not available. Also, post Ids

@shaikhsajid1111
Copy link
Owner

Well, I have found a way. Probably be pushing totally a new way under a major release

@Reeyomma
Copy link

When will the next release be? Having this same issue.
new layout loaded
all_posts length: 4
no post_url, skipping
no post_url, skipping
no post_url, skipping
no post_url, skipping
all_posts length: 4
all_posts length: 7
no post_url, skipping

@moda20
Copy link

moda20 commented Jun 27, 2024

@Reeyomma try my fork, https://github.com/moda20/facebook_page_scraper, it's drop in replacement.
it works for me for now,

@shaikhsajid1111
Copy link
Owner

shaikhsajid1111 commented Jul 14, 2024

I found a way through Facebook's GraphQL but haven't had enough time to spend on writing the parser for it

@shaikhsajid1111
Copy link
Owner

Here's the response (Attached File). I'm trying to understand if it can resolve the issue.
graphql_response.json

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants