fc

facebook-crawler

Showing:

Popularity

Downloads/wk

0

GitHub Stars

115

Maintenance

Last Commit

3mos ago

Contributors

1

Package

Dependencies

5

License

Categories

Readme

Facebook_Crawler

Downloads Downloads Downloads

  • The project is developed by TENG-LIN YU(游騰林).
  • Any suggestions are good and feel free to contact me.

Support

ecgo.png

Donate is not required to utilize this package, but it would be great to get your support. Either donate, star, or share are good for me. Your support will keep me in maintaining and develop more functions in this project.

贊助不是使用這個套件的必要條件,但如能獲得你的支持我將會非常感謝。不論是贊助、給予星星或跟朋友分享對我來說都是非常好的支持方式。有你的支持我才能繼續在這個專案中維護和開發新的功能。

What's this?

The project can help us collect the data from Facebook's public Fanspage / group. Here are the three big points of this project:

  1. You don't need to log in to your account.
  2. Easy: Just key in the Fanspage/group URL and the target date(to break the while loop).
  3. Efficient: It collects the data through the requests package directly instead of Selenium.

這個專案可以幫我們從 Facebook 公開的的粉絲頁和公開社團收集資料。以下是本專案的 3 個重點:

  1. 不需登入: 不需要帳號密碼因此也不用擔心被鎖定帳號
  2. 簡單: 僅需要粉絲頁/社團的網址和停止的日期(用來跳脫迴圈)
  3. 高效: 透過 request 直接向伺服器請求資料,不需通過 Selenium

Quickstart

  • Install

    pip install -U facebook-crawler
    
  • Usage

    • Facebook Fanspage
      import facebook_crawler
      pageurl= 'https://www.facebook.com/diudiu333'
      facebook_crawler.Crawl_PagePosts(pageurl=pageurl, until_date='2021-01-01')
      
      quickstart_fanspage.png
    • Group
      import facebook_crawler
      groupurl = 'https://www.facebook.com/groups/pythontw'
      facebook_crawler.Crawl_GroupPosts(groupurl, until_date='2021-01-01')
      
      quickstart_group.png

FAQ

  • Could you please release the function that can collect comments content instead of only the number of comments?

    Indeed, the comments and replies content are precious data on social media. But I wouldn't prefer to release this function due to Security. It would be horrible if someone does terrible things through this function. So, if someone needs the comments and replies content, he/she can write me an email and tell me the project purpose, and I will think about it case by case.

  • How can I find out the post's link through the data?

    You can add the string 'https://www.facebook.com' in front of the POSTID, and it's just its post link. So, for example, if the POSTID is 123456789, and its link is 'https://www.facebook.com/12345679'.

  • Can I directly collect the data in the specific time period?

    Nope! It's related to Facebook's website framework. You need to collect the data from the newest post to the older post.

License

  • Apache License 2.0
  • 本專案提供的所有內容均用於教育、非商業用途。本專案不對資料內容錯誤、更新延誤或傳輸中斷負任何責任。

Contact Info

To Do

  • GUI interface
  • Database

Rate & Review

Great Documentation0
Easy to Use0
Performant0
Highly Customizable0
Bleeding Edge0
Responsive Maintainers0
Poor Documentation0
Hard to Use0
Slow0
Buggy0
Abandoned0
Unwelcoming Community0
100
No reviews found
Be the first to rate

Alternatives

No alternatives found

Tutorials

No tutorials found
Add a tutorial