We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
Related Projects
house-renting - Possibly the best practice of Scrapy and renting a house (可能是 Scrapy 和租房的最佳实践)
Possibly the best practice of Scrapy and renting a house (可能是 Scrapy 和租房的最佳实践)
scrapy scrapy-crawler scrapy-spider docker scrapydscrapy-redis - Redis-based components for Scrapy.
Redis-based components for Scrapy. You can start multiple spider instances that share a single redis queue. Best suitable for broad multi-domain crawls.
scrapy crawler distributed redisScrapy - Web crawling & scraping framework for Python
Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
crawler web-crawler scraping text-extraction spiderhaipproxy - :sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
high-availability scrapy ipproxy distributed redis crawler scheduler spiderants-go - open source, distributed, restful crawler engine in golang
I wrote a crawler engine named ants in python base on scrapy. But sometimes, dynamic language is chaos. So I start to write it in a compile language.
wechat - API, command and message handling for WeChat in Rails
Wechat is a free messaging and calling app developed by Tencent, after linking billion people, Wechat had become an application platform. WeChat gem tries to help Rails developer to integrate enterprise account / public account easily. Features below are ready and there is no need to write adapter code for talking to wechat server directly.
wechat-sdk wechat-oauth wechat-frameworkWeChatTweak-macOS - A dynamic library tweak for WeChat macOS - 首款微信 macOS 客户端撤回拦截与多开
A dynamic library tweak for WeChat macOS. For more informations, please go to the Wiki.
wechat revoke tweak dylib multiple-instance no-revoke norevoke message alfred wechattweak-macos wechat-macos wechat-plugin wechat-plugin-macos weixin weixin-tweak weixin-plugin wechat-tweak wechat-launchbarscrapyrt - Scrapy realtime
HTTP server which provides API for scheduling Scrapy spiders and making requests with spiders. Allows you to easily add HTTP API to your existing Scrapy project. All Scrapy project components (e.g. middleware, pipelines, extensions) are supported out of the box. You simply run Scrapyrt in Scrapy project directory and it starts HTTP server allowing you to schedule your spiders and get spider output in JSON format.
paxosstore - PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend
PaxosStore is a distributed-database initially inspired by Google MegaStore. It's the second generation of storage system developed to support current WeChat sevice and applications. PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend including user account management, user relationship management (i.e., contacts), instant messaging, social networking (i.e., Moments), and online payment (i.e., WeChat Pay). Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.
paxos database distributed-database consensusweui - A UI library by WeChat official design team, includes the most useful widgets/modules in mobile web applications
WeUI is an WeChat-like UI framework officially designed by the WeChat Design Team, tailor-made for WeChat Web development, in order to improve and standardize the experience for WeChat users. Including components such as button、cell、dialog、 progress、 toast、article、actionsheet、icon. Please feel free to use and contribute to the development.
weui wechat mobile-web style weixin css less mobilelaravel-wechat - 微信 SDK for Laravel, 基于 overtrue/wechat
微信 SDK for Laravel, 基于 overtrue/wechat
wechat wechat-sdk laravel-wechatscrapy-proxies - Random proxy middleware for Scrapy
Processes Scrapy requests using a random proxy from list to avoid IP ban and improve crawling speed. For older versions of Scrapy (before 1.0.0) you have to use scrapy.contrib.downloadermiddleware.retry.RetryMiddleware and scrapy.contrib.downloadermiddleware.httpproxy.HttpProxyMiddleware middlewares instead.
platformio
.. image:: https://travis-ci.org/platformio/platformio.svg?branch=develop :target: https://travis-ci.org/platformio/platformio :alt: Travis.CI Build Status .. image:: https://ci.appveyor.com/api/projects/status/dku0h2rutfj0ctls/branch/develop?svg=true :target: https://ci.appveyor.com/project/ivankravets/platformio :alt: AppVeyor.CI Build Status .. image:: https://circleci.com/gh/platformio/platformio/tree/develop.svg?style=svg :target: https://circleci.com/gh/platformio/platformio/tree/develop :
wechat-dump - Dump wechat messages from android
WeChat(微信), as the most popular mobile IM app in China, doesn't give users any method to export well-formatted history message. This tool can parse and export WeChat messages on a rooted android phone. Right now it can dump messages in text-only mode, or generate a single-file html containing voice messages, images, emoji, etc.
wechat androidwechat - WeChat SDK for Go （微信SDK：简单、易用）
WeChat SDK for Go （微信SDK：简单、易用）
wechat wechat-sdk sdk js-sdkwechat-admin - Wechat Management System
wechat vue admin project
wechat vue wxpy itchat wechat-admin flask celery sse walrus mkdocs bot tuling chatterbot python3electronic-wechat - :speech_balloon: A better WeChat on macOS and Linux
A better WeChat on macOS and Linux. Built with Electron. Important: If you want to build the app by yourself rather than download the release directly, please consider to use the source code from the production branch, the master branch is under development and we cannot guarantee it to be stable.
wechat web-wechat electron 微信 web
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.
