Possibly the best practice of Scrapy and renting a house (可能是 Scrapy 和租房的最佳实践)
scrapy scrapy-crawler scrapy-spider docker scrapydRedis-based components for Scrapy. You can start multiple spider instances that share a single redis queue. Best suitable for broad multi-domain crawls.
scrapy crawler distributed redisScrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
crawler web-crawler scraping text-extraction spider:sparkling_heart: High available distributed ip proxy pool, powerd by Scrapy and Redis
high-availability scrapy ipproxy distributed redis crawler scheduler spiderI wrote a crawler engine named ants in python base on scrapy. But sometimes, dynamic language is chaos. So I start to write it in a compile language.
Wechat is a free messaging and calling app developed by Tencent, after linking billion people, Wechat had become an application platform. WeChat gem tries to help Rails developer to integrate enterprise account / public account easily. Features below are ready and there is no need to write adapter code for talking to wechat server directly.
wechat-sdk wechat-oauth wechat-frameworkA dynamic library tweak for WeChat macOS. For more informations, please go to the Wiki.
wechat revoke tweak dylib multiple-instance no-revoke norevoke message alfred wechattweak-macos wechat-macos wechat-plugin wechat-plugin-macos weixin weixin-tweak weixin-plugin wechat-tweak wechat-launchbarHTTP server which provides API for scheduling Scrapy spiders and making requests with spiders. Allows you to easily add HTTP API to your existing Scrapy project. All Scrapy project components (e.g. middleware, pipelines, extensions) are supported out of the box. You simply run Scrapyrt in Scrapy project directory and it starts HTTP server allowing you to schedule your spiders and get spider output in JSON format.
PaxosStore is a distributed-database initially inspired by Google MegaStore. It's the second generation of storage system developed to support current WeChat sevice and applications. PaxosStore has been deployed in WeChat production for more than two years, providing storage services for the core businesses of WeChat backend including user account management, user relationship management (i.e., contacts), instant messaging, social networking (i.e., Moments), and online payment (i.e., WeChat Pay). Now PaxosStore is running on thousands of machines, and is able to afford billions of peak TPS.
paxos database distributed-database consensusWeUI is an WeChat-like UI framework officially designed by the WeChat Design Team, tailor-made for WeChat Web development, in order to improve and standardize the experience for WeChat users. Including components such as button、cell、dialog、 progress、 toast、article、actionsheet、icon. Please feel free to use and contribute to the development.
weui wechat mobile-web style weixin css less mobile微信 SDK for Laravel, 基于 overtrue/wechat
wechat wechat-sdk laravel-wechatProcesses Scrapy requests using a random proxy from list to avoid IP ban and improve crawling speed. For older versions of Scrapy (before 1.0.0) you have to use scrapy.contrib.downloadermiddleware.retry.RetryMiddleware and scrapy.contrib.downloadermiddleware.httpproxy.HttpProxyMiddleware middlewares instead.
.. image:: https://travis-ci.org/platformio/platformio.svg?branch=develop :target: https://travis-ci.org/platformio/platformio :alt: Travis.CI Build Status .. image:: https://ci.appveyor.com/api/projects/status/dku0h2rutfj0ctls/branch/develop?svg=true :target: https://ci.appveyor.com/project/ivankravets/platformio :alt: AppVeyor.CI Build Status .. image:: https://circleci.com/gh/platformio/platformio/tree/develop.svg?style=svg :target: https://circleci.com/gh/platformio/platformio/tree/develop :
WeChat(微信), as the most popular mobile IM app in China, doesn't give users any method to export well-formatted history message. This tool can parse and export WeChat messages on a rooted android phone. Right now it can dump messages in text-only mode, or generate a single-file html containing voice messages, images, emoji, etc.
wechat androidWeChat SDK for Go (微信SDK:简单、易用)
wechat wechat-sdk sdk js-sdkwechat vue admin project
wechat vue wxpy itchat wechat-admin flask celery sse walrus mkdocs bot tuling chatterbot python3A better WeChat on macOS and Linux. Built with Electron. Important: If you want to build the app by yourself rather than download the release directly, please consider to use the source code from the production branch, the master branch is under development and we cannot guarantee it to be stable.
wechat web-wechat electron 微信 web
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.