A simple proxy scraper that utilizes the requests module in python.
Depending on your python installation your commands may vary. Below are the commands you should run before execution. The script was tested in python 3.8.6, using windows.
git clone https://github.com/qizqq/Proxy-Scraper.git
cd Proxy-Scraper
pip install requests
pip install colorama
py main.py
cracking4crawling 一些爬虫相关的签名、验证码破解，目前已有脚本： 小红书App接口签名（shield）（2020.12.02） 小红书滑块（数美）验证破解（2020.12.02） 海南航空App接口签名（hnairSign）（2020.12.05） 说明： 脚本按目标网站、App命
Web crawling framework for everyone. Written with asyncio, uvloop and aiohttp. Requirements Python3.5+ Installation pip install gain pip install uvloo
UsernameScraperTool Username Scraper for 40+ Social sites. How To use git clone
Open Crawl Vietnamese Text This repo contains crawled Vietnamese text from multiple sources. This list of a topic-centric public data sources in high
demiurge PyQuery-based scraping micro-framework. Supports Python 2.x and 3.x. Documentation: http://demiurge.readthedocs.org Installing demiurge $ pip
Data Scraping for Glassdoor This is python to scrape overview and reviews of companies from Glassdoor. Please use it carefully and follow the Terms of
Introduction A dead simple crawler to get books information from Douban. Pre-requesites Python 3 Install dependencies from requirements.txt (Optional)
PyMDL An API for MyDramaList(MDL) based on webscraping for python. Description An API for MDL to make your life easier in retriving and working on dat
Web-Scrapping-1 An application that on a given url, crowls a web page and gets all words, sorts and counts them. Installation Using the package manage
NewsScraper A simple Python 3 module to get crypto or news articles and their content from various RSS feeds. 🔧 Installation Clone the repo locally.
Scrapper-en-python Scrapper des données signifie récuperer des données pour les traiter ou les analyser. En python, il y'a 2 grands moyens de scrapper
Ace Attorney reddit bot 👨🏼⚖️ Reddit bot that turns comment chains into ace attorney scenes. You'll need to sign up for streamable and reddit and se
Ebay-Webscraper-for-Getting-Average-Product-Price The code in this repo is used to determine the average price of an item on Ebay given a valid search
Extract Facebook group posts that are related to a specific topic and write them to a .json file.
Twitter-Scraping-App A simple app to scrap data from Twitter. Available Features Search query. Select number of data you want to fetch from twitter. C
trafilatura: Web scraping tool for text discovery and retrieval Description Trafilatura is a Python package and command-line tool which seamlessly dow
release-notes-scraper This simple script can be used to grab the release notes for projects from github that do not keep a CHANGELOG, but publish thei
Python-Goose - Article Extractor Intro Goose was originally an article extractor written in Java that has most recently (Aug2011) been converted to a
Stealthy Scraping Tools Do not use puppeteer and playwright for scraping. Explanation. We only use the CDP to obtain the page source and to get the ab
Phone Crawler: Phone Crawler with multi-thread functionality Disclaimer: I'm not responsible for any illegal/misuse actions, this program was made for
90 Feb 09, 2021
2k Jan 05, 2023
1 Dec 20, 2022
4 Jan 05, 2022
109 Jul 20, 2022
5 Jun 23, 2022
1 Jan 10, 2022
6 Dec 10, 2022
1 Jan 16, 2022
3 Jan 02, 2022
1 Dec 05, 2021
763 Nov 17, 2022
17 Jan 05, 2023
14 Aug 12, 2022
2 Oct 31, 2022
704 Jan 06, 2023
4 Apr 01, 2022
3.8k Jan 02, 2023
88 Jan 04, 2023
3 Feb 10, 2022