a database scraper created with mechanical soup and sqlite
author: Mariya Sha
This repository was created to support a YouTube tutorial:
https://youtu.be/MkGQmZoMuRM
scraper.py
is designed to webscrape a table from Wikipedia and store it in an SQlite database.
selector.py
is designed to test wether our database from scraper.py was properly created.
Scrapping Connections' info on Linkedin
ISEF Database This is a simple web scraper which gets all of the projects and abstract information from here. My goal for this is for someone to get i
SkyScrapers Collection of variety of Web Scraping Apps The web-scrapers involved
Web Scrapping Popular Youtube Tech Channels with Selenium Data Mining, Data Wrangling, and Exploratory Data Analysis About the Data Web scrapi
Movies-Scraper You are probably tired of navigating through a movie website to get the right movie you'd want to watch during the weekend. There may e
NameMC Scrape API This is an api to scrape NameMC using message previews generated by discord. NameMC makes it a pain to scrape their website, but som
Apicell You can use this api to search in google, bing, pypi and subscene and get results Method : POST Parameter : query Example import request url =
Pulls Binance Smart Chain feed of newly-verified contracts every 30 seconds, then checks their contract code for links to socials.Returns only those with socials information included, and then submit
Scrapely Scrapely is a library for extracting structured data from HTML pages. Given some example web pages and the data to be extracted, scrapely con
Pattern Pattern is a web mining module for Python. It has tools for: Data Mining: web services (Google, Twitter, Wikipedia), web crawler, HTML DOM par
Web crawling framework for everyone. Written with asyncio, uvloop and aiohttp. Requirements Python3.5+ Installation pip install gain pip install uvloo
Google Developer Profile Badge Scraper It is a Google Developer Profile Web Scraper which scrapes for specific badges in a user's Google Developer Pro
Google Developer Profile Badge Scraper GDev Profile Badge Scraper is a Google Developer Profile Web Scraper which scrapes for specific badges in a use
release-notes-scraper This simple script can be used to grab the release notes for projects from github that do not keep a CHANGELOG, but publish thei
A Python Covid-19 cases tracker that scrapes data off the web and presents the number of Cases, Recovered Cases, and Deaths that occurred because of the pandemic.
Toxicity comments crawler Crawler job that scrapes comments from social media posts and saves them in a S3 bucket. Twitter Tweets and replies are scra
LinkedinSpider LinkedinSpider is a small project using browser automating to increase your visibility and network of connections on Linkedin. DISCLAIM
Here I provide the source code for doing web scraping using the python library, it is Selenium.
WebScrapeGrades About The Project This Project is a personal project where I learned how to webscrape using python requests. Being able to get request
poolbooru_gelscraper a simple python script for scraping images off gelbooru pools. modules required:requests_html, and os by default saves files with
1 Feb 11, 2022
1 Mar 18, 2022
3 Feb 17, 2022
0 Aug 18, 2021
1 Jan 31, 2022
2 Dec 22, 2021
1 Dec 19, 2021
14 Dec 09, 2022
1.8k Dec 31, 2022
8.4k Jan 08, 2023
2k Jan 05, 2023
2 Feb 22, 2022
7 Jan 10, 2022
4 Apr 01, 2022
1 Nov 13, 2021
2 Jan 24, 2022
2 Nov 26, 2021
1 Nov 13, 2021
1 Oct 23, 2021
1 Jan 02, 2022