Open Source Tech Lab - Project [SEMESTER IV]
OSTL Assignments
COVID19 India Data Scraping and Visualisation using Matplotlib and BeautifulSoup in Python3.
I used PrettyTable and BS4 to scrape/scale the data and visualize it using Bar Plots and Donut Charts.
Data sourced from Ministry Of Health and Family Welfare, India.
This repo contains the source code for crawler and crawled data of cars specifications from autodata. The data has roughly 45k cars
poolbooru_gelscraper a simple python script for scraping images off gelbooru pools. modules required:requests_html, and os by default saves files with
Deals of the Day This is a web scraper, using the Python framework Scrapy, built to extract data such as price and product name from the Deals of the
Web crawling framework for everyone. Written with asyncio, uvloop and aiohttp. Requirements Python3.5+ Installation pip install gain pip install uvloo
Amazon-Web-Scarper Created a web scraper using simple functions to check price of a product on amazon (can be duplicated to check price at other marke
Works very well and you can ask for the type of image you want the scrapper to collect. Also follows a specific urls path depending on keyword selection.
Cola: high-level distributed crawling framework Overview Cola is a high-level distributed crawling framework, used to crawl pages and extract structur
12306抢票脚本
Amazon-web-scraping-using-Scrapy-Framework Scrapy Scrapy is an application framework for crawling web sites and extracting structured data which can b
Sportyfin Description Stream sports events straight from your Jellyfin server. Sportyfin allows users to scrape for live streamed events and watch str
fetch_comments A simple code to fetch comments below an Instagram post and save them to a csv file usage First you have to enter your username and pas
NewsScraping Esse é um projeto de raspagem das últimas noticias, de 2021, do portal da universidade Ucsal http://noosfero.ucsal.br/institucional Tecno
JDRouterPush 项目简介 本项目调用京东云无线宝API,可每天定时推送积分收益情况,帮助你更好的观察主要信息 更新日志 2021-03-02: 查询绑定的京东账户 通知排版优化 脚本检测更新 支持Server酱Turbo版 2021-02-25: 实现多设备查询 查询今
Provider API Scraper Example Example of scraping a paginated API endpoint and dumping the data into a DB. Pre-requisits Python = 3.9 Pipenv Setup # i
Audio media crawler for lbry. Requirements Python 3.8 Poetry 1.1.7 Elasticsearch 7.14.0 Lbry-sdk 0.99.0 Development This project uses poetry as a depe
Agroforestry Species Switchboard 2.0 Scraper Scrape plants scientific name information from Species Switchboard 2.0. Requirements python = 3.10 (you
Scrapy Overview Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pag
Extract Facebook group posts that are related to a specific topic and write them to a .json file.
Comment Webpage Screenshot is a GitHub Action that helps maintainers visually review HTML file changes introduced on a Pull Request by adding comments with the screenshots of the latest HTML file cha
Web-Scraping-COVID-19-Meta-Portal-with-Python - Requests API and Beautiful Soup to scrape real-time COVID statistics from worldometer website and perform data cleaning and visual analysis in Jupyter
5 Nov 22, 2022
1 Jan 02, 2022
1 Jan 12, 2022
2k Jan 05, 2023
1 Jan 17, 2022
1 Feb 17, 2022
1.5k Dec 24, 2022
457 Jan 05, 2023
1 Jan 25, 2022
38 Nov 05, 2022
2 Jul 14, 2022
0 Sep 30, 2021
199 Dec 12, 2022
1 Oct 20, 2021
4 Dec 03, 2022
2 Dec 23, 2021
45.5k Jan 07, 2023
14 Aug 12, 2022
21 Sep 29, 2022
1 Jan 04, 2022