OSTA web scraper, for checking the status of school buses in Ottawa

Overview

OSTA-La-Vista

OSTA web scraper, for checking the status of school buses in Ottawa.

Getting Started

  1. Using a Raspberry Pi, download Python 3, and optionally, your IDE of preference.
  2. From this repository, download OSTA_La_Vista.py for the most up-to-date version of the program. temp_alarm_sound.mp3 is also needed for the alarm sound
  3. Ensure you have the required external libraries downloaded using pip3 install from the terminal. Namely, you'll need:
    • requests
    • bs4
    • gtts
    • RPi.GPIO
    • smtplib
    • tkinter
    • mpg321 (command line audio file player)
  4. Hook up green, yellow, and red LEDs to GPIO ports 18, 19, and 20, respectively.
  5. Run the Python file, and things should work as planned.
    • Recommended: see the following explanation slideshow to understand exactly what this program is capable of!

Important Note: You may think that the email password in the .py file will give you access to my entire Google account. This is an incorrect assumption:

  • This password is what's known as an "App Password", that can only be used for the sole purpose of sending emails via a script.
  • 2-Factor Authentication has been set up for this account.
  • This account is worthless anyways; it has only been set up to work as a "bus bot" emailing system.

Licence

This project is free and open-source, so long that it is not used for commercial purposes (CC BY-NC 4.0).

SOFTWARE IS PROVIDED “AS-IS”, WITHOUT A WARRANTY OF ANY KIND.

About

This project was only made as part of my high school CS class; it is by no means a comprehensive program, nor was it intended to be. If you experience issues, that's expected. This program is not yet bullet-proof!

Support

Should you run into any issues while using this program, please feel free to start an "Issues Thread" or contact me. I'm always happy to help, but you probably know more than I do :)

Features Coming in v2.0

This program is just the very beginning. I still have lots of ideas for how I want to expand this project, inlcuded, but not limited to, the following:

  • Extra support for Windows PCs
  • An enhanced alarm scheduling system
  • Added error-trapping
  • SMS alerts, in addition to emails already
  • A dedicated user support email

See my explanation slideshow for more in-depth ideas for the future.

Facebook Group Scraping Using Beautiful Soup & Selenium

Extract Facebook group posts that are related to a specific topic and write them to a .json file.

Fatima Ghadieh 14 Aug 12, 2022
A simple proxy scraper that utilizes the requests module in python.

Proxy Scraper A simple proxy scraper that utilizes the requests module in python. Usage Depending on your python installation your commands may vary.

3 Sep 08, 2021
Find thumbnails and original images from URL or HTML file.

Haul Find thumbnails and original images from URL or HTML file. Demo Hauler on Heroku Installation on Ubuntu $ sudo apt-get install build-essential py

Vinta Chen 150 Oct 15, 2022
Google Maps crawler using Selenium

Google Maps Crawler using Selenium Built as part of the Antifragile Dev Project Selenium crawler that browses Google Maps as a regular user and stores

Guilherme Latrova 46 Dec 16, 2022
A social networking service scraper in Python

snscrape snscrape is a scraper for social networking services (SNS). It scrapes things like user profiles, hashtags, or searches and returns the disco

2.4k Jan 01, 2023
A simple code to fetch comments below an Instagram post and save them to a csv file

fetch_comments A simple code to fetch comments below an Instagram post and save them to a csv file usage First you have to enter your username and pas

2 Jul 14, 2022
News, full-text, and article metadata extraction in Python 3. Advanced docs:

Newspaper3k: Article scraping & curation Inspired by requests for its simplicity and powered by lxml for its speed: "Newspaper is an amazing python li

Lucas Ou-Yang 12.3k Jan 07, 2023
Luis M. Capdevielle 1 Jan 14, 2022
A high-level distributed crawling framework.

Cola: high-level distributed crawling framework Overview Cola is a high-level distributed crawling framework, used to crawl pages and extract structur

Xuye (Chris) Qin 1.5k Jan 04, 2023
Web scraper for Zillow

Zillow-Scraper Instructions All terminal commands are highlighted. Make sure you first have python 3 installed. You can check this by running "python

Ali Rastegar 1 Nov 23, 2021
Amazon scraper using scrapy, a python framework for crawling websites.

#Amazon-web-scraper This is a python program, which use scrapy python framework to crawl all pages of the product and scrap products data. This progra

Akash Das 1 Dec 26, 2021
Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

Parsel Parsel is a BSD-licensed Python library to extract and remove data from HTML and XML using XPath and CSS selectors, optionally combined with re

Scrapy project 859 Dec 29, 2022
A web scraper that exports your entire WhatsApp chat history.

WhatSoup 🍲 A web scraper that exports your entire WhatsApp chat history. Table of Contents Overview Demo Prerequisites Instructions Frequen

Eddy Harrington 87 Jan 06, 2023
API which uses discord to scrape NameMC searches/droptime/dropping status of minecraft names

NameMC Scrape API This is an api to scrape NameMC using message previews generated by discord. NameMC makes it a pain to scrape their website, but som

Twilak 2 Dec 22, 2021
Scrape puzzle scrambles from csTimer.net

Scroodle Selenium script to scrape scrambles from csTimer.net csTimer runs locally in your browser, so this doesn't strain the servers any more than i

Jason Nguyen 1 Oct 29, 2021
Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX)

mcc-mnc.com-webscraper Scrapes mcc-mnc.com and outputs 3 files with the data (JSON, CSV & XLSX) A Python script for web scraping mcc-mnc.com Link: mcc

Anton Ivarsson 1 Nov 07, 2021
A multithreaded tool for searching and downloading images from popular search engines. It is straightforward to set up and run!

🕳️ CygnusX1 Code by Trong-Dat Ngo. Overviews 🕳️ CygnusX1 is a multithreaded tool 🛠️ , used to search and download images from popular search engine

DatNgo 32 Dec 31, 2022
A Web Scraping Program.

Web Scraping AUTHOR: Saurabh G. MTech Information Security, IIT Jammu. If you find this repository useful. I would appreciate if you Star it and Fork

Saurabh G. 2 Dec 14, 2022
script to scrape direct download links (ddls) from google drive index.

bhadoo Google Personal/Shared Drive Index scraper. A small script to scrape direct download links (ddls) of downloadable files from bhadoo google driv

sαɴᴊɪᴛ sɪɴʜα 53 Dec 16, 2022
Automated Linkedin bot that will improve your visibility and increase your network.

LinkedinSpider LinkedinSpider is a small project using browser automating to increase your visibility and network of connections on Linkedin. DISCLAIM

Frederik 2 Nov 26, 2021