Webservice wrapper for hhursev/recipe-scrapers (python library to scrape recipes from websites)

Overview

recipe-scrapers-webservice

This is a wrapper for hhursev/recipe-scrapers which provides the api as a webservice, to be consumed as a microservice by other languages.

Usage

docker compose

version: "2.1"
services:
  recipe-scrapers-webservice:
    image: ghcr.io/steve192/recipe-scrapers-webservice
    container_name: recipe-scrapers-webservice
    ports:
      - 9090:9090
    restart: unless-stopped

docker cli

    docker run -d \
        --name=recipe-scrapers-webservice \
        -p 9090:9090 \
        --restart unless-stopped \
        ghcr.io/steve192/recipe-scrapers-webservice

Routes

/api/v1/scrape-recipe?url=
responds with

{
	"author": "AuthorHere",
	"category": "CategoryHere",
	"cook_time": "100",
	"cuisine": "French",
	"host": "recipehost.com",
	"imgage": "https://recipehost.com/image-for-recipe.jpg",
	"ingredients": ["10 g Ingredients1", "20g Ingredients2"],
	"instructions": "Instructions to the recipe\nSeparated by newlines",
	"language": "de",
	"links": [],
	"nutrients": {
		"calories": "631 kcal",
		"carbohydrateContent": "69 g",
		"fatContent": "26 g",
		"proteinContent": "14 g",
		"saturatedFatContent": "6 g",
		"servingSize": "504",
		"sodiumContent": "2 g",
		"sugarContent": "5 g"
	},
	"prep_time": "",
	"ratings": "",
	"title": "Title to a delicious recipe",
	"total_time": 30,
	"yields": "2 serving(s)"
}
Comments
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.25

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.25.0

    Adds support for:

    Thank you, @​brett @​NijeboerFrank!

    Commits
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.24

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.24.0

    Adds support for:

    • #679 - southerncastiron.com
    • #680 - handletheheat.com

    Fixes:

    • #661 - TypeError on mob.co.uk
    • #687 - Site updates for amazingribs.com

    Credits: @​brett @​jayaddison

    Commits
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • b95290c Add handletheheat.com (#680)
    • 3594e02 Add southerncastiron (#679)
    • d6e0fe7 pre-commit configuration: migrate source of flake8 from gitlab.com (no-longer...
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.17.0

    build(deps): bump alpine from 3.15 to 3.17.0

    Bumps alpine from 3.15 to 3.17.0.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): bump alpine from 3.15 to 3.16.3

    build(deps): bump alpine from 3.15 to 3.16.3

    Bumps alpine from 3.15 to 3.16.3.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.23

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.23.0

    Adds support for:

    • creativecanning.com
    • lecker.de
    • simply-cookit.com

    Removes support for:

    • sallys-blog.de

    Updates a bunch of preexisting scrapers with #676.

    Creds @​vabene1111 @​hhursev

    Commits
    • c954e1a Bump version to 14.23.0
    • 05d51d7 Address the lecker and simplycookit scrapers issues.
    • 9a798ee added simplycookit scraper (#618)
    • 2e58592 Fix lecker.de articles (#611)
    • fa31236 Reduce the amount of wording in the GitHub 'new issue' templates (#651)
    • fa61cf2 System health. Scrapers needed polishing (#676)
    • 1582886 Exclude macos and win py 3.11 from matrix again
    • 628b375 Use Python 3.11 in CI. Run macos and win w/ python 3.11 - don't mark whole jo...
    • 1d07ae9 Update README and bump version
    • 954c5c6 Issue 646/scraper weightwatchers (#657)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.21

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.21.0

    Housekeeping / development / maintenance release :broom:

    • Introduce tox as a standard mechanism to run isolated unit tests and linting workflows (#650)
    • Introduce pyproject.toml for project metadata (#655)
    • Remove the test_settings_module (#663)
    • Remove pytest and unittest-parallel development-time dependencies (#659, #660, 991b1d1784711bf1276ab74763e4e11c46649ee1)
    • Switch unit test scraper setup from per-test-method to per-test-case (#668)
    • Refactor the SchemaOrg parser (#671)
    • Fixup: incorrect start-URL in scraper test (b5f84adc0cfd2da2d645e43a321b39c7da10d4e8)

    This release should have little-to-no effect on usage of the library (it's intended to be backwards compatible) - however, bug / issue reports appreciated, as always!

    Commits
    • e23154a Bump version to 14.21.0
    • e7f7a90 Refactor: schema.org parser (#671)
    • 743d7cd Revert "Fixup: remove overwrite of schema.org data with 'mainEntity' contents...
    • aacd321 Modernization: introduce pyproject.toml for setuptools configuration (#655)
    • 2c3e0e8 Unit tests: move scraper construction from setUp (per-method) to setUpClass (...
    • b5f84ad Fixup: test-mode startURL for test_gousto
    • 557cfd9 Fixup: remove overwrite of schema.org data with 'mainEntity' contents during ...
    • d839b76 Cleanup: remove test_settings_module (#663)
    • 1526b32 Consolidate linting configuration (#662)
    • 991b1d1 Fixup / cleanup: remove unittest-parallel from tox.ini (related to f986c6ed6a...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.20

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.20.0

    • Remove META_HTTP_EQUIV setting (#644)
    • Remove TEST_MODE setting (#645)
    • Remove 'v12-like' settings module (#653)
    • Add omnivores cookbook (#647)
    • Add maangchi (#656)
    • Fix justonecookbook (#649)

    Thank you, @​wengtad!

    Commits
    • 93de8af Bump version to 14.20.0
    • 90a507a feat: add maangchi (#656)
    • df71ec3 fix: incomplete justonecookbook (#649)
    • cc913ac feat: add omnivores cookbook (#647)
    • 89a0a67 Cleanup: remove 'v12-like' settings module (#653)
    • 9321d9a Cleanup: remove TEST_MODE setting (#645)
    • cf7870f Cleanup: remove META_HTTP_EQUIV setting (#644)
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.19

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.19.0

    Fixes Recipe-scraper does not return the correct amount of ingredients for Hellofresh

    Commits
    • c250e06 Bump version to 14.19.0
    • 8553024 Continuous integration: re-enable coveralls test coverage upload (#637)
    • c074623 Ad-hoc solution for wrong ingredients amount in hellofresh when serving size ...
    • f0d45d0 Bump version to 14.18.0
    • b02a25a Bump version to 14.17.2
    • 6093969 import from dataclasses (#642)
    • 4326635 Add LeanAndGreenRecipes (#636)
    • e1bfb74 feat: add rosanna pansino (#639)
    • f55e235 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 860fb89 Bump version to 14.17.1
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.17

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.17.0

    This probably should've been 14.16.1 now that I think about it (bugfixes only, no new scrapers) - oops. We've not always adhered to that I suppose.

    • reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • Fixup to run unit tests on MacOS and Windows in GitHub Actions (#629)
    • mypy: ignore type union-attr errors in scraper modules, to deal with false positives from BeautifulSoup's find return type (e33181aef48f0aac6740edbf96055f2fec6c8eb2)

    Thanks @​vabene1111 for the reishunger improvements!

    Commits
    • a95d8ac Bump version to 14.17.0
    • 753c054 Refactor: remove use of 'while' loop (#634)
    • 5c033fb reishunger.de: bugfixes and add support for multi-method recipes (#616)
    • f5c5ec1 Maintenance: update bs4 string searches to use 'string' parameter instead of ...
    • 401070d Workaround: install lxml from binary wheel when unit tests run on MacOS (#629)
    • e33181a Ignore union-attr mypy errors in scraper modules
    • 39fa50b Use isodate library to attempt ISO 8601 duration parsing in get_minutes (#610)
    • 754a316 Fixup for OS selection in GitHub Actions unittests workflow (#628)
    • 7d1cfad Bump version to 14.16.0
    • c477678 Fix ingredients for simplyrecipes.com scraper (#623)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.16

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.16.0

    • Fix ingredients for simplyrecipes.com scraper (#623)
    • Simple Veganista scraper added (#626)

    Thanks, @​thomaspinder @​puradox!

    Commits

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.14

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.14.0

    Adds support for:

    • owen-han.com (#599)

    Includes fixes for:

    • greatbritishchefs - ingredients in subheadings (#598)
    • mobkitchen - domain name matching (#600)

    Thanks @​ptoczko @​ephemer4l!

    Commits
    • 3a3d2fd Bump version to 14.14.0
    • 3a57112 Added owen-han.com (#599)
    • a52e91e Add updated domain name for MobKitchen scraper (#600)
    • 9ecaec3 greatbritishchefs: handle case where ingredients are in subheaders (#598)
    • 348abb2 Bump version to 14.13.0. Food.com updates
    • a97807b removed unused imports in food.com scraper (#591)
    • 998a3ad Run tests against python 3.11 too and bump setup-python version (#586)
    • 4b5a51f Bump version to 14.12.0
    • 908c8f2 Add support for ica.se (#584)
    • 796a35a Add support for coop.se (#583)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 1
  • build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    build(deps): update recipe-scrapers requirement from ~=14.6 to ~=14.26

    Updates the requirements on recipe-scrapers to permit the latest version.

    Release notes

    Sourced from recipe-scrapers's releases.

    14.26.0

    Adds support for:

    • briceletbaklava.ch (#697)

    With credit to @​lacliq

    Commits
    • d673cae Bump version to 14.26.0
    • 472114b added briceletbaklava.ch (#697)
    • d882d1f GitHub Actions workflows: version-constrain 'tox' to less-than v4 (#702)
    • baf3403 Bump version to 14.25.0
    • 607ab04 Add Project Gezond scraper (Dutch Website) (#691)
    • 05a04a8 add sunset.com (#690)
    • 0967f5e Bump version to 14.24.0
    • f45155f Remove some outdated quirk/workaround handling code for schema.org data in mo...
    • e2bda68 Update amazingribs scraper (#688)
    • f278c94 tox: permit positional arguments when running 'unittest'-based unit tests (#686)
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
  • build(deps): bump alpine from 3.15 to 3.17

    build(deps): bump alpine from 3.15 to 3.17

    Bumps alpine from 3.15 to 3.17.

    Dependabot compatibility score

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies docker 
    opened by dependabot[bot] 0
  • build(deps): update flask requirement from ~=2.1 to ~=2.2

    build(deps): update flask requirement from ~=2.1 to ~=2.2

    Updates the requirements on flask to permit the latest version.

    Release notes

    Sourced from flask's releases.

    2.2.0

    This is a feature release, which includes new features and removes previously deprecated code. The 2.2.x branch is now the supported bug fix branch, the 2.1.x branch will become a tag marking the end of support for that branch. We encourage everyone to upgrade, and to use a tool such as pip-tools to pin all dependencies and control upgrades.

    Changelog

    Sourced from flask's changelog.

    Version 2.2.0

    Released 2022-08-01

    • Remove previously deprecated code. :pr:4337

      • Old names for some send_file parameters have been removed. download_name replaces attachment_filename, max_age replaces cache_timeout, and etag replaces add_etags. Additionally, path replaces filename in send_from_directory.
      • The RequestContext.g property returning AppContext.g is removed.
    • Update Werkzeug dependency to >= 2.2.

    • The app and request contexts are managed using Python context vars directly rather than Werkzeug's LocalStack. This should result in better performance and memory use. :pr:4682

      • Extension maintainers, be aware that _app_ctx_stack.top and _request_ctx_stack.top are deprecated. Store data on g instead using a unique prefix, like g._extension_name_attr.
    • The FLASK_ENV environment variable and app.env attribute are deprecated, removing the distinction between development and debug mode. Debug mode should be controlled directly using the --debug option or app.run(debug=True). :issue:4714

    • Some attributes that proxied config keys on app are deprecated: session_cookie_name, send_file_max_age_default, use_x_sendfile, propagate_exceptions, and templates_auto_reload. Use the relevant config keys instead. :issue:4716

    • Add new customization points to the Flask app object for many previously global behaviors.

      • flask.url_for will call app.url_for. :issue:4568
      • flask.abort will call app.aborter. Flask.aborter_class and Flask.make_aborter can be used to customize this aborter. :issue:4567
      • flask.redirect will call app.redirect. :issue:4569
      • flask.json is an instance of JSONProvider. A different provider can be set to use a different JSON library. flask.jsonify will call app.json.response, other functions in flask.json will call corresponding functions in app.json. :pr:4688
    • JSON configuration is moved to attributes on the default app.json provider. JSON_AS_ASCII, JSON_SORT_KEYS,

    ... (truncated)

    Commits
    • b17bb9e Merge pull request #4710 from pallets/release-2.2.0
    • 292c7e5 release version 2.2.0
    • f3bb9b2 Merge branch '2.1.x'
    • ac1bb97 Merge pull request #4721 from pallets/pre-commit-ci-update-config
    • cfd5783 Merge pull request #4722 from pallets/deprecate-config-attrs
    • bfdd371 deprecate config attributes
    • 6f9ef11 [pre-commit.ci] pre-commit autoupdate
    • 98ca00d Merge pull request #4720 from pallets/deprecate-env
    • 30427a2 remove FLASK_ENV from docs
    • ef95998 deprecate FLASK_ENV
    • Additional commits viewable in compare view

    Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


    Dependabot commands and options

    You can trigger Dependabot actions by commenting on this PR:

    • @dependabot rebase will rebase this PR
    • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
    • @dependabot merge will merge this PR after your CI passes on it
    • @dependabot squash and merge will squash and merge this PR after your CI passes on it
    • @dependabot cancel merge will cancel a previously requested merge and block automerging
    • @dependabot reopen will reopen this PR if it is closed
    • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
    • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
    • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    dependencies python 
    opened by dependabot[bot] 0
Releases(v1.6.0)
Telegram group scraper tool

Telegram Group Scrapper

Wahyusaputra 2 Jan 11, 2022
OSTA web scraper, for checking the status of school buses in Ottawa

OSTA-La-Vista OSTA web scraper, for checking the status of school buses in Ottawa. Getting Started Using a Raspberry Pi, download Python 3, and option

1 Jan 28, 2022
Automated data scraper for Thailand COVID-19 data

The Researcher COVID data Automated data scraper for Thailand COVID-19 data Accessing the Data 1st Dose Provincial Vaccination Data 2nd Dose Provincia

Porames Vatanaprasan 31 Apr 17, 2022
:arrow_double_down: Dumb downloader that scrapes the web

You-Get NOTICE: Read this if you are looking for the conventional "Issues" tab. You-Get is a tiny command-line utility to download media contents (vid

Mort Yao 46.4k Jan 03, 2023
A Python library for automating interaction with websites.

Home page https://mechanicalsoup.readthedocs.io/ Overview A Python library for automating interaction with websites. MechanicalSoup automatically stor

4.3k Jan 07, 2023
优化版本的京东茅台抢购神器

优化版本的京东茅台抢购神器

1.8k Mar 18, 2022
HappyScrapper - Google news web scrapper with python

HappyScrapper ~ Google news web scrapper INSTALLATION ♦ Clone the repository ♦ O

Jhon Aguiar 0 Nov 07, 2022
Auto Join: A GitHub action script to automatically invite everyone to the organization who star your repository.

Auto Invite To The Organization By Star A GitHub Action script to automatically invite everyone to your organization that stars your repository. What

Max Base 11 Dec 11, 2022
for those who dont want to pay $10/month for high school game footage with ads

nfhs-scraper Disclaimer: I am in no way responsible for what you choose to do with this script and guide. I do not endorse avoiding paywalls or any il

Conrad Crawford 5 Apr 12, 2022
A simple django-rest-framework api using web scraping

Apicell You can use this api to search in google, bing, pypi and subscene and get results Method : POST Parameter : query Example import request url =

Hesam N 1 Dec 19, 2021
Complete pipeline for crawling online newspaper article.

Complete pipeline for crawling online newspaper article. The articles are stored to MongoDB. The whole pipeline is dockerized, thus the user does not need to worry about dependencies. Additionally, d

newspipe 4 May 27, 2022
Web3 Pancakeswap Sniper bot written in python3

Pancakeswap_BSC_Sniper_Bot Web3 Pancakeswap Sniper bot written in python3, Please note the license conditions! The first Binance Smart Chain sniper bo

Treading-Tigers 295 Dec 31, 2022
Python based Web Scraper which can discover javascript files and parse them for juicy information (API keys, IP's, Hidden Paths etc)

Python based Web Scraper which can discover javascript files and parse them for juicy information (API keys, IP's, Hidden Paths etc).

Amit 6 Aug 26, 2022
Using Python and Pushshift.io to Track stocks on the WallStreetBets subreddit

wallstreetbets-tracker Using Python and Pushshift.io to Track stocks on the WallStreetBets subreddit.

91 Dec 08, 2022
A web Scraper for CSrankings.com that scrapes University and Faculty list for a particular country

A look into what we're building Demo.mp4 Prerequisites Python 3 Node v16+ Steps to run Create a virtual environment. Activate the virtual environment.

2 Jun 06, 2022
Open Crawl Vietnamese Text

Open Crawl Vietnamese Text This repo contains crawled Vietnamese text from multiple sources. This list of a topic-centric public data sources in high

QAI Research 4 Jan 05, 2022
A web scraper which checks price of a product regularly and sends price alerts by email if price reduces.

Amazon-Web-Scarper Created a web scraper using simple functions to check price of a product on amazon (can be duplicated to check price at other marke

Swaroop Todankar 1 Jan 17, 2022
Library to scrape and clean web pages to create massive datasets.

lazynlp A straightforward library that allows you to crawl, clean up, and deduplicate webpages to create massive monolingual datasets. Using this libr

Chip Huyen 2.1k Jan 06, 2023
FilmMikirAPI - A simple rest-api which is used for scrapping on the Kincir website using the Python and Flask package

FilmMikirAPI - A simple rest-api which is used for scrapping on the Kincir website using the Python and Flask package

UserGhost411 1 Nov 17, 2022
✂️🕷️ Spider-Cut is a Network Mapper Framework (NMAP Framework)

Spider-Cut is a Network Mapper Framework (NMAP Framework) Installation | Usage | Creators | Donate Installation # Kali Linux | WSL

XforWorks 3 Mar 07, 2022