Stars
18
Forks
1
Language
Crystal
Last Updated
Apr 19, 2022
Similar Repos
| Repo | Language | Stars | Description | Updated At |
|---|---|---|---|---|
| Go | 3 | A standalone crawling tool for extracting data from the web. | Mar 10, 2021 | |
| Go | 17 | Web crawling and scraping framework for Golang | Aug 06, 2021 | |
| Python | 61 | Screen scraping and web crawling framework | Jun 21, 2021 | |
| C# | 2 | A Web Crawling Framework | Jan 28, 2023 | |
| Python | 157 | Brownant is a web data extracting framework. | Jan 06, 2022 | |
| CoffeeScript | 2 | Sinew-Node collects structured data from web sites (screen scraping). | Jan 15, 2021 | |
| Python | 62 | Scraping and Web Crawling Framework For Zhihu Live | Jul 14, 2022 | |
| Ruby | 15 | Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites. | May 17, 2015 | |
| Java | 702 | NewPipe's core library for extracting data from streaming sites | Aug 13, 2022 | |
| None | 2 | NewPipe's core library for extracting data from streaming sites | Mar 30, 2023 | |
| Java | 7 | NewPipe's core library for extracting data from streaming sites | Sep 22, 2023 | |
| None | 2 | NewPipe's core library for extracting data from streaming sites | Mar 26, 2024 | |
| Ruby | 3 | Ruby Gem for crawling bandcamp.com sites | May 25, 2021 | |
| JavaScript | 5 | UI for extracting structured data from graphs in pdf files | Mar 21, 2022 | |
| Python | 2016 | Web crawling framework based on asyncio. | Nov 01, 2022 | |
| JavaScript | 4 | Scalable framework for structured and growable web apps. | Mar 31, 2015 | |
| Rust | 27 | macros for querying and extracting value from structured data by JavaScript-like syntax | Mar 31, 2023 | |
| C# | 3 | Analyst Opinions, Estimates and Market data - Web Crawling | Apr 23, 2017 | |
| C# | 3 | A .NET Core Library for extracting structured data from unstructured text. | Apr 02, 2022 | |
| Ruby | 408 | Fast high-level web crawling Ruby framework | Aug 31, 2022 | |
| Common Lisp | 8 | A web crawling framework in Common Lisp. | Dec 10, 2019 | |
| Python | 14 | Asyncio web crawling framework. Work in progress. | Oct 31, 2022 | |
| Jupyter Notebook | 34 | Extracting Semi-Structured Data from PDFs on a large scale | Oct 07, 2022 | |
| Python | 5 | OceanMonkey is a High-Level Distributed Web Crawling and Web Scraping framework base on multi-process and … | Jan 27, 2022 | |
| None | 2 | :mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured … | Jan 31, 2021 | |
| TypeScript | 122 | :mag: Data pipeline for crawling PDFs from the Web and transforming their contents into structured … | Aug 17, 2022 | |
| Go | 4 | Golang Crawling and scraping framework | May 01, 2023 | |
| Python | 4 | A fast high-level screen scraping and web crawling framework for Python. | Jul 05, 2022 | |
| Go | 2 | Antch, a fast, powerful and extensible web crawling & scraping framework for Go | Jun 04, 2022 | |
| Go | 248 | Antch, a fast, powerful and extensible web crawling & scraping framework for Go | May 09, 2023 | |
| Dart | 2 | A dart library for extracting metadata in web pages. Supports Open Graph, Meta, Twitter Cards, … | Oct 20, 2021 | |
| None | 4 | A dart library for extracting metadata in web pages. Supports Open Graph, Meta, Twitter Cards, … | Oct 07, 2021 | |
| C# | 3410 | DotnetSpider, a .NET standard web crawling library. It is lightweight, efficient and fast high-level web … | Aug 12, 2022 | |
| Common Lisp | 5 | Framework for parsing/extracting data from web pages into a more manageable format | Jan 27, 2019 | |
| Jupyter Notebook | 10 | Tutorials for web scraping and crawling | Aug 02, 2020 | |
| JavaScript | 504 | OWL: A web framework for structured, dynamic and maintainable applications | Aug 30, 2022 | |
| Python | 81 | Scraping Ebay's products using Scrapy Web Crawling Framework | Aug 31, 2022 | |
| JavaScript | 30 | Userscript for extracting links from kissanime.ru and similar sites. | May 07, 2023 | |
| JavaScript | 1943 | A framework for extracting meaning from web pages | Aug 10, 2022 | |
| Python | 277 | Lightweight web scraping toolkit for documents and structured data. | Aug 07, 2022 | |
| Elixir | 586 | Crawly, a high-level web crawling & scraping framework for Elixir. | Jul 11, 2022 | |
| JavaScript | 456 | a reliable high-level web crawling & scraping framework for Node.js. | May 10, 2023 | |
| JavaScript | 11 | An Open Source Web Application for Genetic Data (SNPs) Data Crawling | May 31, 2022 | |
| PHP | 3 | GlisWeb framework is a stable and lightweight framework for building both web sites and web … | Jan 31, 2023 | |
| Python | 17 | The web data crawling code on the clien and bobaedream. | Feb 22, 2022 | |
| Rust | 2 | Crawling/scraping framework for Rust | Mar 05, 2023 | |
| None | 25 | Scrapy, a fast high-level screen scraping and web crawling framework for Python. | Apr 27, 2020 | |
| Dart | 49 | Scrapy, a fast high-level web crawling & scraping framework for dart and Flutter | Jul 22, 2022 | |
| Python | 2 | Scrapy, a fast high-level screen scraping and web crawling framework for Python. | Apr 26, 2022 | |
| Java | 6 | Project for extracting structured data from PDFs - accepted for publication in Open Research Computation | Jul 30, 2016 |