Web Scraping Platform 07-23-2017, 05:46 PM
#1
Project Orville
Past Project
Well, as most of you know I was working on a project, Authize, which was a license management system I was going to market here and other forums. Unfortunately there was too much competition and I can no longer see the project as being viable for income. Hence, project Orville.
What is Orville?
Orville will be a GUI-based (currently CLI) web scraping utility with API endpoints and the ability to embed if desired. The goal is to make web scraping faster than is currently possible with Selenium and similar frameworks that actually render a page in a browser. It will also make it easier than the mishmash of libraries people use for scraping in languages such as Python.
I originally started this project because I was working on email scraping for a few investment companies, but decided that other people might also enjoy using what I've created.
Notable features include:
• Scriping support (currently lua, maybe JS later)
• HTTP request building
• Easy cookie and crumb scraping
I originally started this project because I was working on email scraping for a few investment companies, but decided that other people might also enjoy using what I've created.
Notable features include:
• Scriping support (currently lua, maybe JS later)
• HTTP request building
• Easy cookie and crumb scraping
How much will it cost?
Price is still very much undecided, but there will be a limited free version for trials.
Technical Details
The Orville Framework and application will be written mostly in Go with certain parts done in C/ASM. The API will be accessible through a RESTful API and possible an RPC API.





![[+]](https://sinister.li/images/modern/collapse_collapsed.png)




















