scraping

/scraping

Scraping and data enrichment

, ,

The project goal was data enrichment: to find and collect email addresses of people working in the educational institutions in the USA based off the list of universities. We were provided the list of websites of the USA universities and our task was to find and scrape all available emails associated with these educational institutions. [...]

Price comparison website and custom scraper

, , , , ,

Price comparison website and custom scraper – a web application to compare prices in multiple USA shops and notify end users when prices go down. Script monitors 6pm.com, amazon.com, bestbuy.com, ebay.com, homedepot.com, macys.com, microsoft.com/en-us/store/b/home, newegg.com, rakuten.com, walmart.com and couple dozens more shops are scraped. […]

Directory of products scraped from eBay and Amazon for local market

, , , ,

Online marketplace and directory with products scraped and grabbed from eBay and Amazon API. There is a delivery service for shoppers from Ukraine who fell it difficult to make orders themselves and payment system, which supports multiple currencies. Product is purchased from eBay and Amazon, company's commission and delivery cost is added and user can [...]

Digital charts for aircraft

, , , ,

Semi-automatic system for conversion of paper charts with aircraft routes into digital format. Chart is drawn with a digital pen with camera, which then passes the chart into backend and saves as an electronic document. Then they become available as digital charts for aircraft. A tool is used in aviation industry. Coverted charts are being [...]

A web and mobile application for finding special offers, deals and discounts in bars and restaurants around

, , , ,

A web application for finding special offers, deals, discounts. A directory of bars, restraunts and clubs, where user can pick up the places with happy hours, discounts, deals, interesting events at the moment basing on his location. The first stage was to parse places from Foursquare, the next stage was automatic finding social networks associated [...]

A script for scraping site templates

,

A script for scraping site templates and removing all personal information from it. Urls, names, contact details, addresses are removed from template and are replaced with placeholder data for further usage. The tool supports either sites based on popular CMS like Wordpress or sites based on frontend frameworks like Angular and React.

Scraper to parse contact details

, , , , ,

A scraper to parse contact details of buisness offices that belong to a certain buisness category on Yelp site. Script is responsible for automated collection of data for marketing campaigns and for filtering out collected results. It scrapes businesses from Yelp by set of criteria, then grabs business contact info from details. Provides high performance [...]

Cars scraper and database

, , ,

A cars scraper and database. We've implemented a scraping script, which grabbed cars from multiple car directories into a single collection. Then data were filtered and uploaded to a database, which feeds online car catalogue. It  helps user select a car according to his specific requirements. There is advanced search for site visitors. Data is [...]