Scraper

/Scraper

Scraping and data enrichment

, ,

The project goal was data enrichment: to find and collect email addresses of people working in the educational institutions in the USA based off the list of universities. We were provided the list of websites of the USA universities and our task was to find and scrape all available emails associated with these educational institutions. [...]

Data augmentation for marketing application

,

Data augmentation for marketing campaign. The goal was to use the  database of email addresses to find information of their owners. Data augmentation is one of the most popular tasks in data processing for marketing and advertising. Email addresses without owner details are not enough to create high-quality marketing newsletter. […]

Price comparison website and custom scraper

, , , , ,

Price comparison website and custom scraper – a web application to compare prices in multiple USA shops and notify end users when prices go down. Script monitors 6pm.com, amazon.com, bestbuy.com, ebay.com, homedepot.com, macys.com, microsoft.com/en-us/store/b/home, newegg.com, rakuten.com, walmart.com and couple dozens more shops are scraped. […]

Digital charts for aircraft

, , , ,

Semi-automatic system for conversion of paper charts with aircraft routes into digital format. Chart is drawn with a digital pen with camera, which then passes the chart into backend and saves as an electronic document. Then they become available as digital charts for aircraft. A tool is used in aviation industry. Coverted charts are being [...]

A web and mobile application for finding special offers, deals and discounts in bars and restaurants around

, , , ,

A web application for finding special offers, deals, discounts. A directory of bars, restraunts and clubs, where user can pick up the places with happy hours, discounts, deals, interesting events at the moment basing on his location. The first stage was to parse places from Foursquare, the next stage was automatic finding social networks associated [...]

A script for scraping site templates

,

A script for scraping site templates and removing all personal information from it. Urls, names, contact details, addresses are removed from template and are replaced with placeholder data for further usage. The tool supports either sites based on popular CMS like Wordpress or sites based on frontend frameworks like Angular and React.

Scraper to parse contact details

, , , , ,

A scraper to parse contact details of buisness offices that belong to a certain buisness category on Yelp site. Script is responsible for automated collection of data for marketing campaigns and for filtering out collected results. It scrapes businesses from Yelp by set of criteria, then grabs business contact info from details. Provides high performance [...]

Cars scraper and database

, , ,

A cars scraper and database. We've implemented a scraping script, which grabbed cars from multiple car directories into a single collection. Then data were filtered and uploaded to a database, which feeds online car catalogue. It  helps user select a car according to his specific requirements. There is advanced search for site visitors. Data is [...]

Scraper and language analyzer for Springer

,

Scraper and language analyzer  for collection of data and semantic analysis of scientific texts for Springer and technical universities. The script grabs article author, title, volume, issue and other information and then uses this data to search in Google Scholar. Then it grabs citations from search result and stores in the database.