What is the website? -------------------- This website automatically downloads pictures from the review pages of aliexpress, classifies them to a NSFW-level and posts images beyond a certain NSFW threshold. There's no human intervention. How does it work? -------------------- * get product pages from ali * crawl product pages and extract images * classify images as nsfw * upload images beyond a certain threshold to imgur * generate html and deploy to this website Technical --------------------- * runs on Linux * lots of Python and Bash scripts * curl, wget and Selenium for crawling * caffee with open_nsfw for classification * crawls about 1GB of pictures in 12 hours Changelog ---------- 07/05/17: Identical images are now filtered while uploading 07/03/17: Automatically recovers from the last point before shutting down downloading 07/01/17: Added automatic crawling for products 06/21/17: Automated dealing with cookie changes, added about.txt 06/20/17: Automated the crawling of product pages, lots of backend work 06/18/17: Moved from tumblr to imgur, created website 06/17/17: Integrated deep learning algorithm for integration and tumblr integration 06/16/17: Start of the project, simple picture crawler