CNN - Tensorflow.JS

Vision - Doodles Classifier & Live Drawing Prediction in Browser.

This was just a fun experiment to make predictions on hand-drawn sketch or doodles using transfer learning.

For this, I used 'DoodleNet' Convolutional Neural Network (CNN) model. This model was created by 'Yining Shi' and the model is hosted on ml5 library. So using p5 and ml5, I was able to write a small and high level code to load the pretrained model and then make a prediction on the model.

• Dataset used in DoodleNet

  This pretrained model was trained using 345 categories of doodles with 50K images per category dataset, which is gives total 17,250,000 images, so getting the data, preprocessing and training the data would have taken alot of time and resources. This data was collected from "Google’s Quick, Draw!" game, which at this point contains 50M hand-drawn images. To check the data and categories please visit "Google’s Quick Draw!, The Data".

• Transfer Learning

  Model was loaded and predicted using ml5 JS libaray, which provides high level coding interface for users, so that they can easily deploy and the models that are hosted by ml5.

To view the source code JS, HTML & CSS please visit my Github page.

Github page