Models documentation¶

The mlpack models repository provides ready-to-use implementations of popular and cutting-edge machine learning models mostly deep learning models. The implementations in this repository are intended to be compiled into command-line programs and bindings to Python and other languages.

(This README contains various TODO comments like this one, so if you are helping with the transition from the examples/ repository, be sure to look for comments like this one. Once the transition is done, we can remove this comment (and the others).)

We provide ability to download datasets as well as pretrained weights using our utility functions, by default we assume the server to be mlpack.org. To download any file from mlpack.org simple use the following command.

NOTE: Our dataloader and models automatically download weights if necessary during runtime.

Utils::DownloadFile(url, downloadPath);

(If this repository gets set up as a submodule to the main mlpack repository and that is how everything in it should be compiled, then we should point that out here!)

Introduction¶

This repository contains a number of different models implemented in C++ using mlpack. To understand more about mlpack, refer to the mlpack repository or the mlpack website.

Dependencies¶

In order to compile and build the programs in this repository, you’ll need to make sure that you have the same dependencies available that mlpack requires, in addition to mlpack itself.

(If this should only be built as a submodule, we should probably remove this part about dependencies and instruct users to build this as a submodule of the main mlpack repository.)

mlpack
Armadillo      >= 8.400.0
Boost (program_options, math_c99, unit_test_framework, serialization,
       spirit) >= 1.58
CMake          >= 3.3.2
ensmallen      >= 2.10.0

To install mlpack refer to the installation guide that’s available in the mlpack documentation.

All of those dependencies should be available in your distribution’s package manager. If not, you will have to compile each of them by hand. See the documentation for each of those packages for more information.

Building from source¶

To install this project run the following command.

mkdir build && cd build && cmake ../

Use the optional command -D DEBUG=ON to enable debugging.

Once CMake is configured, compile:

make

You can also build with multiple cores using the -j option. For example, building with 4 cores can be done with the following command:

make -j4

Using Dataloaders¶

This repository provides dataloaders and data preprocessing modules for mlpack library. It also provides utility function required required for downloading, extracting and processing image, text and sequential data. For more information about dataloaders and utility functions.

Dataloaders for popular datasets.¶

Creating and processing data can be done in just a single line. Don’t have the dataset downloaded, No worries, we will download and preprocess it for you. Kindly refer to sample code given below.

const string datasetName = "mnist";
bool shuffleData = true;
double ratioForTrainTestSplit = 0.75;

// Create the DataLoader object.
DataLoader<> dataloader(datasetName, shuffleData, ratioForTrainTestSplit);

To train or test your model with our dataloaders is very simple.

// Use the dataloader for training.
model.Train(dataloader.TrainFeatures(), dataloader.TrainLabels());

// Use the dataloader for prediction.
model.Predict(dataloader.TestFeatures(), dataloader.TestLabels());

Currently supported datasets are mentioned below :

Dataset	Usage	Details
MNIST	DataLoader<> (“mnist”);	MNIST dataset is the de facto “hello world” dataset of computer vision. Each image is 28 pixels in height and 28 pixels in width, for a total of 784 pixels in total. The first column, called “label”, is the digit that was drawn by the user. The rest of the columns contain the pixel-values of the associated image.
Pascal VOC Detection	DataLoader<mat, field> (“voc-detection”)	The Pascal VOC challenge is a very popular dataset for building and evaluating algorithms for image classification, object detection and segmentation. VOC detection dataset provides support for loading object detection dataset in PASCAL VOC. Note : By default we refer to VOC - 2012 dataset as VOC dataset.
CIFAR 10	DataLoader<> (“cifar10”);	The CIFAR-10 dataset consists of 60000 32x32 colour images in 10 classes, with 6000 images per class. There are 50000 training images and 10000 test images.

Loading Other Datasets.¶

We are continuously adding new datasets to this repository, However you can also use our dataloaders to load other datasets.

Loading CSV Datasets.¶

Use our LoadCSV function to load and process CSV datasets.

DataLoader<> irisDataloader;

const string datasetPath = "mnist";
bool shuffleData = true;
double ratioForTrainTestSplit = 0.75;
bool isTrainingData = true;
bool useFeatureScaling = true;
bool dropHeader = false;

// Starting column index for Training Features.
size_t startInputFeatures = 0;
// Ending column index for training Features.
// We also support wrapped index i.e. -1 implies last column and so on.
size_t endInputFeatures = -2;

irisDataloader(datasetPath, isTrainingData, shuffleData, ratioForTrainTestSplit,
    useFeatureScaling, dropHeader, startInputFeatures, endInputFeatures);

Loading Image Dataset.¶

Use our LoadImageDatasetFromDirectory to load image dataset in given directory. Directory should contain folders with folder name as class label and each folder should contain images corresponding to the class name.

DataLoader<> dataloader;
dataloader.LoadImageDatasetFromDirectory("path/to/directory", imageWidth, imageHeight, imageDepth);

Loading Object Detection Dataset.¶

We provide support to load annotations represented in XML files and their corresponding images. If your dataset contains fixed number of objects in each annotation use matrix type to load your dataset else use field type for labels / annotations. If images are not of same size pass a vector containing resize parameter. By default, each image is resized to 64 x 64.

DataLoader<> dataloader;
vector<string> classes = {"class-name-0", "class-name-1", "class-name-2"}
dataloader.LoadObjectDetectionDataset("path/to/annotations/", "path/to/images/", classes);

Preprocessing.¶

For all datasets that we support we provide, We preprocess them internally. We also provide access to preprocessor functions for standard datasets in case one needs to apply them to their datasets.

They can simply be called as follows by calling static functions of ProProcess class i.e. PreProcess::SupportedDatasetName

PreProcess<>::MNIST(dataloader.TrainFeatures(), dataloader.TrainLabels(),
    dataloader.ValidFeatures(), dataloader.ValidLabels(), dataloader.TestFeatures());

This is especially useful when preprocessing of your dataset resembles any other standard dataset that we support.

Using Augmentation¶

To prevent overfitting on training data, we provide support for native augmentation. The constructor takes in a list / vector of strings which contain supported augmentation. Augmentation can be applied to the dataset by calling the Transform function. For more information about augmentation.

Augmentation augmentation({"horizontal-flip", "resize : (64, 64)"}, 0.2);
augmentation.Transform(dataset, imageWidth, imageHeight, imageDepth);

Supported Models¶

Currently model-zoo project has the following models implemented:

Model	Usage	Available Weights	Paper
Darknet 19	DarkNet<NegativeLogLikelihood<>, HeInitialization, 19> darknet19({imageDepth, imageWidth, imageHeight}, numClasses)	ImageNet	YOLO9000
Darknet 53	DarkNet<NegativeLogLikelihood<>, HeInitialization, 53> darknet19({imageDepth, imageWidth, imageHeight}, numClasses)	ImageNet	YOLOv3

All models can be included as shown below :

#include <models/Model-ClassName/Model_ClassName.hpp>