Code and data for construction of a network architecture for Multi-Multi-Instance learning

  • Manfred Jaeger (Ophavsperson)
  • Paolo Frasconi (Ophavsperson)
  • Alessandro Tibo (University of Florence) (Ophavsperson)



This tar.gz file contains the replica of the author's GitHub repository which includes the data used for running the experiments on papers. Due to copyright restrictions two of the three graph citation networks are not in included. Please contact the author via email: for further information.The dataset holds:1. data and code files used to construct a multi-multi instance semi-synthetic dataset from the MNIST database of handwritten digits, available here:; a training set of 60,000 examples, and a test set of 10,000 examples. Digits are organized in bags-of-bags of arbitrary cardinality. 2. data, image and code files used to construct a semi-synthetic dataset from MNIST, placing digits randomly into a background images of black pixels.3. example real citation network datasets where data can be naturally decomposed into bags-of-bags (MMI data) or bags (MI data).<b>mmi.tar.gz</b> can be uncompressed using standard compression utilities. Code files are in Python <b>.py, .npy, .pyc</b> formats, Linux shell executable files <b>.sh </b>and<b> .json </b>format<b>, </b>openly accessible via text edit software.README and other metadata files are provided in <b>.md </b>markdown language, <b>.meta</b> and <b>.txt</b> format at various levels of the folder architecture.Image files are provided in <b>.idx3-ubyte</b> file type: a simple format for vectors and multidimensional matrices of various numerical types.<b>mmi</b><b>Installation</b>mmi uses the following dependencies:- numpy- TensorFlow -See installation instructions: install mmi, run the install command: <i>python install</i>You can also install mmmi from PyPI <i>pip install mmi</i><b>Run the demo</b>Enter example_mnist folder and run<i> python</i><b>Background</b>In the associated paper, we study an extension of the multi-instance learning problem where examples are organized as nested bags of instances (e.g., a document could be represented as a bag of sentences, which in turn are bags of words). This framework can be useful in various scenarios, such as graph classification, image classification and translation-invariant pooling in convolutional neural network. In order to learn multi-multi instance data, we introduce a special neural network layer, called bag-layer, whose units aggregate sets of inputs of arbitrary size. We prove that the associated class of functions contains all Boolean functions over sets of sets of instances. We present empirical results on semi-synthetic data showing that such class of functions can be actually learned from data. We also present experiments on citation graphs datasets where our model obtains competitive results.
Dato for tilgængelighed7 mar. 2018