Skip to content

Latest commit

 

History

History
157 lines (134 loc) · 6.44 KB

README.md

File metadata and controls

157 lines (134 loc) · 6.44 KB
Raw

SSD-MobileNet FP32 inference

This document has instructions for running SSD-MobileNet FP32 inference using Intel-optimized TensorFlow.

Dataset

The COCO validation dataset is used in these SSD-Mobilenet quickstart scripts. The inference and accuracy quickstart scripts require the dataset to be converted into the TF records format. See the COCO dataset for instructions on downloading and preprocessing the COCO validation dataset.

Quick Start Scripts

Script name Description
fp32_inference.sh Runs inference on TF records and outputs performance metrics.
fp32_accuracy.sh Processes the TF records to run inference and check accuracy on the results.
multi_instance_batch_inference.sh A multi-instance run that uses all the cores for each socket for each instance with a batch size of 448 and synthetic data.
multi_instance_online_inference.sh A multi-instance run that uses 4 cores per instance with a batch size of 1. Uses synthetic data if no DATASET_DIR is set.

Run the model

Setup your environment using the instructions below, depending on if you are using AI Kit:

Setup using AI Kit on Linux Setup without AI Kit on Linux Setup without AI Kit on Windows

To run using AI Kit on Linux you will need:

  • numactl
  • wget
  • build-essential
  • Cython
  • contextlib2
  • jupyter
  • lxml
  • matplotlib
  • pillow>=8.1.2
  • pycocotools
  • Activate the `tensorflow` conda environment 
    conda activate tensorflow

To run without AI Kit on Linux you will need:

  • Python 3
  • git
  • numactl
  • wget
  • intel-tensorflow>=2.5.0
  • build-essential
  • Cython
  • contextlib2
  • jupyter
  • lxml
  • matplotlib
  • pillow>=8.1.2
  • pycocotools
  • A clone of the Model Zoo repo
    git clone https://github.com/IntelAI/models.git

To run without AI Kit on Windows you will need:

For more information on the dependencies, see the documentation on prerequisites in the TensorFlow models repo.

Download the pretrained model and set the PRETRAINED_MODEL environment variable to the path of the frozen graph. If you run on Windows, please use a browser to download the pretrained model using the link below. For Linux, run:

wget https://storage.googleapis.com/intel-optimized-tensorflow/models/v1_8/ssdmobilenet_fp32_pretrained_model_combinedNMS.pb
export PRETRAINED_MODEL=$(pwd)/ssdmobilenet_fp32_pretrained_model_combinedNMS.pb

After installing the prerequisites and downloading the pretrained model, set the environment variables for the paths to your PRETRAINED_MODEL, an OUTPUT_DIR where log files will be written, and DATASET_DIR for COCO raw dataset directory or tf_records file based on whether you run inference or accuracy scripts. Navigate to your model zoo directory and then run a quickstart script on either Linux or Windows.

Run on Linux

# cd to your model zoo directory
cd models

export PRETRAINED_MODEL=<path to the downloaded frozen graph>
export DATASET_DIR=<path to the coco tf record file>
export OUTPUT_DIR=<path to the directory where log files will be written>
# For a custom batch size, set env var `BATCH_SIZE` or it will run with a default value.
export BATCH_SIZE=<customized batch size value>

./quickstart/object_detection/tensorflow/ssd-mobilenet/inference/cpu/fp32/<script name>.sh

Run on Windows

Using cmd.exe, run:

# cd to your model zoo directory
cd models

set PRETRAINED_MODEL=<path to the pretrained model pb file>
set DATASET_DIR=<path to the coco tf record file>
set OUTPUT_DIR=<directory where log files will be written>
# For a custom batch size, set env var `BATCH_SIZE` or it will run with a default value.
set BATCH_SIZE=<customized batch size value>

bash quickstart\object_detection\tensorflow\ssd-mobilenet\inference\cpu\fp32\<script name>.sh

Note: You may use cygpath to convert the Windows paths to Unix paths before setting the environment variables. As an example, if the dataset location on Windows is D:\user\coco_dataset\coco_val.record, convert the Windows path to Unix as shown:

cygpath D:\user\coco_dataset\coco_val.record
/d/user/coco_dataset/coco_val.record

Then, set the DATASET_DIR environment variable set DATASET_DIR=/d/user/coco_dataset/coco_val.record.

Additional Resources