Skip to content

Latest commit

 

History

History
35 lines (26 loc) · 1.15 KB

tpu_exporters.md

File metadata and controls

35 lines (26 loc) · 1.15 KB
Raw

Object Detection TPU Inference Exporter

This package contains SavedModel Exporter for TPU Inference of object detection models.

Usage

This Exporter is intended for users who have trained models with CPUs / GPUs, but would like to use them for inference on TPU without changing their code or re-training their models.

Users are assumed to have:

  • PIPELINE_CONFIG: A pipeline_pb2.TrainEvalPipelineConfig config file;
  • CHECKPOINT: A model checkpoint trained on any device;

and need to correctly set:

  • EXPORT_DIR: Path to export SavedModel;
  • INPUT_PLACEHOLDER: Name of input placeholder in model's signature_def_map;
  • INPUT_TYPE: Type of input node, which can be one of 'image_tensor', 'encoded_image_string_tensor', or 'tf_example';
  • USE_BFLOAT16: Whether to use bfloat16 instead of float32 on TPU.

The model can be exported with:

python object_detection/tpu_exporters/export_saved_model_tpu.py \
    --pipeline_config_file=<PIPELINE_CONFIG> \
    --ckpt_path=<CHECKPOINT> \
    --export_dir=<EXPORT_DIR> \
    --input_placeholder_name=<INPUT_PLACEHOLDER> \
    --input_type=<INPUT_TYPE> \
    --use_bfloat16=<USE_BFLOAT16>