person-reid.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "TXD4aJ2jPkZD"
   },
   "source": [
    "# Softmax, Cross Entropy Loss \n",
    "\n",
    "This model focuses on training the layer prior to the classification layer. Essentially, while training the classification layer to predict individuals from different angles, you inherently train the embedding layer before the classifier. In doing so, you figure out the embeddings the model finds important. You can take these values and find the distance (euclidean in our case) between query images and images in the gallery.\n",
    "\n",
    "[1] https://www.semanticscholar.org/paper/Person-Re-identification-by-Descriptive-and-Hirzer-Beleznai/16c7c31a7553d99f1837fc6e88e77b5ccbb346b8?p2df\n",
    "\n",
    "[2] https://arxiv.org/abs/1701.07717\n",
    "\n",
    "[3] https://www.cv-foundation.org/openaccess/content_iccv_2015/papers/Zheng_Scalable_Person_Re-Identification_ICCV_2015_paper.pdf "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "1ZCkUVXrXFzP"
   },
   "outputs": [],
   "source": [
    "from google.colab import drive\n",
    "drive.mount('/content/drive/')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "aHBZ8igvZB0u"
   },
   "outputs": [],
   "source": [
    "cd drive/MyDrive/person-reid/deep-person-reid"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "elA7KqY7SozQ"
   },
   "source": [
    "This is tested via the torchreid API provided by Kaiyang Zhou who authored numerous papers within the domain. Link here: https://github.com/KaiyangZhou/deep-person-reid\n",
    "\n",
    "Torchreid is a python API that utilizes PyTorch and carries multiple different implementations and models for user purposes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "1aQxNXKnYwqT"
   },
   "outputs": [],
   "source": [
    "import torchreid\n",
    "import os"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "b120YAzASmNo"
   },
   "source": [
    "Register our data set with torchreid."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "KYprcdaNt6ap"
   },
   "outputs": [],
   "source": [
    "from comp_vis_data import CvDataSet"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "78UxNsYYxg88"
   },
   "outputs": [],
   "source": [
    "torchreid.data.register_image_dataset('cv_data', CvDataSet)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "RTdJP_x8UFm0"
   },
   "source": [
    "Create a DataLoader with Market1501 as the training data our procured data as the evaluation. We did some data augmentations by adding transformations of random_flip and random_crop to help the model generalize. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "yAjyRWNsxnr1"
   },
   "outputs": [],
   "source": [
    "datamanager = torchreid.data.ImageDataManager(\n",
    "    root='reid-data',\n",
    "    sources='market1501',\n",
    "    targets='cv_data',\n",
    "    height=256,\n",
    "    width=128,\n",
    "    batch_size_train=32,\n",
    "    batch_size_test=32,\n",
    "    transforms=['random_flip', 'random_crop']\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "elmKE751Ub8b"
   },
   "source": [
    "Path to restart training from epoch after stopping early"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "KDx9P6vn2ekZ"
   },
   "outputs": [],
   "source": [
    "path = os.getcwd() + '/log/test-softmax-market1501-cv-test/model/model.pth.tar-30'\n",
    "path"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "2im3DlqOUgPp"
   },
   "source": [
    "The model is built using transfer learning using resnet50. This makes the model learn from a baseline model and will help find a local minimum quicker. We initialize the loss function to softmax as test."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "qd51rHn325e8"
   },
   "outputs": [],
   "source": [
    "model = torchreid.models.build_model(\n",
    "    name='resnet50',\n",
    "    num_classes=datamanager.num_train_pids,\n",
    "    loss='softmax'\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "AD_f7pbM2166"
   },
   "outputs": [],
   "source": [
    "model = model.cuda()\n",
    "optimizer = torchreid.optim.build_optimizer(\n",
    "    model, optim='adam', lr=0.0003\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "scWNnWlauWAV"
   },
   "outputs": [],
   "source": [
    "scheduler = torchreid.optim.build_lr_scheduler(\n",
    "    optimizer,\n",
    "    lr_scheduler='single_step',\n",
    "    stepsize=20\n",
    ")\n",
    "\n",
    "engine = torchreid.engine.ImageSoftmaxEngine(\n",
    "    datamanager, model, optimizer, scheduler=scheduler\n",
    ")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 801,
     "status": "ok",
     "timestamp": 1607657755024,
     "user": {
      "displayName": "Bonaventure Raj",
      "photoUrl": "https://lh3.googleusercontent.com/a-/AOh14GhqjcUxZsLP4yW5xE0rZkh6rD6pAr7JvJklQpXf=s64",
      "userId": "03021209118316038736"
     },
     "user_tz": 300
    },
    "id": "lh6lI0wx3hAG",
    "outputId": "96fe99c2-e295-4866-c7bc-76fe4f1b7d0c"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Loading checkpoint from \"/content/drive/My Drive/person-reid/deep-person-reid/log/test-softmax-market1501-cv-test/model/model.pth.tar-30\"\n",
      "Loaded model weights\n",
      "Loaded optimizer\n",
      "Last epoch = 30\n",
      "Last rank1 = 33.3%\n"
     ]
    }
   ],
   "source": [
    "start_epoch = torchreid.utils.resume_from_checkpoint(\n",
    "    path,\n",
    "    model,\n",
    "    optimizer\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "UMnshEJ1Urnp"
   },
   "source": [
    "We train the model for 60 epochs and evaluate on our own dataset every 10 epochs. This shows us how our model is performing as it trains."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "colab": {
     "base_uri": "https://localhost:8080/"
    },
    "executionInfo": {
     "elapsed": 2773826,
     "status": "ok",
     "timestamp": 1607660529719,
     "user": {
      "displayName": "Bonaventure Raj",
      "photoUrl": "https://lh3.googleusercontent.com/a-/AOh14GhqjcUxZsLP4yW5xE0rZkh6rD6pAr7JvJklQpXf=s64",
      "userId": "03021209118316038736"
     },
     "user_tz": 300
    },
    "id": "Ja85Nb87tf58",
    "outputId": "0c0cf608-c5d4-4166-fc00-d7672da8ab36"
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "=> Start training\n",
      "epoch: [31/60][10/404]\ttime 0.207 (0.267)\tdata 0.000 (0.047)\teta 0:53:54\tloss 4.7011 (4.7336)\tacc 21.8750 (16.8750)\tlr 0.000030\n",
      "epoch: [31/60][20/404]\ttime 0.207 (0.238)\tdata 0.000 (0.023)\teta 0:47:53\tloss 4.4288 (4.7268)\tacc 25.0000 (17.8125)\tlr 0.000030\n",
      "epoch: [31/60][30/404]\ttime 0.207 (0.227)\tdata 0.000 (0.016)\teta 0:45:50\tloss 4.9772 (4.6801)\tacc 9.3750 (18.2292)\tlr 0.000030\n",
      "epoch: [31/60][40/404]\ttime 0.213 (0.223)\tdata 0.000 (0.012)\teta 0:44:55\tloss 4.3988 (4.6305)\tacc 34.3750 (19.1406)\tlr 0.000030\n",
      "epoch: [31/60][50/404]\ttime 0.208 (0.220)\tdata 0.000 (0.009)\teta 0:44:18\tloss 4.6845 (4.6074)\tacc 9.3750 (18.8125)\tlr 0.000030\n",
      "epoch: [31/60][60/404]\ttime 0.208 (0.218)\tdata 0.000 (0.008)\teta 0:43:53\tloss 4.5837 (4.6102)\tacc 15.6250 (18.3333)\tlr 0.000030\n",
      "epoch: [31/60][70/404]\ttime 0.210 (0.217)\tdata 0.000 (0.007)\teta 0:43:35\tloss 4.5118 (4.5829)\tacc 18.7500 (18.7946)\tlr 0.000030\n",
      "epoch: [31/60][80/404]\ttime 0.212 (0.216)\tdata 0.000 (0.006)\teta 0:43:22\tloss 4.1285 (4.5653)\tacc 28.1250 (19.2578)\tlr 0.000030\n",
      "epoch: [31/60][90/404]\ttime 0.210 (0.215)\tdata 0.000 (0.005)\teta 0:43:12\tloss 4.6195 (4.5546)\tacc 15.6250 (19.3056)\tlr 0.000030\n",
      "epoch: [31/60][100/404]\ttime 0.210 (0.215)\tdata 0.000 (0.005)\teta 0:43:04\tloss 4.2074 (4.5329)\tacc 28.1250 (19.7812)\tlr 0.000030\n",
      "epoch: [31/60][110/404]\ttime 0.214 (0.215)\tdata 0.000 (0.004)\teta 0:42:59\tloss 4.2323 (4.5330)\tacc 28.1250 (19.8011)\tlr 0.000030\n",
      "epoch: [31/60][120/404]\ttime 0.212 (0.215)\tdata 0.000 (0.004)\teta 0:42:54\tloss 4.2125 (4.5062)\tacc 28.1250 (20.4948)\tlr 0.000030\n",
      "epoch: [31/60][130/404]\ttime 0.213 (0.214)\tdata 0.000 (0.004)\teta 0:42:49\tloss 4.6029 (4.5013)\tacc 9.3750 (20.6731)\tlr 0.000030\n",
      "epoch: [31/60][140/404]\ttime 0.213 (0.214)\tdata 0.000 (0.003)\teta 0:42:46\tloss 4.1211 (4.4876)\tacc 28.1250 (20.9821)\tlr 0.000030\n",
      "epoch: [31/60][150/404]\ttime 0.212 (0.214)\tdata 0.000 (0.003)\teta 0:42:42\tloss 4.3343 (4.4821)\tacc 25.0000 (21.0208)\tlr 0.000030\n",
      "epoch: [31/60][160/404]\ttime 0.215 (0.214)\tdata 0.000 (0.003)\teta 0:42:40\tloss 4.3281 (4.4774)\tacc 21.8750 (21.2109)\tlr 0.000030\n",
      "epoch: [31/60][170/404]\ttime 0.211 (0.214)\tdata 0.000 (0.003)\teta 0:42:37\tloss 4.4841 (4.4783)\tacc 15.6250 (21.2132)\tlr 0.000030\n",
      "epoch: [31/60][180/404]\ttime 0.219 (0.214)\tdata 0.000 (0.003)\teta 0:42:35\tloss 4.5409 (4.4701)\tacc 18.7500 (21.2674)\tlr 0.000030\n",
      "epoch: [31/60][190/404]\ttime 0.216 (0.214)\tdata 0.000 (0.003)\teta 0:42:33\tloss 4.2407 (4.4645)\tacc 25.0000 (21.4967)\tlr 0.000030\n",
      "epoch: [31/60][200/404]\ttime 0.217 (0.214)\tdata 0.000 (0.002)\teta 0:42:32\tloss 4.3091 (4.4717)\tacc 40.6250 (21.5312)\tlr 0.000030\n",
      "epoch: [31/60][210/404]\ttime 0.214 (0.214)\tdata 0.000 (0.002)\teta 0:42:30\tloss 4.5185 (4.4746)\tacc 25.0000 (21.6369)\tlr 0.000030\n",
      "epoch: [31/60][220/404]\ttime 0.215 (0.214)\tdata 0.000 (0.002)\teta 0:42:29\tloss 4.5755 (4.4708)\tacc 15.6250 (21.6619)\tlr 0.000030\n",
      "epoch: [31/60][230/404]\ttime 0.214 (0.214)\tdata 0.000 (0.002)\teta 0:42:27\tloss 4.6604 (4.4671)\tacc 21.8750 (21.8207)\tlr 0.000030\n",
      "epoch: [31/60][240/404]\ttime 0.220 (0.214)\tdata 0.000 (0.002)\teta 0:42:26\tloss 4.3333 (4.4653)\tacc 18.7500 (21.9271)\tlr 0.000030\n",
      "epoch: [31/60][250/404]\ttime 0.217 (0.215)\tdata 0.000 (0.002)\teta 0:42:26\tloss 4.5326 (4.4662)\tacc 21.8750 (21.8625)\tlr 0.000030\n",
      "epoch: [31/60][260/404]\ttime 0.215 (0.215)\tdata 0.000 (0.002)\teta 0:42:24\tloss 4.5667 (4.4609)\tacc 31.2500 (21.9471)\tlr 0.000030\n",
      "epoch: [31/60][270/404]\ttime 0.220 (0.215)\tdata 0.000 (0.002)\teta 0:42:24\tloss 4.4935 (4.4574)\tacc 18.7500 (22.1528)\tlr 0.000030\n",
      "epoch: [31/60][280/404]\ttime 0.219 (0.215)\tdata 0.000 (0.002)\teta 0:42:24\tloss 4.0523 (4.4541)\tacc 34.3750 (22.2433)\tlr 0.000030\n",
      "epoch: [31/60][290/404]\ttime 0.221 (0.215)\tdata 0.000 (0.002)\teta 0:42:23\tloss 4.1996 (4.4532)\tacc 37.5000 (22.3815)\tlr 0.000030\n",
      "epoch: [31/60][300/404]\ttime 0.223 (0.215)\tdata 0.000 (0.002)\teta 0:42:23\tloss 4.1104 (4.4472)\tacc 37.5000 (22.4583)\tlr 0.000030\n",
      "epoch: [31/60][310/404]\ttime 0.221 (0.215)\tdata 0.000 (0.002)\teta 0:42:23\tloss 3.9929 (4.4465)\tacc 28.1250 (22.4698)\tlr 0.000030\n",
      "epoch: [31/60][320/404]\ttime 0.222 (0.216)\tdata 0.000 (0.002)\teta 0:42:23\tloss 4.6486 (4.4439)\tacc 28.1250 (22.4902)\tlr 0.000030\n",
      "epoch: [31/60][330/404]\ttime 0.222 (0.216)\tdata 0.000 (0.002)\teta 0:42:23\tloss 4.5244 (4.4436)\tacc 25.0000 (22.5379)\tlr 0.000030\n",
      "epoch: [31/60][340/404]\ttime 0.224 (0.216)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.3293 (4.4394)\tacc 28.1250 (22.6746)\tlr 0.000030\n",
      "epoch: [31/60][350/404]\ttime 0.223 (0.216)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.2171 (4.4365)\tacc 28.1250 (22.7768)\tlr 0.000030\n",
      "epoch: [31/60][360/404]\ttime 0.222 (0.216)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.2547 (4.4363)\tacc 28.1250 (22.7865)\tlr 0.000030\n",
      "epoch: [31/60][370/404]\ttime 0.223 (0.216)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.6864 (4.4360)\tacc 18.7500 (22.8463)\tlr 0.000030\n",
      "epoch: [31/60][380/404]\ttime 0.228 (0.217)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.3048 (4.4357)\tacc 28.1250 (22.7961)\tlr 0.000030\n",
      "epoch: [31/60][390/404]\ttime 0.222 (0.217)\tdata 0.000 (0.001)\teta 0:42:23\tloss 3.8123 (4.4330)\tacc 31.2500 (22.8285)\tlr 0.000030\n",
      "epoch: [31/60][400/404]\ttime 0.223 (0.217)\tdata 0.000 (0.001)\teta 0:42:23\tloss 4.2036 (4.4284)\tacc 28.1250 (22.9688)\tlr 0.000030\n",
      "epoch: [32/60][10/404]\ttime 0.226 (0.280)\tdata 0.000 (0.054)\teta 0:54:40\tloss 4.5135 (4.3446)\tacc 21.8750 (25.3125)\tlr 0.000030\n",
      "epoch: [32/60][20/404]\ttime 0.227 (0.253)\tdata 0.000 (0.027)\teta 0:49:22\tloss 4.4944 (4.3121)\tacc 28.1250 (26.2500)\tlr 0.000030\n",
      "epoch: [32/60][30/404]\ttime 0.226 (0.244)\tdata 0.000 (0.018)\teta 0:47:31\tloss 4.5323 (4.3499)\tacc 21.8750 (26.7708)\tlr 0.000030\n",
      "epoch: [32/60][40/404]\ttime 0.227 (0.239)\tdata 0.000 (0.013)\teta 0:46:33\tloss 4.3225 (4.3665)\tacc 28.1250 (26.0156)\tlr 0.000030\n",
      "epoch: [32/60][50/404]\ttime 0.226 (0.236)\tdata 0.000 (0.011)\teta 0:45:56\tloss 4.6595 (4.3547)\tacc 25.0000 (26.3750)\tlr 0.000030\n",
      "epoch: [32/60][60/404]\ttime 0.225 (0.234)\tdata 0.000 (0.009)\teta 0:45:30\tloss 4.2604 (4.3698)\tacc 21.8750 (25.7812)\tlr 0.000030\n",
      "epoch: [32/60][70/404]\ttime 0.224 (0.233)\tdata 0.000 (0.008)\teta 0:45:10\tloss 4.4005 (4.3880)\tacc 25.0000 (24.9107)\tlr 0.000030\n",
      "epoch: [32/60][80/404]\ttime 0.223 (0.232)\tdata 0.000 (0.007)\teta 0:44:55\tloss 4.5124 (4.3842)\tacc 25.0000 (25.0391)\tlr 0.000030\n",
      "epoch: [32/60][90/404]\ttime 0.225 (0.231)\tdata 0.000 (0.006)\teta 0:44:41\tloss 4.5632 (4.3791)\tacc 21.8750 (25.1389)\tlr 0.000030\n",
      "epoch: [32/60][100/404]\ttime 0.222 (0.230)\tdata 0.000 (0.005)\teta 0:44:30\tloss 4.2913 (4.3675)\tacc 34.3750 (25.4062)\tlr 0.000030\n",
      "epoch: [32/60][110/404]\ttime 0.223 (0.229)\tdata 0.000 (0.005)\teta 0:44:21\tloss 4.4393 (4.3659)\tacc 28.1250 (25.5682)\tlr 0.000030\n",
      "epoch: [32/60][120/404]\ttime 0.225 (0.229)\tdata 0.000 (0.005)\teta 0:44:11\tloss 4.4247 (4.3560)\tacc 28.1250 (25.7552)\tlr 0.000030\n",
      "epoch: [32/60][130/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:44:04\tloss 4.4013 (4.3634)\tacc 25.0000 (25.4567)\tlr 0.000030\n",
      "epoch: [32/60][140/404]\ttime 0.223 (0.228)\tdata 0.000 (0.004)\teta 0:43:56\tloss 4.5086 (4.3632)\tacc 21.8750 (25.5134)\tlr 0.000030\n",
      "epoch: [32/60][150/404]\ttime 0.220 (0.227)\tdata 0.000 (0.004)\teta 0:43:50\tloss 4.4034 (4.3681)\tacc 15.6250 (25.3125)\tlr 0.000030\n",
      "epoch: [32/60][160/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:43:43\tloss 4.1483 (4.3710)\tacc 28.1250 (25.1953)\tlr 0.000030\n",
      "epoch: [32/60][170/404]\ttime 0.218 (0.227)\tdata 0.000 (0.003)\teta 0:43:37\tloss 4.3075 (4.3685)\tacc 18.7500 (25.2757)\tlr 0.000030\n",
      "epoch: [32/60][180/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:43:30\tloss 3.4031 (4.3591)\tacc 50.0000 (25.5729)\tlr 0.000030\n",
      "epoch: [32/60][190/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:43:26\tloss 4.2924 (4.3619)\tacc 28.1250 (25.5263)\tlr 0.000030\n",
      "epoch: [32/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:43:22\tloss 4.6149 (4.3579)\tacc 28.1250 (25.7031)\tlr 0.000030\n",
      "epoch: [32/60][210/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:43:16\tloss 4.4249 (4.3580)\tacc 15.6250 (25.6696)\tlr 0.000030\n",
      "epoch: [32/60][220/404]\ttime 0.219 (0.225)\tdata 0.000 (0.003)\teta 0:43:11\tloss 4.2638 (4.3541)\tacc 12.5000 (25.8239)\tlr 0.000030\n",
      "epoch: [32/60][230/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:43:07\tloss 4.7275 (4.3557)\tacc 12.5000 (25.8152)\tlr 0.000030\n",
      "epoch: [32/60][240/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:43:03\tloss 4.2026 (4.3568)\tacc 28.1250 (25.8594)\tlr 0.000030\n",
      "epoch: [32/60][250/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:42:59\tloss 4.6037 (4.3583)\tacc 28.1250 (25.8625)\tlr 0.000030\n",
      "epoch: [32/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:42:55\tloss 4.3650 (4.3615)\tacc 21.8750 (25.7812)\tlr 0.000030\n",
      "epoch: [32/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:42:52\tloss 3.8057 (4.3557)\tacc 34.3750 (25.7407)\tlr 0.000030\n",
      "epoch: [32/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:42:48\tloss 4.4248 (4.3513)\tacc 28.1250 (25.7812)\tlr 0.000030\n",
      "epoch: [32/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:42:45\tloss 4.7960 (4.3491)\tacc 12.5000 (25.8297)\tlr 0.000030\n",
      "epoch: [32/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:42:42\tloss 4.1197 (4.3468)\tacc 25.0000 (25.8750)\tlr 0.000030\n",
      "epoch: [32/60][310/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:42:39\tloss 4.4055 (4.3477)\tacc 25.0000 (25.8569)\tlr 0.000030\n",
      "epoch: [32/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:42:36\tloss 4.2842 (4.3456)\tacc 37.5000 (25.8789)\tlr 0.000030\n",
      "epoch: [32/60][330/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:42:33\tloss 4.6092 (4.3460)\tacc 21.8750 (25.8617)\tlr 0.000030\n",
      "epoch: [32/60][340/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:42:31\tloss 4.2465 (4.3438)\tacc 25.0000 (25.7904)\tlr 0.000030\n",
      "epoch: [32/60][350/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:42:28\tloss 4.2334 (4.3427)\tacc 25.0000 (25.8214)\tlr 0.000030\n",
      "epoch: [32/60][360/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:42:25\tloss 4.0723 (4.3407)\tacc 28.1250 (25.8594)\tlr 0.000030\n",
      "epoch: [32/60][370/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:42:22\tloss 4.1705 (4.3391)\tacc 18.7500 (25.9375)\tlr 0.000030\n",
      "epoch: [32/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:42:20\tloss 4.1251 (4.3361)\tacc 28.1250 (25.9868)\tlr 0.000030\n",
      "epoch: [32/60][390/404]\ttime 0.226 (0.224)\tdata 0.000 (0.001)\teta 0:42:17\tloss 3.8743 (4.3333)\tacc 31.2500 (25.9535)\tlr 0.000030\n",
      "epoch: [32/60][400/404]\ttime 0.218 (0.224)\tdata 0.000 (0.001)\teta 0:42:14\tloss 4.1008 (4.3334)\tacc 28.1250 (25.9375)\tlr 0.000030\n",
      "epoch: [33/60][10/404]\ttime 0.220 (0.282)\tdata 0.000 (0.054)\teta 0:53:06\tloss 4.4843 (4.2376)\tacc 18.7500 (28.1250)\tlr 0.000030\n",
      "epoch: [33/60][20/404]\ttime 0.222 (0.252)\tdata 0.000 (0.027)\teta 0:47:23\tloss 4.1595 (4.2498)\tacc 25.0000 (27.6562)\tlr 0.000030\n",
      "epoch: [33/60][30/404]\ttime 0.225 (0.242)\tdata 0.000 (0.018)\teta 0:45:31\tloss 4.3758 (4.2512)\tacc 25.0000 (28.4375)\tlr 0.000030\n",
      "epoch: [33/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.013)\teta 0:44:32\tloss 4.2946 (4.2593)\tacc 31.2500 (28.4375)\tlr 0.000030\n",
      "epoch: [33/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.011)\teta 0:43:57\tloss 4.2093 (4.2621)\tacc 31.2500 (28.8750)\tlr 0.000030\n",
      "epoch: [33/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.009)\teta 0:43:32\tloss 4.0738 (4.2483)\tacc 34.3750 (28.8542)\tlr 0.000030\n",
      "epoch: [33/60][70/404]\ttime 0.225 (0.231)\tdata 0.000 (0.008)\teta 0:43:14\tloss 4.1472 (4.2336)\tacc 34.3750 (29.1518)\tlr 0.000030\n",
      "epoch: [33/60][80/404]\ttime 0.222 (0.230)\tdata 0.000 (0.007)\teta 0:43:01\tloss 3.9246 (4.2319)\tacc 28.1250 (28.9844)\tlr 0.000030\n",
      "epoch: [33/60][90/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:42:49\tloss 4.3086 (4.2357)\tacc 21.8750 (28.7500)\tlr 0.000030\n",
      "epoch: [33/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.005)\teta 0:42:40\tloss 4.3713 (4.2407)\tacc 31.2500 (28.2812)\tlr 0.000030\n",
      "epoch: [33/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:42:32\tloss 4.2694 (4.2459)\tacc 18.7500 (28.1818)\tlr 0.000030\n",
      "epoch: [33/60][120/404]\ttime 0.224 (0.227)\tdata 0.000 (0.005)\teta 0:42:24\tloss 5.0085 (4.2608)\tacc 21.8750 (27.8646)\tlr 0.000030\n",
      "epoch: [33/60][130/404]\ttime 0.220 (0.227)\tdata 0.000 (0.004)\teta 0:42:17\tloss 4.1039 (4.2612)\tacc 34.3750 (27.7644)\tlr 0.000030\n",
      "epoch: [33/60][140/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:42:10\tloss 4.3251 (4.2597)\tacc 18.7500 (27.6339)\tlr 0.000030\n",
      "epoch: [33/60][150/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:42:05\tloss 4.1580 (4.2520)\tacc 25.0000 (27.8542)\tlr 0.000030\n",
      "epoch: [33/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:42:01\tloss 4.0852 (4.2550)\tacc 25.0000 (27.8320)\tlr 0.000030\n",
      "epoch: [33/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:41:56\tloss 3.8441 (4.2552)\tacc 28.1250 (27.6287)\tlr 0.000030\n",
      "epoch: [33/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:41:52\tloss 3.8981 (4.2542)\tacc 40.6250 (27.6910)\tlr 0.000030\n",
      "epoch: [33/60][190/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:41:47\tloss 4.1870 (4.2559)\tacc 37.5000 (27.6809)\tlr 0.000030\n",
      "epoch: [33/60][200/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:41:43\tloss 4.8949 (4.2545)\tacc 18.7500 (27.7812)\tlr 0.000030\n",
      "epoch: [33/60][210/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:41:38\tloss 4.1726 (4.2541)\tacc 31.2500 (27.8720)\tlr 0.000030\n",
      "epoch: [33/60][220/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:41:35\tloss 4.2007 (4.2540)\tacc 21.8750 (27.7699)\tlr 0.000030\n",
      "epoch: [33/60][230/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:41:32\tloss 3.8240 (4.2590)\tacc 34.3750 (27.7174)\tlr 0.000030\n",
      "epoch: [33/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:41:28\tloss 3.8829 (4.2556)\tacc 43.7500 (27.8516)\tlr 0.000030\n",
      "epoch: [33/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:41:25\tloss 4.0198 (4.2579)\tacc 21.8750 (27.6875)\tlr 0.000030\n",
      "epoch: [33/60][260/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:41:21\tloss 4.1077 (4.2572)\tacc 31.2500 (27.7404)\tlr 0.000030\n",
      "epoch: [33/60][270/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:41:18\tloss 4.1909 (4.2549)\tacc 25.0000 (27.7778)\tlr 0.000030\n",
      "epoch: [33/60][280/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:41:15\tloss 4.5529 (4.2605)\tacc 21.8750 (27.6228)\tlr 0.000030\n",
      "epoch: [33/60][290/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:41:12\tloss 4.2828 (4.2620)\tacc 25.0000 (27.6509)\tlr 0.000030\n",
      "epoch: [33/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:41:09\tloss 4.2775 (4.2622)\tacc 28.1250 (27.6146)\tlr 0.000030\n",
      "epoch: [33/60][310/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:41:05\tloss 3.8749 (4.2617)\tacc 43.7500 (27.7319)\tlr 0.000030\n",
      "epoch: [33/60][320/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:41:02\tloss 4.0738 (4.2603)\tacc 37.5000 (27.8027)\tlr 0.000030\n",
      "epoch: [33/60][330/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:40:59\tloss 4.1558 (4.2617)\tacc 34.3750 (27.8125)\tlr 0.000030\n",
      "epoch: [33/60][340/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:40:56\tloss 4.3897 (4.2619)\tacc 28.1250 (27.8401)\tlr 0.000030\n",
      "epoch: [33/60][350/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:40:54\tloss 4.7238 (4.2620)\tacc 21.8750 (27.8304)\tlr 0.000030\n",
      "epoch: [33/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:40:51\tloss 4.1680 (4.2655)\tacc 37.5000 (27.7170)\tlr 0.000030\n",
      "epoch: [33/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:40:48\tloss 4.4526 (4.2634)\tacc 15.6250 (27.7618)\tlr 0.000030\n",
      "epoch: [33/60][380/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:40:46\tloss 4.3607 (4.2649)\tacc 31.2500 (27.6480)\tlr 0.000030\n",
      "epoch: [33/60][390/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:40:43\tloss 3.9843 (4.2672)\tacc 31.2500 (27.6122)\tlr 0.000030\n",
      "epoch: [33/60][400/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:40:41\tloss 4.3395 (4.2677)\tacc 21.8750 (27.5703)\tlr 0.000030\n",
      "epoch: [34/60][10/404]\ttime 0.221 (0.278)\tdata 0.000 (0.055)\teta 0:50:28\tloss 4.4575 (4.1687)\tacc 37.5000 (32.1875)\tlr 0.000030\n",
      "epoch: [34/60][20/404]\ttime 0.225 (0.250)\tdata 0.000 (0.027)\teta 0:45:24\tloss 4.2149 (4.1463)\tacc 37.5000 (30.6250)\tlr 0.000030\n",
      "epoch: [34/60][30/404]\ttime 0.222 (0.241)\tdata 0.000 (0.018)\teta 0:43:41\tloss 4.4588 (4.1959)\tacc 34.3750 (30.0000)\tlr 0.000030\n",
      "epoch: [34/60][40/404]\ttime 0.224 (0.236)\tdata 0.000 (0.014)\teta 0:42:49\tloss 4.3247 (4.1941)\tacc 28.1250 (30.2344)\tlr 0.000030\n",
      "epoch: [34/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.011)\teta 0:42:17\tloss 4.0490 (4.1829)\tacc 28.1250 (30.4375)\tlr 0.000030\n",
      "epoch: [34/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.009)\teta 0:41:54\tloss 3.6632 (4.1842)\tacc 40.6250 (29.7917)\tlr 0.000030\n",
      "epoch: [34/60][70/404]\ttime 0.224 (0.230)\tdata 0.000 (0.008)\teta 0:41:38\tloss 4.3489 (4.1995)\tacc 37.5000 (29.6429)\tlr 0.000030\n",
      "epoch: [34/60][80/404]\ttime 0.221 (0.229)\tdata 0.000 (0.007)\teta 0:41:24\tloss 4.3164 (4.2162)\tacc 28.1250 (28.9453)\tlr 0.000030\n",
      "epoch: [34/60][90/404]\ttime 0.222 (0.229)\tdata 0.000 (0.006)\teta 0:41:13\tloss 4.4698 (4.2238)\tacc 18.7500 (28.7153)\tlr 0.000030\n",
      "epoch: [34/60][100/404]\ttime 0.228 (0.228)\tdata 0.000 (0.006)\teta 0:41:06\tloss 3.7108 (4.2254)\tacc 40.6250 (28.8438)\tlr 0.000030\n",
      "epoch: [34/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:40:58\tloss 4.4079 (4.2280)\tacc 12.5000 (29.0341)\tlr 0.000030\n",
      "epoch: [34/60][120/404]\ttime 0.223 (0.227)\tdata 0.000 (0.005)\teta 0:40:51\tloss 3.9240 (4.2193)\tacc 46.8750 (29.4271)\tlr 0.000030\n",
      "epoch: [34/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:40:45\tloss 4.2039 (4.2159)\tacc 31.2500 (29.5913)\tlr 0.000030\n",
      "epoch: [34/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:40:40\tloss 4.2699 (4.2163)\tacc 21.8750 (29.3973)\tlr 0.000030\n",
      "epoch: [34/60][150/404]\ttime 0.226 (0.226)\tdata 0.000 (0.004)\teta 0:40:36\tloss 4.0526 (4.2168)\tacc 31.2500 (29.4375)\tlr 0.000030\n",
      "epoch: [34/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.004)\teta 0:40:31\tloss 4.2378 (4.2171)\tacc 15.6250 (29.3945)\tlr 0.000030\n",
      "epoch: [34/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:40:26\tloss 4.2719 (4.2174)\tacc 25.0000 (29.2647)\tlr 0.000030\n",
      "epoch: [34/60][180/404]\ttime 0.226 (0.226)\tdata 0.000 (0.003)\teta 0:40:22\tloss 3.9916 (4.2133)\tacc 34.3750 (29.2361)\tlr 0.000030\n",
      "epoch: [34/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:40:19\tloss 3.7273 (4.2127)\tacc 34.3750 (29.0625)\tlr 0.000030\n",
      "epoch: [34/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:40:15\tloss 4.4556 (4.2143)\tacc 28.1250 (28.9688)\tlr 0.000030\n",
      "epoch: [34/60][210/404]\ttime 0.225 (0.225)\tdata 0.000 (0.003)\teta 0:40:12\tloss 3.9367 (4.2149)\tacc 34.3750 (28.9435)\tlr 0.000030\n",
      "epoch: [34/60][220/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:40:08\tloss 4.2095 (4.2184)\tacc 28.1250 (28.9205)\tlr 0.000030\n",
      "epoch: [34/60][230/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:40:05\tloss 4.8171 (4.2190)\tacc 15.6250 (28.9538)\tlr 0.000030\n",
      "epoch: [34/60][240/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:40:02\tloss 4.4469 (4.2225)\tacc 28.1250 (28.8542)\tlr 0.000030\n",
      "epoch: [34/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:39:59\tloss 4.0292 (4.2214)\tacc 43.7500 (28.9125)\tlr 0.000030\n",
      "epoch: [34/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:39:55\tloss 3.8186 (4.2183)\tacc 34.3750 (29.0024)\tlr 0.000030\n",
      "epoch: [34/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:39:52\tloss 4.1821 (4.2193)\tacc 34.3750 (29.0162)\tlr 0.000030\n",
      "epoch: [34/60][280/404]\ttime 0.226 (0.225)\tdata 0.000 (0.002)\teta 0:39:48\tloss 3.9619 (4.2222)\tacc 34.3750 (28.9844)\tlr 0.000030\n",
      "epoch: [34/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:39:45\tloss 3.7873 (4.2181)\tacc 37.5000 (29.0841)\tlr 0.000030\n",
      "epoch: [34/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:39:42\tloss 4.4145 (4.2207)\tacc 25.0000 (29.0417)\tlr 0.000030\n",
      "epoch: [34/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:39:39\tloss 4.2914 (4.2201)\tacc 25.0000 (28.8710)\tlr 0.000030\n",
      "epoch: [34/60][320/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:39:36\tloss 4.0371 (4.2186)\tacc 31.2500 (28.8574)\tlr 0.000030\n",
      "epoch: [34/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:39:33\tloss 4.4163 (4.2230)\tacc 25.0000 (28.7216)\tlr 0.000030\n",
      "epoch: [34/60][340/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:39:31\tloss 4.5552 (4.2238)\tacc 15.6250 (28.6305)\tlr 0.000030\n",
      "epoch: [34/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:39:28\tloss 4.4265 (4.2269)\tacc 15.6250 (28.5000)\tlr 0.000030\n",
      "epoch: [34/60][360/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:39:25\tloss 4.2075 (4.2251)\tacc 21.8750 (28.5243)\tlr 0.000030\n",
      "epoch: [34/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:39:22\tloss 3.7543 (4.2227)\tacc 31.2500 (28.5642)\tlr 0.000030\n",
      "epoch: [34/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:39:20\tloss 4.6124 (4.2236)\tacc 15.6250 (28.5938)\tlr 0.000030\n",
      "epoch: [34/60][390/404]\ttime 0.226 (0.224)\tdata 0.000 (0.001)\teta 0:39:17\tloss 3.8971 (4.2243)\tacc 34.3750 (28.5897)\tlr 0.000030\n",
      "epoch: [34/60][400/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:39:14\tloss 4.0657 (4.2240)\tacc 25.0000 (28.6406)\tlr 0.000030\n",
      "epoch: [35/60][10/404]\ttime 0.220 (0.278)\tdata 0.000 (0.052)\teta 0:48:39\tloss 4.3736 (4.1305)\tacc 31.2500 (28.4375)\tlr 0.000030\n",
      "epoch: [35/60][20/404]\ttime 0.224 (0.250)\tdata 0.000 (0.026)\teta 0:43:46\tloss 4.0751 (4.1727)\tacc 28.1250 (28.5938)\tlr 0.000030\n",
      "epoch: [35/60][30/404]\ttime 0.225 (0.241)\tdata 0.000 (0.017)\teta 0:42:05\tloss 4.3379 (4.2358)\tacc 28.1250 (26.0417)\tlr 0.000030\n",
      "epoch: [35/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.013)\teta 0:41:19\tloss 4.0022 (4.1878)\tacc 43.7500 (28.1250)\tlr 0.000030\n",
      "epoch: [35/60][50/404]\ttime 0.221 (0.234)\tdata 0.000 (0.010)\teta 0:40:46\tloss 4.1581 (4.1926)\tacc 21.8750 (27.9375)\tlr 0.000030\n",
      "epoch: [35/60][60/404]\ttime 0.219 (0.232)\tdata 0.000 (0.009)\teta 0:40:24\tloss 4.4476 (4.1785)\tacc 21.8750 (28.6979)\tlr 0.000030\n",
      "epoch: [35/60][70/404]\ttime 0.224 (0.231)\tdata 0.000 (0.007)\teta 0:40:10\tloss 3.8823 (4.1833)\tacc 34.3750 (29.1071)\tlr 0.000030\n",
      "epoch: [35/60][80/404]\ttime 0.222 (0.230)\tdata 0.000 (0.007)\teta 0:39:56\tloss 4.0836 (4.1910)\tacc 28.1250 (29.2969)\tlr 0.000030\n",
      "epoch: [35/60][90/404]\ttime 0.224 (0.229)\tdata 0.000 (0.006)\teta 0:39:46\tloss 4.2839 (4.1956)\tacc 21.8750 (29.1667)\tlr 0.000030\n",
      "epoch: [35/60][100/404]\ttime 0.224 (0.229)\tdata 0.000 (0.005)\teta 0:39:38\tloss 3.6918 (4.1874)\tacc 43.7500 (29.5625)\tlr 0.000030\n",
      "epoch: [35/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:39:30\tloss 4.0291 (4.1887)\tacc 28.1250 (29.5455)\tlr 0.000030\n",
      "epoch: [35/60][120/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:39:23\tloss 4.1872 (4.1969)\tacc 31.2500 (29.4792)\tlr 0.000030\n",
      "epoch: [35/60][130/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:39:17\tloss 4.2991 (4.1938)\tacc 21.8750 (29.5192)\tlr 0.000030\n",
      "epoch: [35/60][140/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:39:11\tloss 3.8524 (4.1943)\tacc 34.3750 (29.2857)\tlr 0.000030\n",
      "epoch: [35/60][150/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:39:06\tloss 4.5086 (4.1935)\tacc 25.0000 (29.3333)\tlr 0.000030\n",
      "epoch: [35/60][160/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:39:01\tloss 4.3908 (4.1917)\tacc 21.8750 (29.3945)\tlr 0.000030\n",
      "epoch: [35/60][170/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:38:58\tloss 4.3150 (4.1918)\tacc 31.2500 (29.3199)\tlr 0.000030\n",
      "epoch: [35/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:38:54\tloss 4.1395 (4.1877)\tacc 25.0000 (29.2535)\tlr 0.000030\n",
      "epoch: [35/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:38:50\tloss 4.3103 (4.1869)\tacc 18.7500 (29.3421)\tlr 0.000030\n",
      "epoch: [35/60][200/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:38:46\tloss 4.4698 (4.1856)\tacc 25.0000 (29.1719)\tlr 0.000030\n",
      "epoch: [35/60][210/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:38:42\tloss 4.4745 (4.1859)\tacc 25.0000 (29.1667)\tlr 0.000030\n",
      "epoch: [35/60][220/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:38:38\tloss 4.4555 (4.1797)\tacc 18.7500 (29.3040)\tlr 0.000030\n",
      "epoch: [35/60][230/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:38:35\tloss 3.7932 (4.1781)\tacc 31.2500 (29.3478)\tlr 0.000030\n",
      "epoch: [35/60][240/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:38:32\tloss 4.2485 (4.1766)\tacc 31.2500 (29.4271)\tlr 0.000030\n",
      "epoch: [35/60][250/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:38:29\tloss 4.1500 (4.1790)\tacc 31.2500 (29.3125)\tlr 0.000030\n",
      "epoch: [35/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:38:25\tloss 4.2670 (4.1835)\tacc 28.1250 (29.1827)\tlr 0.000030\n",
      "epoch: [35/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:38:22\tloss 4.3864 (4.1810)\tacc 12.5000 (29.2593)\tlr 0.000030\n",
      "epoch: [35/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:38:19\tloss 4.2965 (4.1786)\tacc 25.0000 (29.2188)\tlr 0.000030\n",
      "epoch: [35/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:38:16\tloss 3.8973 (4.1764)\tacc 40.6250 (29.3966)\tlr 0.000030\n",
      "epoch: [35/60][300/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:38:13\tloss 4.3155 (4.1771)\tacc 15.6250 (29.3854)\tlr 0.000030\n",
      "epoch: [35/60][310/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:38:10\tloss 4.8532 (4.1845)\tacc 18.7500 (29.3347)\tlr 0.000030\n",
      "epoch: [35/60][320/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:38:07\tloss 4.1697 (4.1829)\tacc 28.1250 (29.3555)\tlr 0.000030\n",
      "epoch: [35/60][330/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:38:04\tloss 4.5237 (4.1838)\tacc 18.7500 (29.2330)\tlr 0.000030\n",
      "epoch: [35/60][340/404]\ttime 0.222 (0.225)\tdata 0.001 (0.002)\teta 0:38:01\tloss 4.6407 (4.1864)\tacc 18.7500 (29.1728)\tlr 0.000030\n",
      "epoch: [35/60][350/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:37:59\tloss 4.0531 (4.1845)\tacc 37.5000 (29.3482)\tlr 0.000030\n",
      "epoch: [35/60][360/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:37:56\tloss 4.1681 (4.1813)\tacc 25.0000 (29.4010)\tlr 0.000030\n",
      "epoch: [35/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:37:53\tloss 4.0467 (4.1852)\tacc 40.6250 (29.3497)\tlr 0.000030\n",
      "epoch: [35/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:37:50\tloss 4.1146 (4.1837)\tacc 28.1250 (29.3914)\tlr 0.000030\n",
      "epoch: [35/60][390/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:37:47\tloss 4.2232 (4.1820)\tacc 21.8750 (29.4151)\tlr 0.000030\n",
      "epoch: [35/60][400/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:37:45\tloss 4.1736 (4.1864)\tacc 28.1250 (29.2266)\tlr 0.000030\n",
      "epoch: [36/60][10/404]\ttime 0.224 (0.276)\tdata 0.000 (0.048)\teta 0:46:29\tloss 4.4170 (4.1467)\tacc 25.0000 (32.1875)\tlr 0.000030\n",
      "epoch: [36/60][20/404]\ttime 0.225 (0.249)\tdata 0.000 (0.024)\teta 0:41:54\tloss 3.9274 (4.1655)\tacc 37.5000 (31.8750)\tlr 0.000030\n",
      "epoch: [36/60][30/404]\ttime 0.223 (0.241)\tdata 0.000 (0.016)\teta 0:40:25\tloss 4.2834 (4.1645)\tacc 21.8750 (30.0000)\tlr 0.000030\n",
      "epoch: [36/60][40/404]\ttime 0.220 (0.236)\tdata 0.000 (0.012)\teta 0:39:37\tloss 4.0430 (4.1531)\tacc 34.3750 (30.9375)\tlr 0.000030\n",
      "epoch: [36/60][50/404]\ttime 0.223 (0.234)\tdata 0.000 (0.010)\teta 0:39:07\tloss 4.0929 (4.1519)\tacc 28.1250 (30.8125)\tlr 0.000030\n",
      "epoch: [36/60][60/404]\ttime 0.221 (0.232)\tdata 0.000 (0.008)\teta 0:38:46\tloss 4.1513 (4.1204)\tacc 31.2500 (31.0938)\tlr 0.000030\n",
      "epoch: [36/60][70/404]\ttime 0.223 (0.230)\tdata 0.000 (0.007)\teta 0:38:31\tloss 4.4896 (4.1325)\tacc 18.7500 (31.0268)\tlr 0.000030\n",
      "epoch: [36/60][80/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:38:19\tloss 3.8578 (4.1361)\tacc 31.2500 (31.1719)\tlr 0.000030\n",
      "epoch: [36/60][90/404]\ttime 0.221 (0.229)\tdata 0.000 (0.005)\teta 0:38:09\tloss 4.0419 (4.1473)\tacc 43.7500 (31.1111)\tlr 0.000030\n",
      "epoch: [36/60][100/404]\ttime 0.221 (0.228)\tdata 0.000 (0.005)\teta 0:38:00\tloss 4.3358 (4.1452)\tacc 28.1250 (31.2188)\tlr 0.000030\n",
      "epoch: [36/60][110/404]\ttime 0.223 (0.228)\tdata 0.000 (0.004)\teta 0:37:53\tloss 4.2643 (4.1559)\tacc 28.1250 (30.9659)\tlr 0.000030\n",
      "epoch: [36/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:37:47\tloss 4.0661 (4.1587)\tacc 18.7500 (30.5729)\tlr 0.000030\n",
      "epoch: [36/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:37:41\tloss 4.2370 (4.1492)\tacc 28.1250 (30.7212)\tlr 0.000030\n",
      "epoch: [36/60][140/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:37:35\tloss 3.7842 (4.1433)\tacc 37.5000 (30.7589)\tlr 0.000030\n",
      "epoch: [36/60][150/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:37:31\tloss 4.4910 (4.1422)\tacc 25.0000 (30.8125)\tlr 0.000030\n",
      "epoch: [36/60][160/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:37:26\tloss 4.1865 (4.1414)\tacc 28.1250 (30.8594)\tlr 0.000030\n",
      "epoch: [36/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:37:22\tloss 3.7354 (4.1412)\tacc 43.7500 (30.8456)\tlr 0.000030\n",
      "epoch: [36/60][180/404]\ttime 0.220 (0.226)\tdata 0.000 (0.003)\teta 0:37:18\tloss 4.3703 (4.1382)\tacc 34.3750 (30.9722)\tlr 0.000030\n",
      "epoch: [36/60][190/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:37:14\tloss 4.4590 (4.1426)\tacc 18.7500 (30.9375)\tlr 0.000030\n",
      "epoch: [36/60][200/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:37:11\tloss 3.7538 (4.1388)\tacc 46.8750 (30.8906)\tlr 0.000030\n",
      "epoch: [36/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:37:07\tloss 3.9844 (4.1338)\tacc 28.1250 (30.8929)\tlr 0.000030\n",
      "epoch: [36/60][220/404]\ttime 0.226 (0.225)\tdata 0.000 (0.002)\teta 0:37:04\tloss 3.5775 (4.1377)\tacc 46.8750 (30.6960)\tlr 0.000030\n",
      "epoch: [36/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:37:01\tloss 4.4479 (4.1426)\tacc 31.2500 (30.6114)\tlr 0.000030\n",
      "epoch: [36/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:36:57\tloss 4.0152 (4.1450)\tacc 31.2500 (30.5729)\tlr 0.000030\n",
      "epoch: [36/60][250/404]\ttime 0.226 (0.225)\tdata 0.000 (0.002)\teta 0:36:55\tloss 4.2234 (4.1432)\tacc 34.3750 (30.6500)\tlr 0.000030\n",
      "epoch: [36/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:36:52\tloss 4.2735 (4.1469)\tacc 21.8750 (30.5048)\tlr 0.000030\n",
      "epoch: [36/60][270/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:36:49\tloss 4.2781 (4.1440)\tacc 25.0000 (30.6134)\tlr 0.000030\n",
      "epoch: [36/60][280/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:36:46\tloss 3.9175 (4.1430)\tacc 43.7500 (30.5246)\tlr 0.000030\n",
      "epoch: [36/60][290/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:36:43\tloss 3.9771 (4.1434)\tacc 31.2500 (30.4418)\tlr 0.000030\n",
      "epoch: [36/60][300/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:36:40\tloss 4.4999 (4.1407)\tacc 25.0000 (30.5104)\tlr 0.000030\n",
      "epoch: [36/60][310/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:36:37\tloss 4.4560 (4.1411)\tacc 31.2500 (30.6149)\tlr 0.000030\n",
      "epoch: [36/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:36:35\tloss 4.3187 (4.1428)\tacc 34.3750 (30.5664)\tlr 0.000030\n",
      "epoch: [36/60][330/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:36:32\tloss 4.4958 (4.1436)\tacc 21.8750 (30.5303)\tlr 0.000030\n",
      "epoch: [36/60][340/404]\ttime 0.229 (0.224)\tdata 0.000 (0.001)\teta 0:36:29\tloss 4.1104 (4.1469)\tacc 31.2500 (30.4228)\tlr 0.000030\n",
      "epoch: [36/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:36:27\tloss 4.0049 (4.1485)\tacc 46.8750 (30.3482)\tlr 0.000030\n",
      "epoch: [36/60][360/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:36:24\tloss 4.1805 (4.1471)\tacc 34.3750 (30.3472)\tlr 0.000030\n",
      "epoch: [36/60][370/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:36:21\tloss 4.2485 (4.1465)\tacc 37.5000 (30.3632)\tlr 0.000030\n",
      "epoch: [36/60][380/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:36:19\tloss 4.3277 (4.1474)\tacc 34.3750 (30.3043)\tlr 0.000030\n",
      "epoch: [36/60][390/404]\ttime 0.226 (0.224)\tdata 0.000 (0.001)\teta 0:36:16\tloss 4.2794 (4.1505)\tacc 28.1250 (30.1282)\tlr 0.000030\n",
      "epoch: [36/60][400/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:36:13\tloss 3.8096 (4.1486)\tacc 34.3750 (30.1875)\tlr 0.000030\n",
      "epoch: [37/60][10/404]\ttime 0.222 (0.276)\tdata 0.000 (0.047)\teta 0:44:37\tloss 4.0135 (4.0650)\tacc 34.3750 (31.5625)\tlr 0.000030\n",
      "epoch: [37/60][20/404]\ttime 0.226 (0.250)\tdata 0.000 (0.024)\teta 0:40:16\tloss 3.8981 (4.0307)\tacc 37.5000 (32.6562)\tlr 0.000030\n",
      "epoch: [37/60][30/404]\ttime 0.222 (0.240)\tdata 0.000 (0.016)\teta 0:38:44\tloss 4.2889 (4.0482)\tacc 25.0000 (32.0833)\tlr 0.000030\n",
      "epoch: [37/60][40/404]\ttime 0.221 (0.236)\tdata 0.000 (0.012)\teta 0:37:58\tloss 4.4990 (4.0657)\tacc 18.7500 (31.7188)\tlr 0.000030\n",
      "epoch: [37/60][50/404]\ttime 0.223 (0.233)\tdata 0.000 (0.010)\teta 0:37:30\tloss 4.2582 (4.0514)\tacc 18.7500 (31.7500)\tlr 0.000030\n",
      "epoch: [37/60][60/404]\ttime 0.227 (0.232)\tdata 0.000 (0.008)\teta 0:37:10\tloss 4.0173 (4.0564)\tacc 31.2500 (31.3542)\tlr 0.000030\n",
      "epoch: [37/60][70/404]\ttime 0.221 (0.230)\tdata 0.000 (0.007)\teta 0:36:55\tloss 4.1957 (4.0537)\tacc 25.0000 (31.3839)\tlr 0.000030\n",
      "epoch: [37/60][80/404]\ttime 0.225 (0.229)\tdata 0.000 (0.006)\teta 0:36:44\tloss 3.7832 (4.0617)\tacc 37.5000 (31.0156)\tlr 0.000030\n",
      "epoch: [37/60][90/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:36:34\tloss 4.0179 (4.0628)\tacc 31.2500 (31.5625)\tlr 0.000030\n",
      "epoch: [37/60][100/404]\ttime 0.226 (0.228)\tdata 0.000 (0.005)\teta 0:36:27\tloss 4.1405 (4.0773)\tacc 40.6250 (31.5000)\tlr 0.000030\n",
      "epoch: [37/60][110/404]\ttime 0.221 (0.228)\tdata 0.000 (0.004)\teta 0:36:20\tloss 4.3414 (4.0948)\tacc 31.2500 (31.1648)\tlr 0.000030\n",
      "epoch: [37/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:36:14\tloss 3.5001 (4.0962)\tacc 50.0000 (30.9896)\tlr 0.000030\n",
      "epoch: [37/60][130/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:36:09\tloss 4.2572 (4.0960)\tacc 28.1250 (30.9375)\tlr 0.000030\n",
      "epoch: [37/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:36:04\tloss 3.8621 (4.0955)\tacc 43.7500 (31.0268)\tlr 0.000030\n",
      "epoch: [37/60][150/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:36:00\tloss 3.9651 (4.0997)\tacc 37.5000 (30.8125)\tlr 0.000030\n",
      "epoch: [37/60][160/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:35:56\tloss 4.3175 (4.1032)\tacc 21.8750 (30.7812)\tlr 0.000030\n",
      "epoch: [37/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:35:52\tloss 3.9734 (4.1063)\tacc 40.6250 (30.8272)\tlr 0.000030\n",
      "epoch: [37/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:35:48\tloss 4.1074 (4.1096)\tacc 28.1250 (30.8333)\tlr 0.000030\n",
      "epoch: [37/60][190/404]\ttime 0.227 (0.226)\tdata 0.000 (0.003)\teta 0:35:45\tloss 4.5308 (4.1107)\tacc 18.7500 (30.7401)\tlr 0.000030\n",
      "epoch: [37/60][200/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:35:41\tloss 4.1686 (4.1178)\tacc 21.8750 (30.5312)\tlr 0.000030\n",
      "epoch: [37/60][210/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:35:38\tloss 4.0465 (4.1170)\tacc 25.0000 (30.4613)\tlr 0.000030\n",
      "epoch: [37/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:34\tloss 3.7379 (4.1122)\tacc 46.8750 (30.7102)\tlr 0.000030\n",
      "epoch: [37/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:31\tloss 4.1597 (4.1122)\tacc 37.5000 (30.7473)\tlr 0.000030\n",
      "epoch: [37/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:28\tloss 3.7605 (4.1124)\tacc 28.1250 (30.7031)\tlr 0.000030\n",
      "epoch: [37/60][250/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:35:25\tloss 4.2583 (4.1120)\tacc 25.0000 (30.7625)\tlr 0.000030\n",
      "epoch: [37/60][260/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:35:22\tloss 3.9073 (4.1103)\tacc 31.2500 (30.9135)\tlr 0.000030\n",
      "epoch: [37/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:19\tloss 4.1824 (4.1115)\tacc 21.8750 (30.8449)\tlr 0.000030\n",
      "epoch: [37/60][280/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:16\tloss 4.2315 (4.1157)\tacc 25.0000 (30.8259)\tlr 0.000030\n",
      "epoch: [37/60][290/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:35:14\tloss 4.2699 (4.1171)\tacc 25.0000 (30.7543)\tlr 0.000030\n",
      "epoch: [37/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:11\tloss 4.4811 (4.1159)\tacc 25.0000 (30.7396)\tlr 0.000030\n",
      "epoch: [37/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:35:08\tloss 3.8896 (4.1204)\tacc 37.5000 (30.6653)\tlr 0.000030\n",
      "epoch: [37/60][320/404]\ttime 0.226 (0.225)\tdata 0.000 (0.002)\teta 0:35:05\tloss 3.7123 (4.1231)\tacc 31.2500 (30.4785)\tlr 0.000030\n",
      "epoch: [37/60][330/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:35:02\tloss 4.0129 (4.1208)\tacc 37.5000 (30.5871)\tlr 0.000030\n",
      "epoch: [37/60][340/404]\ttime 0.225 (0.224)\tdata 0.000 (0.001)\teta 0:35:00\tloss 4.2812 (4.1264)\tacc 28.1250 (30.5239)\tlr 0.000030\n",
      "epoch: [37/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:34:57\tloss 4.0364 (4.1239)\tacc 34.3750 (30.5625)\tlr 0.000030\n",
      "epoch: [37/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:34:55\tloss 3.9717 (4.1227)\tacc 37.5000 (30.5469)\tlr 0.000030\n",
      "epoch: [37/60][370/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:34:53\tloss 3.6677 (4.1196)\tacc 34.3750 (30.5997)\tlr 0.000030\n",
      "epoch: [37/60][380/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:34:51\tloss 3.7670 (4.1161)\tacc 37.5000 (30.6990)\tlr 0.000030\n",
      "epoch: [37/60][390/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:34:48\tloss 3.9459 (4.1170)\tacc 34.3750 (30.6891)\tlr 0.000030\n",
      "epoch: [37/60][400/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:34:46\tloss 4.3549 (4.1129)\tacc 31.2500 (30.7891)\tlr 0.000030\n",
      "epoch: [38/60][10/404]\ttime 0.223 (0.272)\tdata 0.000 (0.048)\teta 0:42:09\tloss 4.0342 (4.1664)\tacc 37.5000 (30.9375)\tlr 0.000030\n",
      "epoch: [38/60][20/404]\ttime 0.223 (0.248)\tdata 0.000 (0.024)\teta 0:38:16\tloss 3.7423 (4.1037)\tacc 31.2500 (30.7812)\tlr 0.000030\n",
      "epoch: [38/60][30/404]\ttime 0.223 (0.239)\tdata 0.000 (0.016)\teta 0:36:56\tloss 4.5779 (4.0985)\tacc 21.8750 (31.6667)\tlr 0.000030\n",
      "epoch: [38/60][40/404]\ttime 0.219 (0.235)\tdata 0.000 (0.012)\teta 0:36:15\tloss 3.5966 (4.0767)\tacc 37.5000 (32.2656)\tlr 0.000030\n",
      "epoch: [38/60][50/404]\ttime 0.222 (0.233)\tdata 0.000 (0.010)\teta 0:35:49\tloss 3.8494 (4.0629)\tacc 28.1250 (32.5000)\tlr 0.000030\n",
      "epoch: [38/60][60/404]\ttime 0.223 (0.231)\tdata 0.000 (0.008)\teta 0:35:31\tloss 3.8463 (4.0458)\tacc 34.3750 (32.6562)\tlr 0.000030\n",
      "epoch: [38/60][70/404]\ttime 0.222 (0.230)\tdata 0.000 (0.007)\teta 0:35:17\tloss 4.1140 (4.0523)\tacc 25.0000 (32.2768)\tlr 0.000030\n",
      "epoch: [38/60][80/404]\ttime 0.224 (0.229)\tdata 0.000 (0.006)\teta 0:35:07\tloss 4.0770 (4.0563)\tacc 25.0000 (32.1484)\tlr 0.000030\n",
      "epoch: [38/60][90/404]\ttime 0.226 (0.228)\tdata 0.000 (0.005)\teta 0:34:59\tloss 4.1961 (4.0788)\tacc 18.7500 (31.4583)\tlr 0.000030\n",
      "epoch: [38/60][100/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:34:52\tloss 4.3041 (4.0761)\tacc 28.1250 (31.6250)\tlr 0.000030\n",
      "epoch: [38/60][110/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:34:46\tloss 3.9912 (4.0721)\tacc 25.0000 (31.5341)\tlr 0.000030\n",
      "epoch: [38/60][120/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:34:40\tloss 3.8906 (4.0797)\tacc 31.2500 (31.1458)\tlr 0.000030\n",
      "epoch: [38/60][130/404]\ttime 0.225 (0.227)\tdata 0.000 (0.004)\teta 0:34:35\tloss 4.0493 (4.0802)\tacc 37.5000 (31.0577)\tlr 0.000030\n",
      "epoch: [38/60][140/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:34:31\tloss 4.2013 (4.0818)\tacc 31.2500 (31.2277)\tlr 0.000030\n",
      "epoch: [38/60][150/404]\ttime 0.227 (0.226)\tdata 0.000 (0.003)\teta 0:34:27\tloss 3.9511 (4.0793)\tacc 46.8750 (31.4167)\tlr 0.000030\n",
      "epoch: [38/60][160/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:34:24\tloss 3.8947 (4.0751)\tacc 28.1250 (31.3086)\tlr 0.000030\n",
      "epoch: [38/60][170/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:34:20\tloss 4.4320 (4.0779)\tacc 15.6250 (31.1397)\tlr 0.000030\n",
      "epoch: [38/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:34:16\tloss 4.3816 (4.0856)\tacc 21.8750 (31.0243)\tlr 0.000030\n",
      "epoch: [38/60][190/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:34:13\tloss 3.9452 (4.0837)\tacc 40.6250 (31.1184)\tlr 0.000030\n",
      "epoch: [38/60][200/404]\ttime 0.220 (0.226)\tdata 0.000 (0.002)\teta 0:34:10\tloss 4.0235 (4.0764)\tacc 40.6250 (31.3125)\tlr 0.000030\n",
      "epoch: [38/60][210/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:34:06\tloss 4.3844 (4.0761)\tacc 28.1250 (31.2946)\tlr 0.000030\n",
      "epoch: [38/60][220/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:34:03\tloss 3.9836 (4.0749)\tacc 43.7500 (31.3210)\tlr 0.000030\n",
      "epoch: [38/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:34:00\tloss 4.0549 (4.0741)\tacc 31.2500 (31.3315)\tlr 0.000030\n",
      "epoch: [38/60][240/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:33:56\tloss 3.6006 (4.0730)\tacc 43.7500 (31.4453)\tlr 0.000030\n",
      "epoch: [38/60][250/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:33:54\tloss 4.0813 (4.0756)\tacc 28.1250 (31.4000)\tlr 0.000030\n",
      "epoch: [38/60][260/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:33:50\tloss 4.6382 (4.0713)\tacc 28.1250 (31.4423)\tlr 0.000030\n",
      "epoch: [38/60][270/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:33:47\tloss 4.1231 (4.0710)\tacc 28.1250 (31.3657)\tlr 0.000030\n",
      "epoch: [38/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:33:44\tloss 4.2735 (4.0738)\tacc 28.1250 (31.3728)\tlr 0.000030\n",
      "epoch: [38/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:33:41\tloss 4.3172 (4.0764)\tacc 28.1250 (31.2823)\tlr 0.000030\n",
      "epoch: [38/60][300/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:33:38\tloss 3.8695 (4.0726)\tacc 37.5000 (31.4062)\tlr 0.000030\n",
      "epoch: [38/60][310/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:33:36\tloss 3.4493 (4.0682)\tacc 46.8750 (31.5121)\tlr 0.000030\n",
      "epoch: [38/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:33:33\tloss 4.0342 (4.0700)\tacc 43.7500 (31.4941)\tlr 0.000030\n",
      "epoch: [38/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:33:30\tloss 4.5154 (4.0736)\tacc 28.1250 (31.4394)\tlr 0.000030\n",
      "epoch: [38/60][340/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:33:28\tloss 4.1232 (4.0751)\tacc 31.2500 (31.4798)\tlr 0.000030\n",
      "epoch: [38/60][350/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:33:25\tloss 4.3337 (4.0743)\tacc 21.8750 (31.4464)\tlr 0.000030\n",
      "epoch: [38/60][360/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:33:22\tloss 4.0602 (4.0726)\tacc 31.2500 (31.5017)\tlr 0.000030\n",
      "epoch: [38/60][370/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:33:20\tloss 4.2397 (4.0759)\tacc 31.2500 (31.3936)\tlr 0.000030\n",
      "epoch: [38/60][380/404]\ttime 0.225 (0.224)\tdata 0.000 (0.001)\teta 0:33:17\tloss 4.1247 (4.0776)\tacc 28.1250 (31.3980)\tlr 0.000030\n",
      "epoch: [38/60][390/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:33:14\tloss 3.9676 (4.0770)\tacc 34.3750 (31.4423)\tlr 0.000030\n",
      "epoch: [38/60][400/404]\ttime 0.219 (0.224)\tdata 0.000 (0.001)\teta 0:33:11\tloss 3.6176 (4.0767)\tacc 56.2500 (31.4766)\tlr 0.000030\n",
      "epoch: [39/60][10/404]\ttime 0.221 (0.276)\tdata 0.000 (0.053)\teta 0:40:52\tloss 3.5546 (3.9443)\tacc 40.6250 (34.3750)\tlr 0.000030\n",
      "epoch: [39/60][20/404]\ttime 0.223 (0.249)\tdata 0.000 (0.026)\teta 0:36:51\tloss 3.9344 (4.0327)\tacc 34.3750 (33.7500)\tlr 0.000030\n",
      "epoch: [39/60][30/404]\ttime 0.222 (0.240)\tdata 0.000 (0.018)\teta 0:35:27\tloss 4.3289 (4.0167)\tacc 21.8750 (33.3333)\tlr 0.000030\n",
      "epoch: [39/60][40/404]\ttime 0.222 (0.236)\tdata 0.000 (0.013)\teta 0:34:47\tloss 3.9073 (4.0409)\tacc 37.5000 (32.8906)\tlr 0.000030\n",
      "epoch: [39/60][50/404]\ttime 0.224 (0.233)\tdata 0.000 (0.011)\teta 0:34:21\tloss 3.9321 (4.0204)\tacc 50.0000 (33.6250)\tlr 0.000030\n",
      "epoch: [39/60][60/404]\ttime 0.221 (0.231)\tdata 0.000 (0.009)\teta 0:34:02\tloss 4.4551 (4.0292)\tacc 21.8750 (33.3854)\tlr 0.000030\n",
      "epoch: [39/60][70/404]\ttime 0.224 (0.230)\tdata 0.000 (0.008)\teta 0:33:49\tloss 4.3154 (4.0360)\tacc 28.1250 (33.4821)\tlr 0.000030\n",
      "epoch: [39/60][80/404]\ttime 0.223 (0.229)\tdata 0.000 (0.007)\teta 0:33:40\tloss 4.4656 (4.0497)\tacc 21.8750 (32.8125)\tlr 0.000030\n",
      "epoch: [39/60][90/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:33:31\tloss 3.7189 (4.0449)\tacc 34.3750 (32.8125)\tlr 0.000030\n",
      "epoch: [39/60][100/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:33:24\tloss 4.0599 (4.0487)\tacc 25.0000 (32.6875)\tlr 0.000030\n",
      "epoch: [39/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:33:17\tloss 3.6823 (4.0348)\tacc 43.7500 (32.8693)\tlr 0.000030\n",
      "epoch: [39/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:33:11\tloss 3.8497 (4.0302)\tacc 37.5000 (32.7344)\tlr 0.000030\n",
      "epoch: [39/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:33:06\tloss 4.1453 (4.0400)\tacc 31.2500 (32.3317)\tlr 0.000030\n",
      "epoch: [39/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:33:01\tloss 4.2069 (4.0375)\tacc 37.5000 (32.4554)\tlr 0.000030\n",
      "epoch: [39/60][150/404]\ttime 0.223 (0.226)\tdata 0.000 (0.004)\teta 0:32:57\tloss 4.2073 (4.0482)\tacc 31.2500 (32.1250)\tlr 0.000030\n",
      "epoch: [39/60][160/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:32:53\tloss 4.0883 (4.0467)\tacc 34.3750 (32.0312)\tlr 0.000030\n",
      "epoch: [39/60][170/404]\ttime 0.226 (0.226)\tdata 0.000 (0.003)\teta 0:32:49\tloss 3.9345 (4.0447)\tacc 37.5000 (32.1324)\tlr 0.000030\n",
      "epoch: [39/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:32:45\tloss 4.0632 (4.0443)\tacc 34.3750 (32.2049)\tlr 0.000030\n",
      "epoch: [39/60][190/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:32:42\tloss 3.9278 (4.0484)\tacc 46.8750 (32.0724)\tlr 0.000030\n",
      "epoch: [39/60][200/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:32:38\tloss 4.3040 (4.0523)\tacc 25.0000 (32.2188)\tlr 0.000030\n",
      "epoch: [39/60][210/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:32:35\tloss 3.9693 (4.0548)\tacc 31.2500 (32.0833)\tlr 0.000030\n",
      "epoch: [39/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:32:31\tloss 4.0235 (4.0499)\tacc 34.3750 (32.2017)\tlr 0.000030\n",
      "epoch: [39/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:32:28\tloss 3.8675 (4.0488)\tacc 34.3750 (32.0788)\tlr 0.000030\n",
      "epoch: [39/60][240/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:32:25\tloss 4.4674 (4.0506)\tacc 28.1250 (32.0573)\tlr 0.000030\n",
      "epoch: [39/60][250/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:32:22\tloss 4.1284 (4.0465)\tacc 28.1250 (32.2750)\tlr 0.000030\n",
      "epoch: [39/60][260/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:32:19\tloss 4.1924 (4.0493)\tacc 25.0000 (32.1635)\tlr 0.000030\n",
      "epoch: [39/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:32:16\tloss 4.6513 (4.0486)\tacc 12.5000 (32.0602)\tlr 0.000030\n",
      "epoch: [39/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:32:13\tloss 4.4686 (4.0470)\tacc 18.7500 (32.1094)\tlr 0.000030\n",
      "epoch: [39/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:32:10\tloss 4.2064 (4.0458)\tacc 15.6250 (32.0043)\tlr 0.000030\n",
      "epoch: [39/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:32:07\tloss 4.2339 (4.0434)\tacc 21.8750 (32.0833)\tlr 0.000030\n",
      "epoch: [39/60][310/404]\ttime 0.226 (0.224)\tdata 0.000 (0.002)\teta 0:32:05\tloss 3.9435 (4.0469)\tacc 34.3750 (31.9758)\tlr 0.000030\n",
      "epoch: [39/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:32:02\tloss 3.8262 (4.0518)\tacc 40.6250 (31.9434)\tlr 0.000030\n",
      "epoch: [39/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:32:00\tloss 4.0728 (4.0514)\tacc 37.5000 (32.0076)\tlr 0.000030\n",
      "epoch: [39/60][340/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:31:57\tloss 3.8153 (4.0512)\tacc 40.6250 (32.0956)\tlr 0.000030\n",
      "epoch: [39/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:31:55\tloss 3.8504 (4.0487)\tacc 40.6250 (32.1964)\tlr 0.000030\n",
      "epoch: [39/60][360/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:31:52\tloss 3.6525 (4.0444)\tacc 43.7500 (32.3524)\tlr 0.000030\n",
      "epoch: [39/60][370/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:31:50\tloss 3.8593 (4.0422)\tacc 31.2500 (32.3986)\tlr 0.000030\n",
      "epoch: [39/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:31:47\tloss 4.2618 (4.0441)\tacc 12.5000 (32.3273)\tlr 0.000030\n",
      "epoch: [39/60][390/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:31:45\tloss 3.8941 (4.0427)\tacc 15.6250 (32.3397)\tlr 0.000030\n",
      "epoch: [39/60][400/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:31:42\tloss 4.1741 (4.0385)\tacc 34.3750 (32.4688)\tlr 0.000030\n",
      "epoch: [40/60][10/404]\ttime 0.225 (0.274)\tdata 0.000 (0.051)\teta 0:38:42\tloss 4.1748 (4.0065)\tacc 31.2500 (31.2500)\tlr 0.000030\n",
      "epoch: [40/60][20/404]\ttime 0.225 (0.248)\tdata 0.000 (0.026)\teta 0:34:59\tloss 3.6459 (3.9383)\tacc 37.5000 (34.2188)\tlr 0.000030\n",
      "epoch: [40/60][30/404]\ttime 0.222 (0.240)\tdata 0.000 (0.017)\teta 0:33:45\tloss 4.7026 (3.9687)\tacc 12.5000 (33.1250)\tlr 0.000030\n",
      "epoch: [40/60][40/404]\ttime 0.222 (0.235)\tdata 0.000 (0.013)\teta 0:33:05\tloss 3.5902 (3.9675)\tacc 34.3750 (34.0625)\tlr 0.000030\n",
      "epoch: [40/60][50/404]\ttime 0.222 (0.233)\tdata 0.000 (0.010)\teta 0:32:41\tloss 3.8340 (3.9734)\tacc 34.3750 (34.5625)\tlr 0.000030\n",
      "epoch: [40/60][60/404]\ttime 0.225 (0.231)\tdata 0.000 (0.009)\teta 0:32:25\tloss 4.0604 (3.9762)\tacc 31.2500 (34.8438)\tlr 0.000030\n",
      "epoch: [40/60][70/404]\ttime 0.220 (0.230)\tdata 0.000 (0.007)\teta 0:32:13\tloss 3.6320 (3.9782)\tacc 31.2500 (34.4196)\tlr 0.000030\n",
      "epoch: [40/60][80/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:32:02\tloss 3.9147 (3.9880)\tacc 46.8750 (34.2969)\tlr 0.000030\n",
      "epoch: [40/60][90/404]\ttime 0.223 (0.228)\tdata 0.000 (0.006)\teta 0:31:54\tloss 4.0649 (4.0032)\tacc 25.0000 (33.6111)\tlr 0.000030\n",
      "epoch: [40/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.005)\teta 0:31:47\tloss 4.0309 (3.9971)\tacc 28.1250 (33.7188)\tlr 0.000030\n",
      "epoch: [40/60][110/404]\ttime 0.223 (0.227)\tdata 0.000 (0.005)\teta 0:31:42\tloss 4.4480 (4.0022)\tacc 28.1250 (33.9205)\tlr 0.000030\n",
      "epoch: [40/60][120/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:31:37\tloss 3.9473 (4.0009)\tacc 28.1250 (33.6979)\tlr 0.000030\n",
      "epoch: [40/60][130/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:31:32\tloss 4.2626 (4.0157)\tacc 31.2500 (33.2933)\tlr 0.000030\n",
      "epoch: [40/60][140/404]\ttime 0.224 (0.226)\tdata 0.000 (0.004)\teta 0:31:27\tloss 3.9821 (4.0079)\tacc 40.6250 (33.5268)\tlr 0.000030\n",
      "epoch: [40/60][150/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:31:23\tloss 4.0276 (4.0092)\tacc 28.1250 (33.5000)\tlr 0.000030\n",
      "epoch: [40/60][160/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:31:19\tloss 3.7188 (4.0032)\tacc 37.5000 (33.6133)\tlr 0.000030\n",
      "epoch: [40/60][170/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:31:15\tloss 3.8074 (3.9962)\tacc 37.5000 (33.7316)\tlr 0.000030\n",
      "epoch: [40/60][180/404]\ttime 0.220 (0.225)\tdata 0.000 (0.003)\teta 0:31:11\tloss 3.9356 (3.9995)\tacc 28.1250 (33.7326)\tlr 0.000030\n",
      "epoch: [40/60][190/404]\ttime 0.224 (0.225)\tdata 0.000 (0.003)\teta 0:31:08\tloss 4.0332 (4.0036)\tacc 31.2500 (33.3882)\tlr 0.000030\n",
      "epoch: [40/60][200/404]\ttime 0.224 (0.225)\tdata 0.000 (0.003)\teta 0:31:04\tloss 4.2362 (4.0033)\tacc 28.1250 (33.4688)\tlr 0.000030\n",
      "epoch: [40/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:31:01\tloss 3.6952 (4.0056)\tacc 46.8750 (33.3185)\tlr 0.000030\n",
      "epoch: [40/60][220/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:30:58\tloss 4.1395 (3.9965)\tacc 31.2500 (33.4659)\tlr 0.000030\n",
      "epoch: [40/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:30:55\tloss 3.7528 (3.9904)\tacc 43.7500 (33.6005)\tlr 0.000030\n",
      "epoch: [40/60][240/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:30:52\tloss 3.6331 (3.9910)\tacc 40.6250 (33.6589)\tlr 0.000030\n",
      "epoch: [40/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:30:49\tloss 3.6127 (3.9906)\tacc 53.1250 (33.7375)\tlr 0.000030\n",
      "epoch: [40/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:30:46\tloss 3.7471 (3.9891)\tacc 34.3750 (33.6899)\tlr 0.000030\n",
      "epoch: [40/60][270/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:30:44\tloss 4.0323 (3.9913)\tacc 40.6250 (33.5648)\tlr 0.000030\n",
      "epoch: [40/60][280/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:30:41\tloss 4.1248 (3.9939)\tacc 34.3750 (33.4598)\tlr 0.000030\n",
      "epoch: [40/60][290/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:30:38\tloss 3.3145 (3.9939)\tacc 43.7500 (33.4375)\tlr 0.000030\n",
      "epoch: [40/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:30:36\tloss 4.1906 (3.9934)\tacc 34.3750 (33.4583)\tlr 0.000030\n",
      "epoch: [40/60][310/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:30:33\tloss 3.8283 (3.9883)\tacc 37.5000 (33.6794)\tlr 0.000030\n",
      "epoch: [40/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:30:30\tloss 3.5524 (3.9876)\tacc 50.0000 (33.7305)\tlr 0.000030\n",
      "epoch: [40/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:30:28\tloss 3.6588 (3.9882)\tacc 37.5000 (33.6837)\tlr 0.000030\n",
      "epoch: [40/60][340/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:30:25\tloss 4.0923 (3.9934)\tacc 25.0000 (33.5110)\tlr 0.000030\n",
      "epoch: [40/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:30:23\tloss 4.1963 (3.9978)\tacc 25.0000 (33.4286)\tlr 0.000030\n",
      "epoch: [40/60][360/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:30:20\tloss 4.4036 (3.9948)\tacc 25.0000 (33.5069)\tlr 0.000030\n",
      "epoch: [40/60][370/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:30:17\tloss 3.9465 (3.9973)\tacc 28.1250 (33.4291)\tlr 0.000030\n",
      "epoch: [40/60][380/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:30:15\tloss 3.6544 (3.9983)\tacc 43.7500 (33.3141)\tlr 0.000030\n",
      "epoch: [40/60][390/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:30:12\tloss 3.6015 (3.9942)\tacc 43.7500 (33.3734)\tlr 0.000030\n",
      "epoch: [40/60][400/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:30:10\tloss 3.7523 (3.9927)\tacc 40.6250 (33.3750)\tlr 0.000030\n",
      "##### Evaluating cv_data (target) #####\n",
      "Extracting features from query set ...\n",
      "Done, obtained 39-by-2048 matrix\n",
      "Extracting features from gallery set ...\n",
      "Done, obtained 180-by-2048 matrix\n",
      "Speed: 0.0087 sec/batch\n",
      "Computing distance matrix with metric=euclidean ...\n"
     ]
    },
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/content/drive/MyDrive/person-reid/deep-person-reid/torchreid/metrics/distance.py:63: UserWarning: This overload of addmm_ is deprecated:\n",
      "\taddmm_(Number beta, Number alpha, Tensor mat1, Tensor mat2)\n",
      "Consider using one of the following signatures instead:\n",
      "\taddmm_(Tensor mat1, Tensor mat2, *, Number beta, Number alpha) (Triggered internally at  /pytorch/torch/csrc/utils/python_arg_parser.cpp:882.)\n",
      "  distmat.addmm_(1, -2, input1, input2.t())\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Computing CMC and mAP ...\n",
      "** Results **\n",
      "mAP: 42.8%\n",
      "CMC curve\n",
      "Rank-1  : 30.8%\n",
      "Rank-5  : 71.8%\n",
      "Rank-10 : 76.9%\n",
      "Rank-20 : 79.5%\n",
      "Checkpoint saved to \"log/test-softmax-market1501-cv-test/model/model.pth.tar-40\"\n",
      "epoch: [41/60][10/404]\ttime 0.219 (0.277)\tdata 0.000 (0.049)\teta 0:37:19\tloss 3.5907 (3.8026)\tacc 37.5000 (36.8750)\tlr 0.000030\n",
      "epoch: [41/60][20/404]\ttime 0.221 (0.248)\tdata 0.000 (0.025)\teta 0:33:21\tloss 3.8814 (3.9135)\tacc 43.7500 (36.0938)\tlr 0.000030\n",
      "epoch: [41/60][30/404]\ttime 0.223 (0.240)\tdata 0.000 (0.016)\teta 0:32:10\tloss 4.0824 (3.9134)\tacc 31.2500 (35.8333)\tlr 0.000030\n",
      "epoch: [41/60][40/404]\ttime 0.224 (0.235)\tdata 0.000 (0.012)\teta 0:31:33\tloss 3.8084 (3.9294)\tacc 31.2500 (35.5469)\tlr 0.000030\n",
      "epoch: [41/60][50/404]\ttime 0.221 (0.233)\tdata 0.000 (0.010)\teta 0:31:09\tloss 4.0004 (3.9463)\tacc 34.3750 (34.3750)\tlr 0.000030\n",
      "epoch: [41/60][60/404]\ttime 0.223 (0.231)\tdata 0.000 (0.008)\teta 0:30:54\tloss 3.5772 (3.9437)\tacc 43.7500 (34.6354)\tlr 0.000030\n",
      "epoch: [41/60][70/404]\ttime 0.223 (0.230)\tdata 0.000 (0.007)\teta 0:30:44\tloss 3.9059 (3.9468)\tacc 31.2500 (34.5982)\tlr 0.000030\n",
      "epoch: [41/60][80/404]\ttime 0.227 (0.230)\tdata 0.000 (0.006)\teta 0:30:36\tloss 3.7829 (3.9454)\tacc 43.7500 (34.3750)\tlr 0.000030\n",
      "epoch: [41/60][90/404]\ttime 0.224 (0.229)\tdata 0.000 (0.006)\teta 0:30:28\tloss 3.8544 (3.9336)\tacc 31.2500 (34.7917)\tlr 0.000030\n",
      "epoch: [41/60][100/404]\ttime 0.226 (0.228)\tdata 0.000 (0.005)\teta 0:30:23\tloss 3.9479 (3.9366)\tacc 37.5000 (34.7188)\tlr 0.000030\n",
      "epoch: [41/60][110/404]\ttime 0.229 (0.228)\tdata 0.000 (0.005)\teta 0:30:18\tloss 4.0916 (3.9335)\tacc 21.8750 (34.4034)\tlr 0.000030\n",
      "epoch: [41/60][120/404]\ttime 0.226 (0.228)\tdata 0.000 (0.004)\teta 0:30:14\tloss 3.3758 (3.9200)\tacc 46.8750 (34.9219)\tlr 0.000030\n",
      "epoch: [41/60][130/404]\ttime 0.227 (0.228)\tdata 0.000 (0.004)\teta 0:30:12\tloss 3.7245 (3.9210)\tacc 40.6250 (34.8558)\tlr 0.000030\n",
      "epoch: [41/60][140/404]\ttime 0.228 (0.228)\tdata 0.000 (0.004)\teta 0:30:10\tloss 4.1561 (3.9146)\tacc 21.8750 (35.0446)\tlr 0.000030\n",
      "epoch: [41/60][150/404]\ttime 0.226 (0.228)\tdata 0.000 (0.003)\teta 0:30:07\tloss 4.1701 (3.9157)\tacc 25.0000 (34.8958)\tlr 0.000030\n",
      "epoch: [41/60][160/404]\ttime 0.224 (0.228)\tdata 0.000 (0.003)\teta 0:30:04\tloss 3.8405 (3.9194)\tacc 25.0000 (34.7070)\tlr 0.000030\n",
      "epoch: [41/60][170/404]\ttime 0.224 (0.228)\tdata 0.000 (0.003)\teta 0:30:01\tloss 4.2915 (3.9209)\tacc 18.7500 (34.6140)\tlr 0.000030\n",
      "epoch: [41/60][180/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:29:57\tloss 4.3673 (3.9316)\tacc 25.0000 (34.4271)\tlr 0.000030\n",
      "epoch: [41/60][190/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:29:53\tloss 3.8832 (3.9332)\tacc 37.5000 (34.4408)\tlr 0.000030\n",
      "epoch: [41/60][200/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:29:49\tloss 3.7972 (3.9324)\tacc 37.5000 (34.3906)\tlr 0.000030\n",
      "epoch: [41/60][210/404]\ttime 0.224 (0.227)\tdata 0.000 (0.002)\teta 0:29:46\tloss 3.9481 (3.9348)\tacc 28.1250 (34.4048)\tlr 0.000030\n",
      "epoch: [41/60][220/404]\ttime 0.222 (0.227)\tdata 0.000 (0.002)\teta 0:29:42\tloss 4.3804 (3.9349)\tacc 40.6250 (34.5312)\tlr 0.000030\n",
      "epoch: [41/60][230/404]\ttime 0.223 (0.227)\tdata 0.000 (0.002)\teta 0:29:38\tloss 4.1763 (3.9383)\tacc 34.3750 (34.3614)\tlr 0.000030\n",
      "epoch: [41/60][240/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:29:34\tloss 3.9669 (3.9433)\tacc 40.6250 (34.2839)\tlr 0.000030\n",
      "epoch: [41/60][250/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:29:31\tloss 3.9676 (3.9462)\tacc 37.5000 (34.1750)\tlr 0.000030\n",
      "epoch: [41/60][260/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:29:28\tloss 3.9702 (3.9544)\tacc 18.7500 (33.9423)\tlr 0.000030\n",
      "epoch: [41/60][270/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:29:24\tloss 4.1362 (3.9559)\tacc 28.1250 (33.8426)\tlr 0.000030\n",
      "epoch: [41/60][280/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:29:21\tloss 4.5587 (3.9582)\tacc 18.7500 (33.8281)\tlr 0.000030\n",
      "epoch: [41/60][290/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:29:18\tloss 3.9504 (3.9591)\tacc 31.2500 (33.7716)\tlr 0.000030\n",
      "epoch: [41/60][300/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:29:15\tloss 3.5051 (3.9582)\tacc 50.0000 (33.8646)\tlr 0.000030\n",
      "epoch: [41/60][310/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:29:12\tloss 4.2049 (3.9569)\tacc 31.2500 (33.9214)\tlr 0.000030\n",
      "epoch: [41/60][320/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:29:09\tloss 3.9446 (3.9587)\tacc 37.5000 (33.9160)\tlr 0.000030\n",
      "epoch: [41/60][330/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:29:06\tloss 3.7540 (3.9561)\tacc 34.3750 (33.9110)\tlr 0.000030\n",
      "epoch: [41/60][340/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:29:03\tloss 4.4751 (3.9551)\tacc 25.0000 (34.0349)\tlr 0.000030\n",
      "epoch: [41/60][350/404]\ttime 0.219 (0.225)\tdata 0.000 (0.001)\teta 0:28:59\tloss 4.1528 (3.9572)\tacc 31.2500 (33.9732)\tlr 0.000030\n",
      "epoch: [41/60][360/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:28:56\tloss 4.1852 (3.9559)\tacc 25.0000 (33.8976)\tlr 0.000030\n",
      "epoch: [41/60][370/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:28:54\tloss 4.0880 (3.9613)\tacc 34.3750 (33.8429)\tlr 0.000030\n",
      "epoch: [41/60][380/404]\ttime 0.221 (0.225)\tdata 0.000 (0.001)\teta 0:28:51\tloss 3.7902 (3.9597)\tacc 40.6250 (33.9309)\tlr 0.000030\n",
      "epoch: [41/60][390/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:28:48\tloss 4.3461 (3.9609)\tacc 21.8750 (33.9183)\tlr 0.000030\n",
      "epoch: [41/60][400/404]\ttime 0.218 (0.225)\tdata 0.000 (0.001)\teta 0:28:45\tloss 3.6591 (3.9594)\tacc 37.5000 (33.9375)\tlr 0.000030\n",
      "epoch: [42/60][10/404]\ttime 0.222 (0.279)\tdata 0.000 (0.056)\teta 0:35:37\tloss 4.0722 (4.0419)\tacc 25.0000 (31.5625)\tlr 0.000030\n",
      "epoch: [42/60][20/404]\ttime 0.222 (0.251)\tdata 0.000 (0.028)\teta 0:32:00\tloss 3.3257 (3.9486)\tacc 62.5000 (34.8438)\tlr 0.000030\n",
      "epoch: [42/60][30/404]\ttime 0.228 (0.242)\tdata 0.000 (0.019)\teta 0:30:50\tloss 3.8273 (3.9173)\tacc 40.6250 (35.6250)\tlr 0.000030\n",
      "epoch: [42/60][40/404]\ttime 0.223 (0.238)\tdata 0.000 (0.014)\teta 0:30:13\tloss 4.1017 (3.9228)\tacc 28.1250 (34.7656)\tlr 0.000030\n",
      "epoch: [42/60][50/404]\ttime 0.222 (0.235)\tdata 0.000 (0.011)\teta 0:29:52\tloss 3.9039 (3.9131)\tacc 37.5000 (35.2500)\tlr 0.000030\n",
      "epoch: [42/60][60/404]\ttime 0.223 (0.233)\tdata 0.000 (0.009)\teta 0:29:36\tloss 3.8619 (3.9342)\tacc 34.3750 (34.2188)\tlr 0.000030\n",
      "epoch: [42/60][70/404]\ttime 0.223 (0.232)\tdata 0.000 (0.008)\teta 0:29:23\tloss 3.8868 (3.9089)\tacc 31.2500 (34.5089)\tlr 0.000030\n",
      "epoch: [42/60][80/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:29:13\tloss 4.0625 (3.9112)\tacc 31.2500 (34.5312)\tlr 0.000030\n",
      "epoch: [42/60][90/404]\ttime 0.227 (0.230)\tdata 0.000 (0.006)\teta 0:29:04\tloss 4.1191 (3.9209)\tacc 31.2500 (34.4444)\tlr 0.000030\n",
      "epoch: [42/60][100/404]\ttime 0.224 (0.229)\tdata 0.000 (0.006)\teta 0:28:57\tloss 3.9875 (3.9263)\tacc 25.0000 (34.2500)\tlr 0.000030\n",
      "epoch: [42/60][110/404]\ttime 0.223 (0.229)\tdata 0.000 (0.005)\teta 0:28:51\tloss 3.6054 (3.9257)\tacc 34.3750 (34.4886)\tlr 0.000030\n",
      "epoch: [42/60][120/404]\ttime 0.223 (0.228)\tdata 0.000 (0.005)\teta 0:28:45\tloss 4.4033 (3.9318)\tacc 28.1250 (34.6875)\tlr 0.000030\n",
      "epoch: [42/60][130/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:28:40\tloss 4.1143 (3.9176)\tacc 37.5000 (35.1683)\tlr 0.000030\n",
      "epoch: [42/60][140/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:28:35\tloss 4.2602 (3.9181)\tacc 21.8750 (35.1786)\tlr 0.000030\n",
      "epoch: [42/60][150/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:28:31\tloss 3.7905 (3.9136)\tacc 37.5000 (35.1875)\tlr 0.000030\n",
      "epoch: [42/60][160/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:28:27\tloss 4.2905 (3.9185)\tacc 37.5000 (35.0391)\tlr 0.000030\n",
      "epoch: [42/60][170/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:28:23\tloss 3.6231 (3.9178)\tacc 46.8750 (35.1287)\tlr 0.000030\n",
      "epoch: [42/60][180/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:28:19\tloss 3.9881 (3.9192)\tacc 40.6250 (35.0000)\tlr 0.000030\n",
      "epoch: [42/60][190/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:28:16\tloss 3.5134 (3.9202)\tacc 50.0000 (34.8026)\tlr 0.000030\n",
      "epoch: [42/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:28:12\tloss 4.3605 (3.9268)\tacc 21.8750 (34.6094)\tlr 0.000030\n",
      "epoch: [42/60][210/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:28:08\tloss 3.8706 (3.9319)\tacc 37.5000 (34.5536)\tlr 0.000030\n",
      "epoch: [42/60][220/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:28:05\tloss 4.0525 (3.9298)\tacc 37.5000 (34.6733)\tlr 0.000030\n",
      "epoch: [42/60][230/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:28:01\tloss 4.0334 (3.9297)\tacc 31.2500 (34.5652)\tlr 0.000030\n",
      "epoch: [42/60][240/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:27:59\tloss 3.9235 (3.9257)\tacc 37.5000 (34.7786)\tlr 0.000030\n",
      "epoch: [42/60][250/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:27:55\tloss 3.5327 (3.9259)\tacc 43.7500 (34.6750)\tlr 0.000030\n",
      "epoch: [42/60][260/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:27:52\tloss 4.0931 (3.9229)\tacc 28.1250 (34.6635)\tlr 0.000030\n",
      "epoch: [42/60][270/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:27:49\tloss 4.1018 (3.9269)\tacc 31.2500 (34.4907)\tlr 0.000030\n",
      "epoch: [42/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:27:46\tloss 4.0878 (3.9285)\tacc 37.5000 (34.5424)\tlr 0.000030\n",
      "epoch: [42/60][290/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:27:44\tloss 3.5120 (3.9250)\tacc 43.7500 (34.6228)\tlr 0.000030\n",
      "epoch: [42/60][300/404]\ttime 0.227 (0.225)\tdata 0.000 (0.002)\teta 0:27:41\tloss 3.7103 (3.9236)\tacc 43.7500 (34.6875)\tlr 0.000030\n",
      "epoch: [42/60][310/404]\ttime 0.235 (0.228)\tdata 0.000 (0.004)\teta 0:27:58\tloss 4.4925 (3.9300)\tacc 31.2500 (34.6270)\tlr 0.000030\n",
      "epoch: [42/60][320/404]\ttime 0.233 (0.298)\tdata 0.009 (0.074)\teta 0:36:31\tloss 3.8606 (3.9304)\tacc 37.5000 (34.6094)\tlr 0.000030\n",
      "epoch: [42/60][330/404]\ttime 0.218 (0.296)\tdata 0.000 (0.072)\teta 0:36:11\tloss 3.6715 (3.9280)\tacc 40.6250 (34.6402)\tlr 0.000030\n",
      "epoch: [42/60][340/404]\ttime 0.222 (0.293)\tdata 0.000 (0.070)\teta 0:35:52\tloss 4.0273 (3.9271)\tacc 31.2500 (34.6783)\tlr 0.000030\n",
      "epoch: [42/60][350/404]\ttime 0.223 (0.291)\tdata 0.000 (0.068)\teta 0:35:34\tloss 3.9440 (3.9273)\tacc 34.3750 (34.6786)\tlr 0.000030\n",
      "epoch: [42/60][360/404]\ttime 0.223 (0.289)\tdata 0.000 (0.066)\teta 0:35:17\tloss 3.7928 (3.9273)\tacc 40.6250 (34.7656)\tlr 0.000030\n",
      "epoch: [42/60][370/404]\ttime 0.223 (0.288)\tdata 0.000 (0.064)\teta 0:35:01\tloss 3.3500 (3.9244)\tacc 56.2500 (34.8649)\tlr 0.000030\n",
      "epoch: [42/60][380/404]\ttime 0.222 (0.286)\tdata 0.000 (0.063)\teta 0:34:46\tloss 3.5719 (3.9241)\tacc 46.8750 (34.9013)\tlr 0.000030\n",
      "epoch: [42/60][390/404]\ttime 0.224 (0.284)\tdata 0.000 (0.061)\teta 0:34:31\tloss 4.0759 (3.9233)\tacc 28.1250 (34.8397)\tlr 0.000030\n",
      "epoch: [42/60][400/404]\ttime 0.222 (0.283)\tdata 0.000 (0.059)\teta 0:34:17\tloss 4.0561 (3.9234)\tacc 21.8750 (34.8125)\tlr 0.000030\n",
      "epoch: [43/60][10/404]\ttime 0.229 (0.277)\tdata 0.000 (0.046)\teta 0:33:35\tloss 4.0646 (3.8400)\tacc 31.2500 (37.8125)\tlr 0.000030\n",
      "epoch: [43/60][20/404]\ttime 0.226 (0.252)\tdata 0.000 (0.023)\teta 0:30:27\tloss 3.8877 (3.8413)\tacc 34.3750 (38.5938)\tlr 0.000030\n",
      "epoch: [43/60][30/404]\ttime 0.227 (0.243)\tdata 0.000 (0.015)\teta 0:29:21\tloss 3.6618 (3.8379)\tacc 40.6250 (37.6042)\tlr 0.000030\n",
      "epoch: [43/60][40/404]\ttime 0.227 (0.239)\tdata 0.000 (0.011)\teta 0:28:48\tloss 4.2801 (3.8664)\tacc 18.7500 (36.7188)\tlr 0.000030\n",
      "epoch: [43/60][50/404]\ttime 0.231 (0.237)\tdata 0.000 (0.009)\teta 0:28:28\tloss 3.9357 (3.8532)\tacc 31.2500 (36.5000)\tlr 0.000030\n",
      "epoch: [43/60][60/404]\ttime 0.229 (0.235)\tdata 0.000 (0.008)\teta 0:28:17\tloss 3.7792 (3.8570)\tacc 37.5000 (36.1979)\tlr 0.000030\n",
      "epoch: [43/60][70/404]\ttime 0.229 (0.234)\tdata 0.000 (0.007)\teta 0:28:07\tloss 3.7418 (3.8648)\tacc 40.6250 (36.1607)\tlr 0.000030\n",
      "epoch: [43/60][80/404]\ttime 0.228 (0.233)\tdata 0.000 (0.006)\teta 0:27:57\tloss 4.2186 (3.8608)\tacc 25.0000 (35.9766)\tlr 0.000030\n",
      "epoch: [43/60][90/404]\ttime 0.228 (0.233)\tdata 0.000 (0.005)\teta 0:27:51\tloss 3.7644 (3.8776)\tacc 46.8750 (36.1111)\tlr 0.000030\n",
      "epoch: [43/60][100/404]\ttime 0.224 (0.232)\tdata 0.000 (0.005)\teta 0:27:44\tloss 3.8246 (3.8846)\tacc 40.6250 (35.9375)\tlr 0.000030\n",
      "epoch: [43/60][110/404]\ttime 0.224 (0.231)\tdata 0.000 (0.004)\teta 0:27:37\tloss 3.7166 (3.8792)\tacc 43.7500 (36.3068)\tlr 0.000030\n",
      "epoch: [43/60][120/404]\ttime 0.225 (0.231)\tdata 0.000 (0.004)\teta 0:27:30\tloss 4.5232 (3.8808)\tacc 25.0000 (36.0417)\tlr 0.000030\n",
      "epoch: [43/60][130/404]\ttime 0.223 (0.230)\tdata 0.000 (0.004)\teta 0:27:23\tloss 3.5685 (3.8824)\tacc 43.7500 (35.9856)\tlr 0.000030\n",
      "epoch: [43/60][140/404]\ttime 0.222 (0.230)\tdata 0.000 (0.003)\teta 0:27:17\tloss 3.9965 (3.8809)\tacc 37.5000 (36.0938)\tlr 0.000030\n",
      "epoch: [43/60][150/404]\ttime 0.221 (0.229)\tdata 0.000 (0.003)\teta 0:27:11\tloss 3.6156 (3.8819)\tacc 37.5000 (35.9167)\tlr 0.000030\n",
      "epoch: [43/60][160/404]\ttime 0.222 (0.229)\tdata 0.000 (0.003)\teta 0:27:06\tloss 3.9669 (3.8855)\tacc 43.7500 (35.8594)\tlr 0.000030\n",
      "epoch: [43/60][170/404]\ttime 0.225 (0.228)\tdata 0.000 (0.003)\teta 0:27:01\tloss 4.0546 (3.8877)\tacc 34.3750 (35.7169)\tlr 0.000030\n",
      "epoch: [43/60][180/404]\ttime 0.223 (0.228)\tdata 0.000 (0.003)\teta 0:26:57\tloss 3.9382 (3.8834)\tacc 40.6250 (35.9896)\tlr 0.000030\n",
      "epoch: [43/60][190/404]\ttime 0.230 (0.228)\tdata 0.000 (0.002)\teta 0:26:52\tloss 3.9374 (3.8858)\tacc 37.5000 (35.9211)\tlr 0.000030\n",
      "epoch: [43/60][200/404]\ttime 0.221 (0.227)\tdata 0.000 (0.002)\teta 0:26:48\tloss 3.8394 (3.8838)\tacc 31.2500 (35.9844)\tlr 0.000030\n",
      "epoch: [43/60][210/404]\ttime 0.226 (0.227)\tdata 0.000 (0.002)\teta 0:26:44\tloss 3.6707 (3.8832)\tacc 43.7500 (35.8780)\tlr 0.000030\n",
      "epoch: [43/60][220/404]\ttime 0.222 (0.227)\tdata 0.000 (0.002)\teta 0:26:40\tloss 4.0548 (3.8842)\tacc 28.1250 (35.9091)\tlr 0.000030\n",
      "epoch: [43/60][230/404]\ttime 0.223 (0.227)\tdata 0.000 (0.002)\teta 0:26:36\tloss 4.0518 (3.8891)\tacc 34.3750 (35.8424)\tlr 0.000030\n",
      "epoch: [43/60][240/404]\ttime 0.221 (0.227)\tdata 0.000 (0.002)\teta 0:26:32\tloss 3.5283 (3.8865)\tacc 50.0000 (35.7943)\tlr 0.000030\n",
      "epoch: [43/60][250/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:26:29\tloss 4.3489 (3.8829)\tacc 34.3750 (35.9125)\tlr 0.000030\n",
      "epoch: [43/60][260/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:26:26\tloss 4.0628 (3.8836)\tacc 28.1250 (35.9495)\tlr 0.000030\n",
      "epoch: [43/60][270/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:26:22\tloss 4.3199 (3.8887)\tacc 21.8750 (35.9028)\tlr 0.000030\n",
      "epoch: [43/60][280/404]\ttime 0.220 (0.226)\tdata 0.000 (0.002)\teta 0:26:19\tloss 3.6281 (3.8877)\tacc 34.3750 (35.7812)\tlr 0.000030\n",
      "epoch: [43/60][290/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:26:16\tloss 3.9749 (3.8906)\tacc 28.1250 (35.8297)\tlr 0.000030\n",
      "epoch: [43/60][300/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:26:13\tloss 4.1622 (3.8902)\tacc 28.1250 (35.8229)\tlr 0.000030\n",
      "epoch: [43/60][310/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:26:10\tloss 3.6941 (3.8887)\tacc 40.6250 (35.8468)\tlr 0.000030\n",
      "epoch: [43/60][320/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:26:07\tloss 3.8062 (3.8873)\tacc 40.6250 (35.8594)\tlr 0.000030\n",
      "epoch: [43/60][330/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:26:04\tloss 3.8423 (3.8866)\tacc 34.3750 (35.8996)\tlr 0.000030\n",
      "epoch: [43/60][340/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:26:02\tloss 4.0076 (3.8865)\tacc 34.3750 (35.8180)\tlr 0.000030\n",
      "epoch: [43/60][350/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:25:59\tloss 4.0584 (3.8840)\tacc 40.6250 (35.9018)\tlr 0.000030\n",
      "epoch: [43/60][360/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:25:56\tloss 3.7355 (3.8855)\tacc 43.7500 (35.8160)\tlr 0.000030\n",
      "epoch: [43/60][370/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:25:54\tloss 3.7456 (3.8857)\tacc 37.5000 (35.8530)\tlr 0.000030\n",
      "epoch: [43/60][380/404]\ttime 0.226 (0.225)\tdata 0.000 (0.001)\teta 0:25:51\tloss 3.5252 (3.8833)\tacc 37.5000 (35.9539)\tlr 0.000030\n",
      "epoch: [43/60][390/404]\ttime 0.221 (0.225)\tdata 0.000 (0.001)\teta 0:25:49\tloss 4.0003 (3.8867)\tacc 28.1250 (35.7612)\tlr 0.000030\n",
      "epoch: [43/60][400/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:25:46\tloss 3.3874 (3.8844)\tacc 62.5000 (35.8281)\tlr 0.000030\n",
      "epoch: [44/60][10/404]\ttime 0.224 (0.277)\tdata 0.000 (0.046)\teta 0:31:37\tloss 4.0698 (3.7931)\tacc 28.1250 (36.2500)\tlr 0.000030\n",
      "epoch: [44/60][20/404]\ttime 0.223 (0.250)\tdata 0.000 (0.023)\teta 0:28:34\tloss 3.5226 (3.8101)\tacc 43.7500 (35.1562)\tlr 0.000030\n",
      "epoch: [44/60][30/404]\ttime 0.222 (0.241)\tdata 0.000 (0.015)\teta 0:27:29\tloss 3.8742 (3.7933)\tacc 43.7500 (35.6250)\tlr 0.000030\n",
      "epoch: [44/60][40/404]\ttime 0.226 (0.237)\tdata 0.000 (0.012)\teta 0:26:58\tloss 3.7144 (3.7925)\tacc 43.7500 (37.0312)\tlr 0.000030\n",
      "epoch: [44/60][50/404]\ttime 0.223 (0.235)\tdata 0.000 (0.009)\teta 0:26:38\tloss 3.9954 (3.7867)\tacc 28.1250 (37.2500)\tlr 0.000030\n",
      "epoch: [44/60][60/404]\ttime 0.223 (0.233)\tdata 0.000 (0.008)\teta 0:26:22\tloss 4.0311 (3.8068)\tacc 25.0000 (36.3021)\tlr 0.000030\n",
      "epoch: [44/60][70/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:26:12\tloss 4.1618 (3.8044)\tacc 21.8750 (36.3839)\tlr 0.000030\n",
      "epoch: [44/60][80/404]\ttime 0.220 (0.230)\tdata 0.000 (0.006)\teta 0:26:02\tloss 3.4782 (3.8156)\tacc 43.7500 (36.2891)\tlr 0.000030\n",
      "epoch: [44/60][90/404]\ttime 0.224 (0.230)\tdata 0.000 (0.005)\teta 0:25:55\tloss 3.6370 (3.8228)\tacc 46.8750 (36.3542)\tlr 0.000030\n",
      "epoch: [44/60][100/404]\ttime 0.224 (0.229)\tdata 0.000 (0.005)\teta 0:25:48\tloss 4.0384 (3.8230)\tacc 25.0000 (36.4688)\tlr 0.000030\n",
      "epoch: [44/60][110/404]\ttime 0.224 (0.228)\tdata 0.000 (0.004)\teta 0:25:43\tloss 3.8902 (3.8321)\tacc 34.3750 (36.1648)\tlr 0.000030\n",
      "epoch: [44/60][120/404]\ttime 0.224 (0.228)\tdata 0.000 (0.004)\teta 0:25:38\tloss 3.8343 (3.8396)\tacc 31.2500 (35.9635)\tlr 0.000030\n",
      "epoch: [44/60][130/404]\ttime 0.221 (0.228)\tdata 0.000 (0.004)\teta 0:25:33\tloss 3.3830 (3.8460)\tacc 50.0000 (35.9615)\tlr 0.000030\n",
      "epoch: [44/60][140/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:25:28\tloss 3.6307 (3.8356)\tacc 37.5000 (35.9375)\tlr 0.000030\n",
      "epoch: [44/60][150/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:25:24\tloss 3.9620 (3.8443)\tacc 37.5000 (35.6667)\tlr 0.000030\n",
      "epoch: [44/60][160/404]\ttime 0.226 (0.227)\tdata 0.000 (0.003)\teta 0:25:21\tloss 4.2268 (3.8474)\tacc 28.1250 (35.5078)\tlr 0.000030\n",
      "epoch: [44/60][170/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:25:17\tloss 4.0493 (3.8445)\tacc 40.6250 (35.6434)\tlr 0.000030\n",
      "epoch: [44/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:25:13\tloss 3.8255 (3.8493)\tacc 46.8750 (35.7465)\tlr 0.000030\n",
      "epoch: [44/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:25:10\tloss 4.1905 (3.8523)\tacc 31.2500 (35.7895)\tlr 0.000030\n",
      "epoch: [44/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:25:06\tloss 4.0284 (3.8567)\tacc 43.7500 (35.8750)\tlr 0.000030\n",
      "epoch: [44/60][210/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:25:03\tloss 3.8863 (3.8571)\tacc 40.6250 (35.7292)\tlr 0.000030\n",
      "epoch: [44/60][220/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:25:00\tloss 3.8355 (3.8566)\tacc 40.6250 (35.7102)\tlr 0.000030\n",
      "epoch: [44/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:24:56\tloss 4.1645 (3.8624)\tacc 28.1250 (35.4891)\tlr 0.000030\n",
      "epoch: [44/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:24:53\tloss 3.5192 (3.8534)\tacc 43.7500 (35.8594)\tlr 0.000030\n",
      "epoch: [44/60][250/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:24:50\tloss 3.6539 (3.8515)\tacc 31.2500 (35.7750)\tlr 0.000030\n",
      "epoch: [44/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:24:47\tloss 4.1137 (3.8512)\tacc 25.0000 (35.7572)\tlr 0.000030\n",
      "epoch: [44/60][270/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:24:45\tloss 3.5766 (3.8473)\tacc 53.1250 (35.9144)\tlr 0.000030\n",
      "epoch: [44/60][280/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:24:42\tloss 4.2543 (3.8471)\tacc 21.8750 (35.8594)\tlr 0.000030\n",
      "epoch: [44/60][290/404]\ttime 0.227 (0.225)\tdata 0.000 (0.002)\teta 0:24:39\tloss 3.6362 (3.8437)\tacc 40.6250 (35.9159)\tlr 0.000030\n",
      "epoch: [44/60][300/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:24:37\tloss 3.2749 (3.8413)\tacc 46.8750 (35.8438)\tlr 0.000030\n",
      "epoch: [44/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:24:34\tloss 4.0828 (3.8390)\tacc 34.3750 (36.0081)\tlr 0.000030\n",
      "epoch: [44/60][320/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:24:32\tloss 3.5896 (3.8376)\tacc 40.6250 (36.0645)\tlr 0.000030\n",
      "epoch: [44/60][330/404]\ttime 0.221 (0.225)\tdata 0.000 (0.001)\teta 0:24:29\tloss 3.5329 (3.8353)\tacc 50.0000 (36.1837)\tlr 0.000030\n",
      "epoch: [44/60][340/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:24:27\tloss 3.6079 (3.8348)\tacc 40.6250 (36.2868)\tlr 0.000030\n",
      "epoch: [44/60][350/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:24:24\tloss 3.7867 (3.8349)\tacc 28.1250 (36.2500)\tlr 0.000030\n",
      "epoch: [44/60][360/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:24:22\tloss 4.0231 (3.8363)\tacc 37.5000 (36.2153)\tlr 0.000030\n",
      "epoch: [44/60][370/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:24:19\tloss 3.9695 (3.8337)\tacc 25.0000 (36.2247)\tlr 0.000030\n",
      "epoch: [44/60][380/404]\ttime 0.225 (0.225)\tdata 0.000 (0.001)\teta 0:24:16\tloss 4.0137 (3.8346)\tacc 37.5000 (36.3076)\tlr 0.000030\n",
      "epoch: [44/60][390/404]\ttime 0.226 (0.225)\tdata 0.000 (0.001)\teta 0:24:14\tloss 3.4859 (3.8351)\tacc 37.5000 (36.2099)\tlr 0.000030\n",
      "epoch: [44/60][400/404]\ttime 0.221 (0.225)\tdata 0.000 (0.001)\teta 0:24:12\tloss 3.5801 (3.8334)\tacc 50.0000 (36.2656)\tlr 0.000030\n",
      "epoch: [45/60][10/404]\ttime 0.222 (0.284)\tdata 0.000 (0.053)\teta 0:30:33\tloss 3.3918 (3.7198)\tacc 46.8750 (39.0625)\tlr 0.000030\n",
      "epoch: [45/60][20/404]\ttime 0.223 (0.254)\tdata 0.000 (0.027)\teta 0:27:15\tloss 4.1707 (3.7608)\tacc 18.7500 (37.6562)\tlr 0.000030\n",
      "epoch: [45/60][30/404]\ttime 0.225 (0.244)\tdata 0.000 (0.018)\teta 0:26:06\tloss 3.8103 (3.7518)\tacc 40.6250 (37.2917)\tlr 0.000030\n",
      "epoch: [45/60][40/404]\ttime 0.223 (0.239)\tdata 0.000 (0.013)\teta 0:25:33\tloss 4.0214 (3.7540)\tacc 25.0000 (37.1875)\tlr 0.000030\n",
      "epoch: [45/60][50/404]\ttime 0.222 (0.235)\tdata 0.000 (0.011)\teta 0:25:09\tloss 3.9699 (3.7528)\tacc 31.2500 (37.5625)\tlr 0.000030\n",
      "epoch: [45/60][60/404]\ttime 0.223 (0.233)\tdata 0.000 (0.009)\teta 0:24:54\tloss 3.9320 (3.7574)\tacc 40.6250 (37.7604)\tlr 0.000030\n",
      "epoch: [45/60][70/404]\ttime 0.226 (0.232)\tdata 0.000 (0.008)\teta 0:24:43\tloss 3.5327 (3.7510)\tacc 50.0000 (38.0357)\tlr 0.000030\n",
      "epoch: [45/60][80/404]\ttime 0.225 (0.231)\tdata 0.000 (0.007)\teta 0:24:34\tloss 3.6810 (3.7409)\tacc 40.6250 (38.1641)\tlr 0.000030\n",
      "epoch: [45/60][90/404]\ttime 0.220 (0.230)\tdata 0.000 (0.006)\teta 0:24:26\tloss 3.7245 (3.7534)\tacc 50.0000 (37.7431)\tlr 0.000030\n",
      "epoch: [45/60][100/404]\ttime 0.224 (0.229)\tdata 0.000 (0.005)\teta 0:24:20\tloss 4.6706 (3.7801)\tacc 18.7500 (37.1250)\tlr 0.000030\n",
      "epoch: [45/60][110/404]\ttime 0.227 (0.229)\tdata 0.000 (0.005)\teta 0:24:15\tloss 3.7415 (3.7685)\tacc 31.2500 (37.3864)\tlr 0.000030\n",
      "epoch: [45/60][120/404]\ttime 0.225 (0.229)\tdata 0.000 (0.005)\teta 0:24:11\tloss 4.0493 (3.7680)\tacc 28.1250 (37.1875)\tlr 0.000030\n",
      "epoch: [45/60][130/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:24:06\tloss 4.0261 (3.7860)\tacc 34.3750 (36.8750)\tlr 0.000030\n",
      "epoch: [45/60][140/404]\ttime 0.222 (0.228)\tdata 0.000 (0.004)\teta 0:24:02\tloss 3.6468 (3.7804)\tacc 46.8750 (37.0536)\tlr 0.000030\n",
      "epoch: [45/60][150/404]\ttime 0.223 (0.228)\tdata 0.000 (0.004)\teta 0:23:57\tloss 3.9826 (3.7829)\tacc 31.2500 (36.9792)\tlr 0.000030\n",
      "epoch: [45/60][160/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:23:53\tloss 3.9668 (3.7828)\tacc 21.8750 (37.0117)\tlr 0.000030\n",
      "epoch: [45/60][170/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:23:49\tloss 3.4949 (3.7722)\tacc 40.6250 (37.1324)\tlr 0.000030\n",
      "epoch: [45/60][180/404]\ttime 0.220 (0.227)\tdata 0.000 (0.003)\teta 0:23:45\tloss 3.8401 (3.7714)\tacc 37.5000 (37.2569)\tlr 0.000030\n",
      "epoch: [45/60][190/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:23:42\tloss 3.8632 (3.7737)\tacc 34.3750 (37.2368)\tlr 0.000030\n",
      "epoch: [45/60][200/404]\ttime 0.225 (0.227)\tdata 0.000 (0.003)\teta 0:23:38\tloss 4.3040 (3.7746)\tacc 21.8750 (37.0625)\tlr 0.000030\n",
      "epoch: [45/60][210/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:23:35\tloss 3.6441 (3.7722)\tacc 37.5000 (37.1875)\tlr 0.000030\n",
      "epoch: [45/60][220/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:23:32\tloss 3.9130 (3.7734)\tacc 31.2500 (37.1733)\tlr 0.000030\n",
      "epoch: [45/60][230/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:23:29\tloss 3.6464 (3.7739)\tacc 37.5000 (37.0652)\tlr 0.000030\n",
      "epoch: [45/60][240/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:23:26\tloss 4.3244 (3.7819)\tacc 34.3750 (36.8750)\tlr 0.000030\n",
      "epoch: [45/60][250/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:23:24\tloss 3.7541 (3.7856)\tacc 37.5000 (36.8875)\tlr 0.000030\n",
      "epoch: [45/60][260/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:23:21\tloss 3.9400 (3.7852)\tacc 46.8750 (36.9832)\tlr 0.000030\n",
      "epoch: [45/60][270/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:23:18\tloss 3.4460 (3.7856)\tacc 46.8750 (36.8981)\tlr 0.000030\n",
      "epoch: [45/60][280/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:23:15\tloss 3.6894 (3.7833)\tacc 37.5000 (37.0201)\tlr 0.000030\n",
      "epoch: [45/60][290/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:23:12\tloss 4.0757 (3.7868)\tacc 28.1250 (37.0474)\tlr 0.000030\n",
      "epoch: [45/60][300/404]\ttime 0.225 (0.225)\tdata 0.001 (0.002)\teta 0:23:09\tloss 4.1387 (3.7870)\tacc 34.3750 (37.1042)\tlr 0.000030\n",
      "epoch: [45/60][310/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:23:06\tloss 4.0512 (3.7898)\tacc 34.3750 (37.0867)\tlr 0.000030\n",
      "epoch: [45/60][320/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:23:04\tloss 3.8917 (3.7879)\tacc 25.0000 (37.1777)\tlr 0.000030\n",
      "epoch: [45/60][330/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:23:01\tloss 3.7015 (3.7883)\tacc 37.5000 (37.1591)\tlr 0.000030\n",
      "epoch: [45/60][340/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:22:59\tloss 4.1233 (3.7906)\tacc 37.5000 (37.0956)\tlr 0.000030\n",
      "epoch: [45/60][350/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:22:56\tloss 3.6956 (3.7905)\tacc 34.3750 (37.0714)\tlr 0.000030\n",
      "epoch: [45/60][360/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:22:53\tloss 3.8628 (3.7941)\tacc 34.3750 (37.0486)\tlr 0.000030\n",
      "epoch: [45/60][370/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:22:51\tloss 3.6908 (3.7936)\tacc 34.3750 (37.0270)\tlr 0.000030\n",
      "epoch: [45/60][380/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:22:48\tloss 4.1375 (3.7943)\tacc 37.5000 (37.0312)\tlr 0.000030\n",
      "epoch: [45/60][390/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:22:46\tloss 3.7488 (3.7937)\tacc 37.5000 (37.1234)\tlr 0.000030\n",
      "epoch: [45/60][400/404]\ttime 0.221 (0.225)\tdata 0.000 (0.001)\teta 0:22:43\tloss 4.0087 (3.7946)\tacc 37.5000 (37.0938)\tlr 0.000030\n",
      "epoch: [46/60][10/404]\ttime 0.230 (0.280)\tdata 0.000 (0.046)\teta 0:28:14\tloss 3.8844 (3.7595)\tacc 40.6250 (38.4375)\tlr 0.000030\n",
      "epoch: [46/60][20/404]\ttime 0.224 (0.252)\tdata 0.000 (0.023)\teta 0:25:20\tloss 3.5869 (3.6915)\tacc 56.2500 (40.4688)\tlr 0.000030\n",
      "epoch: [46/60][30/404]\ttime 0.223 (0.242)\tdata 0.000 (0.015)\teta 0:24:20\tloss 3.4729 (3.7311)\tacc 46.8750 (39.5833)\tlr 0.000030\n",
      "epoch: [46/60][40/404]\ttime 0.224 (0.237)\tdata 0.000 (0.012)\teta 0:23:48\tloss 3.6719 (3.7241)\tacc 43.7500 (39.6094)\tlr 0.000030\n",
      "epoch: [46/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.009)\teta 0:23:28\tloss 3.6315 (3.7279)\tacc 50.0000 (39.5625)\tlr 0.000030\n",
      "epoch: [46/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.008)\teta 0:23:13\tloss 3.2736 (3.7361)\tacc 50.0000 (39.1146)\tlr 0.000030\n",
      "epoch: [46/60][70/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:23:03\tloss 3.5637 (3.7281)\tacc 50.0000 (39.3750)\tlr 0.000030\n",
      "epoch: [46/60][80/404]\ttime 0.223 (0.230)\tdata 0.000 (0.006)\teta 0:22:55\tloss 3.8281 (3.7195)\tacc 31.2500 (39.2188)\tlr 0.000030\n",
      "epoch: [46/60][90/404]\ttime 0.222 (0.229)\tdata 0.000 (0.005)\teta 0:22:48\tloss 3.7914 (3.7154)\tacc 37.5000 (39.0278)\tlr 0.000030\n",
      "epoch: [46/60][100/404]\ttime 0.226 (0.229)\tdata 0.000 (0.005)\teta 0:22:42\tloss 4.1531 (3.7169)\tacc 34.3750 (38.8438)\tlr 0.000030\n",
      "epoch: [46/60][110/404]\ttime 0.221 (0.228)\tdata 0.000 (0.004)\teta 0:22:37\tloss 3.8402 (3.7269)\tacc 31.2500 (38.5227)\tlr 0.000030\n",
      "epoch: [46/60][120/404]\ttime 0.223 (0.228)\tdata 0.000 (0.004)\teta 0:22:33\tloss 3.7800 (3.7232)\tacc 43.7500 (38.7240)\tlr 0.000030\n",
      "epoch: [46/60][130/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:22:28\tloss 3.3888 (3.7225)\tacc 50.0000 (38.7019)\tlr 0.000030\n",
      "epoch: [46/60][140/404]\ttime 0.226 (0.227)\tdata 0.000 (0.003)\teta 0:22:24\tloss 3.6443 (3.7284)\tacc 31.2500 (38.5268)\tlr 0.000030\n",
      "epoch: [46/60][150/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:22:20\tloss 4.0662 (3.7386)\tacc 28.1250 (38.4792)\tlr 0.000030\n",
      "epoch: [46/60][160/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:22:16\tloss 3.7663 (3.7379)\tacc 40.6250 (38.3398)\tlr 0.000030\n",
      "epoch: [46/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:22:12\tloss 3.7113 (3.7308)\tacc 46.8750 (38.4375)\tlr 0.000030\n",
      "epoch: [46/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:22:09\tloss 3.9142 (3.7298)\tacc 31.2500 (38.4896)\tlr 0.000030\n",
      "epoch: [46/60][190/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:22:06\tloss 3.8006 (3.7359)\tacc 31.2500 (38.4868)\tlr 0.000030\n",
      "epoch: [46/60][200/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:22:02\tloss 3.6590 (3.7328)\tacc 46.8750 (38.5938)\tlr 0.000030\n",
      "epoch: [46/60][210/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:21:59\tloss 3.3347 (3.7372)\tacc 43.7500 (38.4375)\tlr 0.000030\n",
      "epoch: [46/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:21:56\tloss 3.7955 (3.7391)\tacc 34.3750 (38.3239)\tlr 0.000030\n",
      "epoch: [46/60][230/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:21:53\tloss 3.8166 (3.7369)\tacc 43.7500 (38.4783)\tlr 0.000030\n",
      "epoch: [46/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:21:51\tloss 4.4182 (3.7468)\tacc 15.6250 (38.1510)\tlr 0.000030\n",
      "epoch: [46/60][250/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:21:48\tloss 3.5371 (3.7460)\tacc 43.7500 (38.2625)\tlr 0.000030\n",
      "epoch: [46/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:21:45\tloss 3.9520 (3.7481)\tacc 31.2500 (38.1731)\tlr 0.000030\n",
      "epoch: [46/60][270/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:21:42\tloss 4.1836 (3.7508)\tacc 18.7500 (38.1250)\tlr 0.000030\n",
      "epoch: [46/60][280/404]\ttime 0.227 (0.225)\tdata 0.000 (0.002)\teta 0:21:40\tloss 3.8671 (3.7527)\tacc 31.2500 (38.0580)\tlr 0.000030\n",
      "epoch: [46/60][290/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:21:37\tloss 3.8953 (3.7498)\tacc 34.3750 (38.0927)\tlr 0.000030\n",
      "epoch: [46/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:21:35\tloss 3.7958 (3.7501)\tacc 34.3750 (38.0417)\tlr 0.000030\n",
      "epoch: [46/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:21:32\tloss 3.6519 (3.7510)\tacc 46.8750 (38.0040)\tlr 0.000030\n",
      "epoch: [46/60][320/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:21:29\tloss 3.6365 (3.7529)\tacc 40.6250 (38.0078)\tlr 0.000030\n",
      "epoch: [46/60][330/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:21:27\tloss 3.8245 (3.7543)\tacc 25.0000 (38.0019)\tlr 0.000030\n",
      "epoch: [46/60][340/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:21:24\tloss 3.7180 (3.7537)\tacc 50.0000 (37.9504)\tlr 0.000030\n",
      "epoch: [46/60][350/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:21:22\tloss 3.9953 (3.7539)\tacc 34.3750 (37.9018)\tlr 0.000030\n",
      "epoch: [46/60][360/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:21:19\tloss 4.0079 (3.7528)\tacc 31.2500 (37.9688)\tlr 0.000030\n",
      "epoch: [46/60][370/404]\ttime 0.224 (0.225)\tdata 0.000 (0.001)\teta 0:21:17\tloss 3.7497 (3.7518)\tacc 40.6250 (38.0659)\tlr 0.000030\n",
      "epoch: [46/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:21:14\tloss 3.5380 (3.7493)\tacc 43.7500 (38.1003)\tlr 0.000030\n",
      "epoch: [46/60][390/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:21:12\tloss 3.6208 (3.7493)\tacc 31.2500 (38.0048)\tlr 0.000030\n",
      "epoch: [46/60][400/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:21:09\tloss 3.8147 (3.7504)\tacc 40.6250 (37.9141)\tlr 0.000030\n",
      "epoch: [47/60][10/404]\ttime 0.224 (0.282)\tdata 0.000 (0.053)\teta 0:26:29\tloss 3.7102 (3.6470)\tacc 28.1250 (37.1875)\tlr 0.000030\n",
      "epoch: [47/60][20/404]\ttime 0.223 (0.266)\tdata 0.000 (0.026)\teta 0:25:00\tloss 3.4113 (3.6466)\tacc 43.7500 (39.5312)\tlr 0.000030\n",
      "epoch: [47/60][30/404]\ttime 0.221 (0.252)\tdata 0.000 (0.018)\teta 0:23:35\tloss 3.9314 (3.6457)\tacc 21.8750 (39.3750)\tlr 0.000030\n",
      "epoch: [47/60][40/404]\ttime 0.222 (0.244)\tdata 0.000 (0.013)\teta 0:22:52\tloss 3.6381 (3.6679)\tacc 46.8750 (39.2969)\tlr 0.000030\n",
      "epoch: [47/60][50/404]\ttime 0.223 (0.240)\tdata 0.000 (0.011)\teta 0:22:25\tloss 3.6343 (3.6833)\tacc 31.2500 (38.9375)\tlr 0.000030\n",
      "epoch: [47/60][60/404]\ttime 0.222 (0.237)\tdata 0.000 (0.009)\teta 0:22:06\tloss 4.1022 (3.6735)\tacc 28.1250 (38.8542)\tlr 0.000030\n",
      "epoch: [47/60][70/404]\ttime 0.224 (0.235)\tdata 0.000 (0.008)\teta 0:21:53\tloss 3.7606 (3.6737)\tacc 34.3750 (38.4375)\tlr 0.000030\n",
      "epoch: [47/60][80/404]\ttime 0.221 (0.234)\tdata 0.000 (0.007)\teta 0:21:42\tloss 3.8897 (3.6824)\tacc 21.8750 (38.1250)\tlr 0.000030\n",
      "epoch: [47/60][90/404]\ttime 0.225 (0.233)\tdata 0.000 (0.006)\teta 0:21:34\tloss 3.8224 (3.6871)\tacc 40.6250 (38.3681)\tlr 0.000030\n",
      "epoch: [47/60][100/404]\ttime 0.223 (0.232)\tdata 0.000 (0.005)\teta 0:21:26\tloss 3.7242 (3.6963)\tacc 46.8750 (37.9375)\tlr 0.000030\n",
      "epoch: [47/60][110/404]\ttime 0.228 (0.231)\tdata 0.000 (0.005)\teta 0:21:20\tloss 3.5642 (3.7082)\tacc 37.5000 (37.6989)\tlr 0.000030\n",
      "epoch: [47/60][120/404]\ttime 0.225 (0.230)\tdata 0.000 (0.004)\teta 0:21:15\tloss 3.6353 (3.7155)\tacc 43.7500 (37.8385)\tlr 0.000030\n",
      "epoch: [47/60][130/404]\ttime 0.223 (0.230)\tdata 0.000 (0.004)\teta 0:21:10\tloss 3.9231 (3.7097)\tacc 34.3750 (38.4615)\tlr 0.000030\n",
      "epoch: [47/60][140/404]\ttime 0.227 (0.230)\tdata 0.000 (0.004)\teta 0:21:06\tloss 3.8090 (3.7050)\tacc 34.3750 (38.5268)\tlr 0.000030\n",
      "epoch: [47/60][150/404]\ttime 0.225 (0.229)\tdata 0.000 (0.004)\teta 0:21:01\tloss 3.8553 (3.7038)\tacc 34.3750 (38.6875)\tlr 0.000030\n",
      "epoch: [47/60][160/404]\ttime 0.224 (0.229)\tdata 0.000 (0.003)\teta 0:20:57\tloss 3.7029 (3.7019)\tacc 34.3750 (38.5352)\tlr 0.000030\n",
      "epoch: [47/60][170/404]\ttime 0.223 (0.228)\tdata 0.000 (0.003)\teta 0:20:52\tloss 3.5893 (3.7082)\tacc 46.8750 (38.6029)\tlr 0.000030\n",
      "epoch: [47/60][180/404]\ttime 0.222 (0.228)\tdata 0.000 (0.003)\teta 0:20:49\tloss 3.9746 (3.7093)\tacc 31.2500 (38.6285)\tlr 0.000030\n",
      "epoch: [47/60][190/404]\ttime 0.223 (0.228)\tdata 0.000 (0.003)\teta 0:20:45\tloss 3.3552 (3.7009)\tacc 46.8750 (38.8816)\tlr 0.000030\n",
      "epoch: [47/60][200/404]\ttime 0.223 (0.228)\tdata 0.000 (0.003)\teta 0:20:42\tloss 3.6916 (3.6992)\tacc 28.1250 (38.9062)\tlr 0.000030\n",
      "epoch: [47/60][210/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:20:38\tloss 3.7740 (3.7003)\tacc 34.3750 (38.8542)\tlr 0.000030\n",
      "epoch: [47/60][220/404]\ttime 0.221 (0.227)\tdata 0.000 (0.002)\teta 0:20:35\tloss 3.7249 (3.7038)\tacc 37.5000 (38.8210)\tlr 0.000030\n",
      "epoch: [47/60][230/404]\ttime 0.222 (0.227)\tdata 0.000 (0.002)\teta 0:20:31\tloss 3.8651 (3.7050)\tacc 25.0000 (38.8179)\tlr 0.000030\n",
      "epoch: [47/60][240/404]\ttime 0.222 (0.227)\tdata 0.000 (0.002)\teta 0:20:28\tloss 3.8378 (3.7051)\tacc 40.6250 (38.8021)\tlr 0.000030\n",
      "epoch: [47/60][250/404]\ttime 0.223 (0.227)\tdata 0.000 (0.002)\teta 0:20:25\tloss 3.6284 (3.7035)\tacc 37.5000 (38.9000)\tlr 0.000030\n",
      "epoch: [47/60][260/404]\ttime 0.223 (0.227)\tdata 0.000 (0.002)\teta 0:20:22\tloss 3.8951 (3.7075)\tacc 34.3750 (38.7981)\tlr 0.000030\n",
      "epoch: [47/60][270/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:20:19\tloss 3.7483 (3.7031)\tacc 34.3750 (38.8426)\tlr 0.000030\n",
      "epoch: [47/60][280/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:20:16\tloss 4.1865 (3.7044)\tacc 21.8750 (38.9174)\tlr 0.000030\n",
      "epoch: [47/60][290/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:20:14\tloss 3.7763 (3.7074)\tacc 28.1250 (38.7823)\tlr 0.000030\n",
      "epoch: [47/60][300/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:20:11\tloss 3.7586 (3.7076)\tacc 37.5000 (38.7604)\tlr 0.000030\n",
      "epoch: [47/60][310/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:20:08\tloss 3.6165 (3.7054)\tacc 37.5000 (38.8508)\tlr 0.000030\n",
      "epoch: [47/60][320/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:20:05\tloss 3.9730 (3.7077)\tacc 18.7500 (38.7598)\tlr 0.000030\n",
      "epoch: [47/60][330/404]\ttime 0.220 (0.226)\tdata 0.000 (0.002)\teta 0:20:02\tloss 3.7383 (3.7050)\tacc 37.5000 (38.7879)\tlr 0.000030\n",
      "epoch: [47/60][340/404]\ttime 0.229 (0.226)\tdata 0.000 (0.002)\teta 0:20:00\tloss 3.2948 (3.7019)\tacc 43.7500 (38.8603)\tlr 0.000030\n",
      "epoch: [47/60][350/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:19:57\tloss 3.9350 (3.7022)\tacc 37.5000 (38.8750)\tlr 0.000030\n",
      "epoch: [47/60][360/404]\ttime 0.224 (0.226)\tdata 0.000 (0.002)\teta 0:19:55\tloss 3.7773 (3.7031)\tacc 43.7500 (38.8194)\tlr 0.000030\n",
      "epoch: [47/60][370/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:19:52\tloss 3.4030 (3.7033)\tacc 37.5000 (38.7753)\tlr 0.000030\n",
      "epoch: [47/60][380/404]\ttime 0.224 (0.226)\tdata 0.000 (0.001)\teta 0:19:49\tloss 3.7142 (3.7032)\tacc 50.0000 (38.8240)\tlr 0.000030\n",
      "epoch: [47/60][390/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:19:47\tloss 4.0358 (3.7026)\tacc 34.3750 (38.9103)\tlr 0.000030\n",
      "epoch: [47/60][400/404]\ttime 0.220 (0.225)\tdata 0.000 (0.001)\teta 0:19:44\tloss 3.4362 (3.7012)\tacc 46.8750 (38.9297)\tlr 0.000030\n",
      "epoch: [48/60][10/404]\ttime 0.220 (0.279)\tdata 0.000 (0.052)\teta 0:24:20\tloss 3.6782 (3.6169)\tacc 37.5000 (43.1250)\tlr 0.000030\n",
      "epoch: [48/60][20/404]\ttime 0.225 (0.251)\tdata 0.000 (0.026)\teta 0:21:54\tloss 3.4907 (3.5672)\tacc 50.0000 (44.0625)\tlr 0.000030\n",
      "epoch: [48/60][30/404]\ttime 0.223 (0.242)\tdata 0.000 (0.017)\teta 0:21:02\tloss 3.4941 (3.6191)\tacc 46.8750 (42.6042)\tlr 0.000030\n",
      "epoch: [48/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.013)\teta 0:20:36\tloss 3.4375 (3.6334)\tacc 40.6250 (41.0156)\tlr 0.000030\n",
      "epoch: [48/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.011)\teta 0:20:18\tloss 3.6290 (3.6239)\tacc 34.3750 (41.0000)\tlr 0.000030\n",
      "epoch: [48/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.009)\teta 0:20:06\tloss 3.7502 (3.6245)\tacc 40.6250 (40.5208)\tlr 0.000030\n",
      "epoch: [48/60][70/404]\ttime 0.223 (0.231)\tdata 0.000 (0.008)\teta 0:19:56\tloss 3.6566 (3.6169)\tacc 37.5000 (40.7589)\tlr 0.000030\n",
      "epoch: [48/60][80/404]\ttime 0.222 (0.230)\tdata 0.000 (0.007)\teta 0:19:48\tloss 3.3989 (3.6336)\tacc 46.8750 (40.2344)\tlr 0.000030\n",
      "epoch: [48/60][90/404]\ttime 0.222 (0.229)\tdata 0.000 (0.006)\teta 0:19:42\tloss 3.6777 (3.6331)\tacc 31.2500 (40.1042)\tlr 0.000030\n",
      "epoch: [48/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.005)\teta 0:19:36\tloss 4.0579 (3.6325)\tacc 31.2500 (39.7500)\tlr 0.000030\n",
      "epoch: [48/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:19:31\tloss 3.2594 (3.6384)\tacc 56.2500 (39.6591)\tlr 0.000030\n",
      "epoch: [48/60][120/404]\ttime 0.225 (0.228)\tdata 0.000 (0.004)\teta 0:19:28\tloss 3.5878 (3.6411)\tacc 37.5000 (39.4010)\tlr 0.000030\n",
      "epoch: [48/60][130/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:19:24\tloss 3.3000 (3.6436)\tacc 43.7500 (39.3510)\tlr 0.000030\n",
      "epoch: [48/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:19:20\tloss 3.5210 (3.6454)\tacc 37.5000 (39.3080)\tlr 0.000030\n",
      "epoch: [48/60][150/404]\ttime 0.226 (0.227)\tdata 0.000 (0.004)\teta 0:19:16\tloss 3.3357 (3.6446)\tacc 50.0000 (39.6667)\tlr 0.000030\n",
      "epoch: [48/60][160/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:19:13\tloss 3.5853 (3.6400)\tacc 34.3750 (39.9414)\tlr 0.000030\n",
      "epoch: [48/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:19:10\tloss 4.0736 (3.6478)\tacc 31.2500 (39.8346)\tlr 0.000030\n",
      "epoch: [48/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:19:06\tloss 3.8714 (3.6536)\tacc 31.2500 (39.7917)\tlr 0.000030\n",
      "epoch: [48/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:19:03\tloss 3.4026 (3.6543)\tacc 56.2500 (39.7204)\tlr 0.000030\n",
      "epoch: [48/60][200/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:19:00\tloss 3.6461 (3.6577)\tacc 37.5000 (39.7344)\tlr 0.000030\n",
      "epoch: [48/60][210/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:18:57\tloss 3.7453 (3.6548)\tacc 37.5000 (39.6726)\tlr 0.000030\n",
      "epoch: [48/60][220/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:18:55\tloss 3.9057 (3.6589)\tacc 31.2500 (39.6307)\tlr 0.000030\n",
      "epoch: [48/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:18:52\tloss 3.9727 (3.6641)\tacc 25.0000 (39.5652)\tlr 0.000030\n",
      "epoch: [48/60][240/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:18:49\tloss 3.5442 (3.6627)\tacc 43.7500 (39.5964)\tlr 0.000030\n",
      "epoch: [48/60][250/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:18:46\tloss 3.4387 (3.6564)\tacc 50.0000 (39.8625)\tlr 0.000030\n",
      "epoch: [48/60][260/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:18:44\tloss 3.8075 (3.6583)\tacc 28.1250 (39.6514)\tlr 0.000030\n",
      "epoch: [48/60][270/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:18:41\tloss 3.6128 (3.6592)\tacc 43.7500 (39.7569)\tlr 0.000030\n",
      "epoch: [48/60][280/404]\ttime 0.228 (0.225)\tdata 0.000 (0.002)\teta 0:18:38\tloss 3.5083 (3.6582)\tacc 34.3750 (39.7991)\tlr 0.000030\n",
      "epoch: [48/60][290/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:18:36\tloss 3.1767 (3.6573)\tacc 53.1250 (39.8815)\tlr 0.000030\n",
      "epoch: [48/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:18:33\tloss 3.1464 (3.6560)\tacc 59.3750 (39.9375)\tlr 0.000030\n",
      "epoch: [48/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:18:31\tloss 3.4008 (3.6586)\tacc 56.2500 (39.8085)\tlr 0.000030\n",
      "epoch: [48/60][320/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:18:28\tloss 3.5325 (3.6555)\tacc 50.0000 (39.9707)\tlr 0.000030\n",
      "epoch: [48/60][330/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:18:25\tloss 3.1969 (3.6551)\tacc 46.8750 (39.8958)\tlr 0.000030\n",
      "epoch: [48/60][340/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:18:23\tloss 3.4242 (3.6534)\tacc 53.1250 (39.9265)\tlr 0.000030\n",
      "epoch: [48/60][350/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:18:21\tloss 3.5782 (3.6531)\tacc 43.7500 (39.9286)\tlr 0.000030\n",
      "epoch: [48/60][360/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:18:18\tloss 3.4129 (3.6545)\tacc 40.6250 (39.8438)\tlr 0.000030\n",
      "epoch: [48/60][370/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:18:15\tloss 3.4871 (3.6534)\tacc 43.7500 (39.8818)\tlr 0.000030\n",
      "epoch: [48/60][380/404]\ttime 0.226 (0.224)\tdata 0.000 (0.001)\teta 0:18:13\tloss 3.7093 (3.6556)\tacc 46.8750 (39.8684)\tlr 0.000030\n",
      "epoch: [48/60][390/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:18:11\tloss 4.0235 (3.6585)\tacc 21.8750 (39.7276)\tlr 0.000030\n",
      "epoch: [48/60][400/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:18:08\tloss 3.4307 (3.6563)\tacc 43.7500 (39.8594)\tlr 0.000030\n",
      "epoch: [49/60][10/404]\ttime 0.225 (0.280)\tdata 0.000 (0.052)\teta 0:22:32\tloss 3.6430 (3.5473)\tacc 43.7500 (45.6250)\tlr 0.000030\n",
      "epoch: [49/60][20/404]\ttime 0.227 (0.252)\tdata 0.001 (0.026)\teta 0:20:16\tloss 3.6160 (3.6760)\tacc 37.5000 (39.2188)\tlr 0.000030\n",
      "epoch: [49/60][30/404]\ttime 0.222 (0.242)\tdata 0.000 (0.017)\teta 0:19:27\tloss 3.7171 (3.6391)\tacc 40.6250 (40.6250)\tlr 0.000030\n",
      "epoch: [49/60][40/404]\ttime 0.224 (0.238)\tdata 0.000 (0.013)\teta 0:19:03\tloss 3.7080 (3.6112)\tacc 31.2500 (40.9375)\tlr 0.000030\n",
      "epoch: [49/60][50/404]\ttime 0.222 (0.235)\tdata 0.000 (0.010)\teta 0:18:46\tloss 3.5455 (3.5922)\tacc 40.6250 (41.0000)\tlr 0.000030\n",
      "epoch: [49/60][60/404]\ttime 0.221 (0.233)\tdata 0.000 (0.009)\teta 0:18:34\tloss 3.8288 (3.5917)\tacc 34.3750 (41.3021)\tlr 0.000030\n",
      "epoch: [49/60][70/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:18:25\tloss 3.8924 (3.6081)\tacc 28.1250 (40.3125)\tlr 0.000030\n",
      "epoch: [49/60][80/404]\ttime 0.225 (0.230)\tdata 0.000 (0.007)\teta 0:18:17\tloss 3.5573 (3.6140)\tacc 46.8750 (40.5859)\tlr 0.000030\n",
      "epoch: [49/60][90/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:18:11\tloss 3.5660 (3.6072)\tacc 40.6250 (40.6597)\tlr 0.000030\n",
      "epoch: [49/60][100/404]\ttime 0.222 (0.229)\tdata 0.000 (0.005)\teta 0:18:06\tloss 3.7546 (3.6202)\tacc 31.2500 (40.2812)\tlr 0.000030\n",
      "epoch: [49/60][110/404]\ttime 0.225 (0.229)\tdata 0.000 (0.005)\teta 0:18:02\tloss 3.5088 (3.6047)\tacc 40.6250 (40.5114)\tlr 0.000030\n",
      "epoch: [49/60][120/404]\ttime 0.224 (0.228)\tdata 0.000 (0.004)\teta 0:17:58\tloss 3.7190 (3.6086)\tacc 34.3750 (40.4427)\tlr 0.000030\n",
      "epoch: [49/60][130/404]\ttime 0.226 (0.228)\tdata 0.000 (0.004)\teta 0:17:54\tloss 3.4977 (3.6051)\tacc 28.1250 (40.2163)\tlr 0.000030\n",
      "epoch: [49/60][140/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:17:50\tloss 3.3435 (3.6021)\tacc 56.2500 (40.3571)\tlr 0.000030\n",
      "epoch: [49/60][150/404]\ttime 0.225 (0.227)\tdata 0.000 (0.004)\teta 0:17:47\tloss 3.6139 (3.6102)\tacc 43.7500 (40.3750)\tlr 0.000030\n",
      "epoch: [49/60][160/404]\ttime 0.225 (0.227)\tdata 0.000 (0.003)\teta 0:17:43\tloss 3.3491 (3.6099)\tacc 46.8750 (40.5664)\tlr 0.000030\n",
      "epoch: [49/60][170/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:17:40\tloss 3.8302 (3.6035)\tacc 31.2500 (40.8640)\tlr 0.000030\n",
      "epoch: [49/60][180/404]\ttime 0.222 (0.227)\tdata 0.000 (0.003)\teta 0:17:37\tloss 4.2233 (3.6093)\tacc 15.6250 (40.6424)\tlr 0.000030\n",
      "epoch: [49/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:17:34\tloss 3.6222 (3.6079)\tacc 37.5000 (40.5592)\tlr 0.000030\n",
      "epoch: [49/60][200/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:17:31\tloss 3.6686 (3.6106)\tacc 37.5000 (40.5938)\tlr 0.000030\n",
      "epoch: [49/60][210/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:17:28\tloss 3.7186 (3.6092)\tacc 40.6250 (40.6994)\tlr 0.000030\n",
      "epoch: [49/60][220/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:17:25\tloss 3.7052 (3.6098)\tacc 31.2500 (40.7244)\tlr 0.000030\n",
      "epoch: [49/60][230/404]\ttime 0.223 (0.226)\tdata 0.000 (0.002)\teta 0:17:22\tloss 4.1766 (3.6104)\tacc 21.8750 (40.7473)\tlr 0.000030\n",
      "epoch: [49/60][240/404]\ttime 0.222 (0.226)\tdata 0.000 (0.002)\teta 0:17:20\tloss 3.6359 (3.6091)\tacc 37.5000 (40.7161)\tlr 0.000030\n",
      "epoch: [49/60][250/404]\ttime 0.221 (0.226)\tdata 0.000 (0.002)\teta 0:17:17\tloss 3.8608 (3.6110)\tacc 34.3750 (40.5500)\tlr 0.000030\n",
      "epoch: [49/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:14\tloss 3.1730 (3.6099)\tacc 59.3750 (40.5889)\tlr 0.000030\n",
      "epoch: [49/60][270/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:11\tloss 3.8576 (3.6112)\tacc 28.1250 (40.5556)\tlr 0.000030\n",
      "epoch: [49/60][280/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:08\tloss 3.7876 (3.6138)\tacc 40.6250 (40.5692)\tlr 0.000030\n",
      "epoch: [49/60][290/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:06\tloss 3.4197 (3.6098)\tacc 34.3750 (40.6250)\tlr 0.000030\n",
      "epoch: [49/60][300/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:03\tloss 3.8432 (3.6145)\tacc 34.3750 (40.6146)\tlr 0.000030\n",
      "epoch: [49/60][310/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:17:00\tloss 3.6658 (3.6166)\tacc 40.6250 (40.5847)\tlr 0.000030\n",
      "epoch: [49/60][320/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:16:58\tloss 3.5802 (3.6142)\tacc 40.6250 (40.5664)\tlr 0.000030\n",
      "epoch: [49/60][330/404]\ttime 0.232 (0.225)\tdata 0.000 (0.002)\teta 0:16:55\tloss 3.5245 (3.6168)\tacc 50.0000 (40.5492)\tlr 0.000030\n",
      "epoch: [49/60][340/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:16:53\tloss 3.2759 (3.6143)\tacc 53.1250 (40.5790)\tlr 0.000030\n",
      "epoch: [49/60][350/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:16:50\tloss 3.4286 (3.6120)\tacc 50.0000 (40.7232)\tlr 0.000030\n",
      "epoch: [49/60][360/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:16:48\tloss 3.5675 (3.6126)\tacc 37.5000 (40.6510)\tlr 0.000030\n",
      "epoch: [49/60][370/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:16:46\tloss 3.2245 (3.6131)\tacc 59.3750 (40.7264)\tlr 0.000030\n",
      "epoch: [49/60][380/404]\ttime 0.223 (0.225)\tdata 0.000 (0.001)\teta 0:16:43\tloss 3.4557 (3.6142)\tacc 40.6250 (40.6414)\tlr 0.000030\n",
      "epoch: [49/60][390/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:16:41\tloss 3.3658 (3.6140)\tacc 53.1250 (40.6250)\tlr 0.000030\n",
      "epoch: [49/60][400/404]\ttime 0.222 (0.225)\tdata 0.000 (0.001)\teta 0:16:38\tloss 3.7137 (3.6124)\tacc 37.5000 (40.6484)\tlr 0.000030\n",
      "epoch: [50/60][10/404]\ttime 0.223 (0.282)\tdata 0.000 (0.056)\teta 0:20:48\tloss 3.4052 (3.5177)\tacc 43.7500 (41.8750)\tlr 0.000030\n",
      "epoch: [50/60][20/404]\ttime 0.220 (0.252)\tdata 0.000 (0.028)\teta 0:18:33\tloss 3.2665 (3.5276)\tacc 50.0000 (41.0938)\tlr 0.000030\n",
      "epoch: [50/60][30/404]\ttime 0.222 (0.242)\tdata 0.000 (0.019)\teta 0:17:47\tloss 3.7274 (3.5873)\tacc 34.3750 (41.1458)\tlr 0.000030\n",
      "epoch: [50/60][40/404]\ttime 0.224 (0.237)\tdata 0.000 (0.014)\teta 0:17:23\tloss 3.2382 (3.5899)\tacc 46.8750 (41.0156)\tlr 0.000030\n",
      "epoch: [50/60][50/404]\ttime 0.221 (0.234)\tdata 0.000 (0.011)\teta 0:17:08\tloss 3.3653 (3.5637)\tacc 46.8750 (42.1250)\tlr 0.000030\n",
      "epoch: [50/60][60/404]\ttime 0.223 (0.232)\tdata 0.000 (0.009)\teta 0:16:58\tloss 3.5686 (3.5825)\tacc 50.0000 (41.9792)\tlr 0.000030\n",
      "epoch: [50/60][70/404]\ttime 0.225 (0.231)\tdata 0.000 (0.008)\teta 0:16:50\tloss 3.7374 (3.5806)\tacc 37.5000 (41.7857)\tlr 0.000030\n",
      "epoch: [50/60][80/404]\ttime 0.222 (0.230)\tdata 0.000 (0.007)\teta 0:16:43\tloss 3.1607 (3.5687)\tacc 56.2500 (42.3047)\tlr 0.000030\n",
      "epoch: [50/60][90/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:16:37\tloss 3.3289 (3.5612)\tacc 43.7500 (42.2917)\tlr 0.000030\n",
      "epoch: [50/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.006)\teta 0:16:32\tloss 3.6555 (3.5565)\tacc 34.3750 (42.1250)\tlr 0.000030\n",
      "epoch: [50/60][110/404]\ttime 0.225 (0.228)\tdata 0.000 (0.005)\teta 0:16:28\tloss 3.5371 (3.5555)\tacc 43.7500 (42.1023)\tlr 0.000030\n",
      "epoch: [50/60][120/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:16:24\tloss 3.6545 (3.5726)\tacc 43.7500 (41.7708)\tlr 0.000030\n",
      "epoch: [50/60][130/404]\ttime 0.226 (0.227)\tdata 0.000 (0.004)\teta 0:16:21\tloss 3.6677 (3.5740)\tacc 40.6250 (41.6587)\tlr 0.000030\n",
      "epoch: [50/60][140/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:16:17\tloss 3.3923 (3.5680)\tacc 43.7500 (41.8527)\tlr 0.000030\n",
      "epoch: [50/60][150/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:16:14\tloss 3.4046 (3.5708)\tacc 50.0000 (41.9375)\tlr 0.000030\n",
      "epoch: [50/60][160/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:16:11\tloss 3.6254 (3.5825)\tacc 37.5000 (41.7188)\tlr 0.000030\n",
      "epoch: [50/60][170/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:16:07\tloss 3.3659 (3.5801)\tacc 37.5000 (41.8382)\tlr 0.000030\n",
      "epoch: [50/60][180/404]\ttime 0.226 (0.226)\tdata 0.000 (0.003)\teta 0:16:04\tloss 3.1312 (3.5769)\tacc 56.2500 (41.8750)\tlr 0.000030\n",
      "epoch: [50/60][190/404]\ttime 0.226 (0.226)\tdata 0.000 (0.003)\teta 0:16:01\tloss 3.3544 (3.5770)\tacc 53.1250 (41.9079)\tlr 0.000030\n",
      "epoch: [50/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:15:58\tloss 3.5435 (3.5766)\tacc 46.8750 (41.9375)\tlr 0.000030\n",
      "epoch: [50/60][210/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:15:56\tloss 3.6495 (3.5740)\tacc 46.8750 (41.8452)\tlr 0.000030\n",
      "epoch: [50/60][220/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:15:53\tloss 3.6592 (3.5767)\tacc 46.8750 (41.7756)\tlr 0.000030\n",
      "epoch: [50/60][230/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:15:50\tloss 3.5888 (3.5800)\tacc 46.8750 (41.7391)\tlr 0.000030\n",
      "epoch: [50/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:15:47\tloss 3.6862 (3.5828)\tacc 37.5000 (41.6276)\tlr 0.000030\n",
      "epoch: [50/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:15:45\tloss 3.7645 (3.5815)\tacc 37.5000 (41.6500)\tlr 0.000030\n",
      "epoch: [50/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:15:42\tloss 3.4094 (3.5827)\tacc 50.0000 (41.6106)\tlr 0.000030\n",
      "epoch: [50/60][270/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:15:39\tloss 3.6727 (3.5801)\tacc 31.2500 (41.5046)\tlr 0.000030\n",
      "epoch: [50/60][280/404]\ttime 0.226 (0.225)\tdata 0.000 (0.002)\teta 0:15:37\tloss 3.0545 (3.5748)\tacc 56.2500 (41.6853)\tlr 0.000030\n",
      "epoch: [50/60][290/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:15:34\tloss 3.2236 (3.5791)\tacc 59.3750 (41.5409)\tlr 0.000030\n",
      "epoch: [50/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:15:32\tloss 3.1680 (3.5790)\tacc 50.0000 (41.5938)\tlr 0.000030\n",
      "epoch: [50/60][310/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:15:29\tloss 3.2392 (3.5796)\tacc 43.7500 (41.6028)\tlr 0.000030\n",
      "epoch: [50/60][320/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:15:27\tloss 3.7149 (3.5773)\tacc 40.6250 (41.6797)\tlr 0.000030\n",
      "epoch: [50/60][330/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:15:24\tloss 3.5570 (3.5776)\tacc 40.6250 (41.6098)\tlr 0.000030\n",
      "epoch: [50/60][340/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:15:22\tloss 3.3649 (3.5768)\tacc 53.1250 (41.5717)\tlr 0.000030\n",
      "epoch: [50/60][350/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:15:19\tloss 3.7625 (3.5773)\tacc 40.6250 (41.6161)\tlr 0.000030\n",
      "epoch: [50/60][360/404]\ttime 0.219 (0.225)\tdata 0.000 (0.002)\teta 0:15:17\tloss 3.3149 (3.5770)\tacc 50.0000 (41.6146)\tlr 0.000030\n",
      "epoch: [50/60][370/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:15:15\tloss 3.5894 (3.5759)\tacc 46.8750 (41.6639)\tlr 0.000030\n",
      "epoch: [50/60][380/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:15:12\tloss 3.4547 (3.5731)\tacc 53.1250 (41.7434)\tlr 0.000030\n",
      "epoch: [50/60][390/404]\ttime 0.227 (0.225)\tdata 0.000 (0.002)\teta 0:15:10\tloss 3.9842 (3.5742)\tacc 34.3750 (41.6747)\tlr 0.000030\n",
      "epoch: [50/60][400/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:15:08\tloss 3.1453 (3.5752)\tacc 46.8750 (41.6094)\tlr 0.000030\n",
      "##### Evaluating cv_data (target) #####\n",
      "Extracting features from query set ...\n",
      "Done, obtained 39-by-2048 matrix\n",
      "Extracting features from gallery set ...\n",
      "Done, obtained 180-by-2048 matrix\n",
      "Speed: 0.0139 sec/batch\n",
      "Computing distance matrix with metric=euclidean ...\n",
      "Computing CMC and mAP ...\n",
      "** Results **\n",
      "mAP: 42.6%\n",
      "CMC curve\n",
      "Rank-1  : 33.3%\n",
      "Rank-5  : 71.8%\n",
      "Rank-10 : 79.5%\n",
      "Rank-20 : 87.2%\n",
      "Checkpoint saved to \"log/test-softmax-market1501-cv-test/model/model.pth.tar-50\"\n",
      "epoch: [51/60][10/404]\ttime 0.223 (0.285)\tdata 0.000 (0.054)\teta 0:19:10\tloss 3.5395 (3.4402)\tacc 43.7500 (49.6875)\tlr 0.000003\n",
      "epoch: [51/60][20/404]\ttime 0.221 (0.254)\tdata 0.000 (0.027)\teta 0:17:00\tloss 3.6947 (3.5400)\tacc 40.6250 (45.1562)\tlr 0.000003\n",
      "epoch: [51/60][30/404]\ttime 0.223 (0.243)\tdata 0.000 (0.018)\teta 0:16:16\tloss 3.4674 (3.5189)\tacc 46.8750 (44.5833)\tlr 0.000003\n",
      "epoch: [51/60][40/404]\ttime 0.223 (0.238)\tdata 0.000 (0.014)\teta 0:15:52\tloss 3.2942 (3.5383)\tacc 46.8750 (43.2812)\tlr 0.000003\n",
      "epoch: [51/60][50/404]\ttime 0.225 (0.235)\tdata 0.000 (0.011)\teta 0:15:37\tloss 3.3011 (3.5029)\tacc 53.1250 (44.3125)\tlr 0.000003\n",
      "epoch: [51/60][60/404]\ttime 0.223 (0.233)\tdata 0.000 (0.009)\teta 0:15:28\tloss 3.5289 (3.4905)\tacc 46.8750 (44.3229)\tlr 0.000003\n",
      "epoch: [51/60][70/404]\ttime 0.221 (0.232)\tdata 0.000 (0.008)\teta 0:15:20\tloss 3.9283 (3.4995)\tacc 34.3750 (44.3750)\tlr 0.000003\n",
      "epoch: [51/60][80/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:15:13\tloss 3.6280 (3.5082)\tacc 37.5000 (43.9453)\tlr 0.000003\n",
      "epoch: [51/60][90/404]\ttime 0.224 (0.230)\tdata 0.000 (0.006)\teta 0:15:08\tloss 3.1291 (3.5067)\tacc 59.3750 (43.7847)\tlr 0.000003\n",
      "epoch: [51/60][100/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:15:03\tloss 3.1716 (3.5078)\tacc 50.0000 (43.7812)\tlr 0.000003\n",
      "epoch: [51/60][110/404]\ttime 0.223 (0.229)\tdata 0.000 (0.005)\teta 0:14:58\tloss 3.4704 (3.5102)\tacc 40.6250 (43.5511)\tlr 0.000003\n",
      "epoch: [51/60][120/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:14:54\tloss 3.3358 (3.5058)\tacc 46.8750 (43.6979)\tlr 0.000003\n",
      "epoch: [51/60][130/404]\ttime 0.224 (0.228)\tdata 0.000 (0.004)\teta 0:14:50\tloss 3.6108 (3.5084)\tacc 50.0000 (43.7019)\tlr 0.000003\n",
      "epoch: [51/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:14:46\tloss 3.8330 (3.5154)\tacc 34.3750 (43.4598)\tlr 0.000003\n",
      "epoch: [51/60][150/404]\ttime 0.223 (0.227)\tdata 0.000 (0.004)\teta 0:14:43\tloss 3.8999 (3.5116)\tacc 31.2500 (43.4583)\tlr 0.000003\n",
      "epoch: [51/60][160/404]\ttime 0.224 (0.227)\tdata 0.000 (0.003)\teta 0:14:39\tloss 3.8200 (3.5153)\tacc 28.1250 (43.0664)\tlr 0.000003\n",
      "epoch: [51/60][170/404]\ttime 0.223 (0.227)\tdata 0.000 (0.003)\teta 0:14:36\tloss 3.6021 (3.5118)\tacc 40.6250 (43.2169)\tlr 0.000003\n",
      "epoch: [51/60][180/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:14:33\tloss 3.4954 (3.5163)\tacc 46.8750 (43.0729)\tlr 0.000003\n",
      "epoch: [51/60][190/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:14:30\tloss 3.5020 (3.5111)\tacc 37.5000 (43.0757)\tlr 0.000003\n",
      "epoch: [51/60][200/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:14:27\tloss 3.4096 (3.5073)\tacc 43.7500 (43.1719)\tlr 0.000003\n",
      "epoch: [51/60][210/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:14:24\tloss 3.8447 (3.5109)\tacc 28.1250 (43.0952)\tlr 0.000003\n",
      "epoch: [51/60][220/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:14:21\tloss 3.6407 (3.5131)\tacc 50.0000 (43.1250)\tlr 0.000003\n",
      "epoch: [51/60][230/404]\ttime 0.225 (0.226)\tdata 0.000 (0.002)\teta 0:14:19\tloss 3.2605 (3.5098)\tacc 56.2500 (43.2880)\tlr 0.000003\n",
      "epoch: [51/60][240/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:14:16\tloss 4.0593 (3.5076)\tacc 31.2500 (43.2943)\tlr 0.000003\n",
      "epoch: [51/60][250/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:14:13\tloss 3.4449 (3.5097)\tacc 46.8750 (43.0750)\tlr 0.000003\n",
      "epoch: [51/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:14:10\tloss 3.1052 (3.5086)\tacc 50.0000 (43.1250)\tlr 0.000003\n",
      "epoch: [51/60][270/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:14:08\tloss 3.7676 (3.5088)\tacc 37.5000 (43.0671)\tlr 0.000003\n",
      "epoch: [51/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:14:05\tloss 3.3292 (3.5087)\tacc 43.7500 (42.9576)\tlr 0.000003\n",
      "epoch: [51/60][290/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:14:02\tloss 4.0679 (3.5130)\tacc 21.8750 (42.8556)\tlr 0.000003\n",
      "epoch: [51/60][300/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:14:00\tloss 3.3707 (3.5090)\tacc 43.7500 (42.9375)\tlr 0.000003\n",
      "epoch: [51/60][310/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:13:57\tloss 3.4502 (3.5074)\tacc 43.7500 (42.9637)\tlr 0.000003\n",
      "epoch: [51/60][320/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:13:55\tloss 3.9211 (3.5072)\tacc 28.1250 (42.9004)\tlr 0.000003\n",
      "epoch: [51/60][330/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:13:52\tloss 3.5129 (3.5097)\tacc 46.8750 (42.7557)\tlr 0.000003\n",
      "epoch: [51/60][340/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:13:50\tloss 3.1627 (3.5110)\tacc 46.8750 (42.7757)\tlr 0.000003\n",
      "epoch: [51/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:13:47\tloss 3.4733 (3.5106)\tacc 40.6250 (42.7857)\tlr 0.000003\n",
      "epoch: [51/60][360/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:13:45\tloss 3.9065 (3.5080)\tacc 40.6250 (43.0208)\tlr 0.000003\n",
      "epoch: [51/60][370/404]\ttime 0.218 (0.224)\tdata 0.000 (0.002)\teta 0:13:42\tloss 3.8221 (3.5081)\tacc 28.1250 (43.0574)\tlr 0.000003\n",
      "epoch: [51/60][380/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:13:40\tloss 3.5266 (3.5072)\tacc 43.7500 (43.0839)\tlr 0.000003\n",
      "epoch: [51/60][390/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:13:37\tloss 3.5133 (3.5091)\tacc 46.8750 (43.0128)\tlr 0.000003\n",
      "epoch: [51/60][400/404]\ttime 0.218 (0.224)\tdata 0.000 (0.001)\teta 0:13:35\tloss 3.8433 (3.5094)\tacc 34.3750 (43.0625)\tlr 0.000003\n",
      "epoch: [52/60][10/404]\ttime 0.224 (0.286)\tdata 0.000 (0.062)\teta 0:17:17\tloss 3.7088 (3.4453)\tacc 40.6250 (44.0625)\tlr 0.000003\n",
      "epoch: [52/60][20/404]\ttime 0.222 (0.253)\tdata 0.000 (0.031)\teta 0:15:16\tloss 3.5894 (3.4701)\tacc 43.7500 (44.6875)\tlr 0.000003\n",
      "epoch: [52/60][30/404]\ttime 0.224 (0.243)\tdata 0.000 (0.021)\teta 0:14:37\tloss 2.9956 (3.4735)\tacc 50.0000 (43.1250)\tlr 0.000003\n",
      "epoch: [52/60][40/404]\ttime 0.220 (0.238)\tdata 0.000 (0.016)\teta 0:14:14\tloss 3.9367 (3.4622)\tacc 34.3750 (43.1250)\tlr 0.000003\n",
      "epoch: [52/60][50/404]\ttime 0.223 (0.235)\tdata 0.000 (0.012)\teta 0:14:02\tloss 3.0383 (3.4454)\tacc 46.8750 (43.9375)\tlr 0.000003\n",
      "epoch: [52/60][60/404]\ttime 0.220 (0.233)\tdata 0.000 (0.010)\teta 0:13:52\tloss 3.3904 (3.4403)\tacc 37.5000 (44.3750)\tlr 0.000003\n",
      "epoch: [52/60][70/404]\ttime 0.218 (0.231)\tdata 0.000 (0.009)\teta 0:13:44\tloss 4.0954 (3.4691)\tacc 21.8750 (43.6161)\tlr 0.000003\n",
      "epoch: [52/60][80/404]\ttime 0.224 (0.230)\tdata 0.000 (0.008)\teta 0:13:38\tloss 3.7995 (3.4856)\tacc 34.3750 (43.2031)\tlr 0.000003\n",
      "epoch: [52/60][90/404]\ttime 0.221 (0.229)\tdata 0.000 (0.007)\teta 0:13:32\tloss 2.9843 (3.4774)\tacc 68.7500 (43.8194)\tlr 0.000003\n",
      "epoch: [52/60][100/404]\ttime 0.224 (0.228)\tdata 0.000 (0.006)\teta 0:13:27\tloss 3.1516 (3.4748)\tacc 53.1250 (43.8750)\tlr 0.000003\n",
      "epoch: [52/60][110/404]\ttime 0.224 (0.228)\tdata 0.000 (0.006)\teta 0:13:23\tloss 3.6537 (3.4749)\tacc 28.1250 (43.6932)\tlr 0.000003\n",
      "epoch: [52/60][120/404]\ttime 0.220 (0.227)\tdata 0.000 (0.005)\teta 0:13:19\tloss 3.8913 (3.4968)\tacc 34.3750 (43.3854)\tlr 0.000003\n",
      "epoch: [52/60][130/404]\ttime 0.225 (0.227)\tdata 0.000 (0.005)\teta 0:13:15\tloss 3.2630 (3.4944)\tacc 50.0000 (43.4135)\tlr 0.000003\n",
      "epoch: [52/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.005)\teta 0:13:11\tloss 3.0776 (3.4922)\tacc 50.0000 (43.4152)\tlr 0.000003\n",
      "epoch: [52/60][150/404]\ttime 0.223 (0.226)\tdata 0.000 (0.004)\teta 0:13:08\tloss 3.4181 (3.4891)\tacc 43.7500 (43.3125)\tlr 0.000003\n",
      "epoch: [52/60][160/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:13:05\tloss 3.2911 (3.4886)\tacc 53.1250 (43.5352)\tlr 0.000003\n",
      "epoch: [52/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.004)\teta 0:13:02\tloss 3.6944 (3.4916)\tacc 34.3750 (43.4375)\tlr 0.000003\n",
      "epoch: [52/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:12:59\tloss 3.1396 (3.4907)\tacc 50.0000 (43.6632)\tlr 0.000003\n",
      "epoch: [52/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:12:57\tloss 3.6450 (3.4942)\tacc 40.6250 (43.7007)\tlr 0.000003\n",
      "epoch: [52/60][200/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:12:54\tloss 3.6892 (3.4966)\tacc 37.5000 (43.6562)\tlr 0.000003\n",
      "epoch: [52/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:12:51\tloss 3.4585 (3.4960)\tacc 28.1250 (43.6607)\tlr 0.000003\n",
      "epoch: [52/60][220/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:12:48\tloss 3.4040 (3.4973)\tacc 34.3750 (43.6080)\tlr 0.000003\n",
      "epoch: [52/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:12:46\tloss 3.4923 (3.4999)\tacc 37.5000 (43.4647)\tlr 0.000003\n",
      "epoch: [52/60][240/404]\ttime 0.219 (0.225)\tdata 0.000 (0.003)\teta 0:12:43\tloss 3.7739 (3.5011)\tacc 43.7500 (43.4635)\tlr 0.000003\n",
      "epoch: [52/60][250/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:12:41\tloss 3.6188 (3.5010)\tacc 43.7500 (43.3750)\tlr 0.000003\n",
      "epoch: [52/60][260/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:12:38\tloss 3.6548 (3.5072)\tacc 40.6250 (43.1971)\tlr 0.000003\n",
      "epoch: [52/60][270/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:12:36\tloss 3.8637 (3.5084)\tacc 31.2500 (43.2292)\tlr 0.000003\n",
      "epoch: [52/60][280/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:12:33\tloss 3.6039 (3.5101)\tacc 40.6250 (43.1250)\tlr 0.000003\n",
      "epoch: [52/60][290/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:12:30\tloss 3.2167 (3.5034)\tacc 53.1250 (43.3836)\tlr 0.000003\n",
      "epoch: [52/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:12:28\tloss 3.6113 (3.5049)\tacc 31.2500 (43.2604)\tlr 0.000003\n",
      "epoch: [52/60][310/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:12:25\tloss 3.5144 (3.5056)\tacc 40.6250 (43.2359)\tlr 0.000003\n",
      "epoch: [52/60][320/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:12:23\tloss 3.9194 (3.5049)\tacc 40.6250 (43.2031)\tlr 0.000003\n",
      "epoch: [52/60][330/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:12:21\tloss 3.6665 (3.5059)\tacc 37.5000 (43.0871)\tlr 0.000003\n",
      "epoch: [52/60][340/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:12:18\tloss 3.3338 (3.5060)\tacc 46.8750 (43.0607)\tlr 0.000003\n",
      "epoch: [52/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:12:16\tloss 3.5917 (3.5098)\tacc 40.6250 (42.9464)\tlr 0.000003\n",
      "epoch: [52/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:12:14\tloss 3.2583 (3.5083)\tacc 53.1250 (42.9861)\tlr 0.000003\n",
      "epoch: [52/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:12:11\tloss 3.1469 (3.5050)\tacc 50.0000 (43.1250)\tlr 0.000003\n",
      "epoch: [52/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:12:09\tloss 3.5264 (3.5088)\tacc 37.5000 (42.9852)\tlr 0.000003\n",
      "epoch: [52/60][390/404]\ttime 0.219 (0.224)\tdata 0.000 (0.002)\teta 0:12:07\tloss 3.3456 (3.5077)\tacc 46.8750 (43.0128)\tlr 0.000003\n",
      "epoch: [52/60][400/404]\ttime 0.217 (0.224)\tdata 0.000 (0.002)\teta 0:12:04\tloss 3.3810 (3.5109)\tacc 56.2500 (42.9688)\tlr 0.000003\n",
      "epoch: [53/60][10/404]\ttime 0.220 (0.276)\tdata 0.000 (0.048)\teta 0:14:50\tloss 3.2596 (3.6575)\tacc 59.3750 (41.5625)\tlr 0.000003\n",
      "epoch: [53/60][20/404]\ttime 0.221 (0.249)\tdata 0.000 (0.024)\teta 0:13:20\tloss 3.1930 (3.5585)\tacc 53.1250 (43.4375)\tlr 0.000003\n",
      "epoch: [53/60][30/404]\ttime 0.222 (0.240)\tdata 0.000 (0.016)\teta 0:12:49\tloss 3.8159 (3.5674)\tacc 18.7500 (42.9167)\tlr 0.000003\n",
      "epoch: [53/60][40/404]\ttime 0.221 (0.236)\tdata 0.000 (0.012)\teta 0:12:32\tloss 3.6585 (3.5562)\tacc 46.8750 (43.2031)\tlr 0.000003\n",
      "epoch: [53/60][50/404]\ttime 0.225 (0.233)\tdata 0.000 (0.010)\teta 0:12:22\tloss 3.1226 (3.5189)\tacc 59.3750 (43.6875)\tlr 0.000003\n",
      "epoch: [53/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.008)\teta 0:12:14\tloss 3.4420 (3.5270)\tacc 43.7500 (43.6458)\tlr 0.000003\n",
      "epoch: [53/60][70/404]\ttime 0.221 (0.230)\tdata 0.000 (0.007)\teta 0:12:07\tloss 2.9184 (3.5112)\tacc 62.5000 (43.8839)\tlr 0.000003\n",
      "epoch: [53/60][80/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:12:01\tloss 3.7797 (3.5210)\tacc 40.6250 (43.7891)\tlr 0.000003\n",
      "epoch: [53/60][90/404]\ttime 0.231 (0.228)\tdata 0.000 (0.005)\teta 0:11:57\tloss 3.1938 (3.5180)\tacc 56.2500 (43.7153)\tlr 0.000003\n",
      "epoch: [53/60][100/404]\ttime 0.224 (0.228)\tdata 0.000 (0.005)\teta 0:11:53\tloss 3.6021 (3.5162)\tacc 43.7500 (43.8438)\tlr 0.000003\n",
      "epoch: [53/60][110/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:11:50\tloss 3.0998 (3.5109)\tacc 50.0000 (43.8920)\tlr 0.000003\n",
      "epoch: [53/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:11:46\tloss 3.6490 (3.5054)\tacc 46.8750 (43.9062)\tlr 0.000003\n",
      "epoch: [53/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:11:43\tloss 3.5115 (3.5019)\tacc 43.7500 (43.7500)\tlr 0.000003\n",
      "epoch: [53/60][140/404]\ttime 0.223 (0.226)\tdata 0.000 (0.004)\teta 0:11:40\tloss 3.6053 (3.5020)\tacc 40.6250 (43.6384)\tlr 0.000003\n",
      "epoch: [53/60][150/404]\ttime 0.225 (0.226)\tdata 0.000 (0.003)\teta 0:11:36\tloss 3.0209 (3.5026)\tacc 65.6250 (43.6042)\tlr 0.000003\n",
      "epoch: [53/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:11:33\tloss 3.2795 (3.4981)\tacc 40.6250 (43.8281)\tlr 0.000003\n",
      "epoch: [53/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:11:31\tloss 3.2115 (3.5004)\tacc 56.2500 (43.6949)\tlr 0.000003\n",
      "epoch: [53/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:11:28\tloss 3.4301 (3.5072)\tacc 40.6250 (43.4028)\tlr 0.000003\n",
      "epoch: [53/60][190/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:11:25\tloss 3.3077 (3.5047)\tacc 46.8750 (43.3717)\tlr 0.000003\n",
      "epoch: [53/60][200/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:11:22\tloss 3.5046 (3.5029)\tacc 40.6250 (43.4531)\tlr 0.000003\n",
      "epoch: [53/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:11:20\tloss 3.5684 (3.4990)\tacc 28.1250 (43.4077)\tlr 0.000003\n",
      "epoch: [53/60][220/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:11:17\tloss 3.2579 (3.5034)\tacc 40.6250 (43.4233)\tlr 0.000003\n",
      "epoch: [53/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:11:14\tloss 3.2802 (3.4964)\tacc 43.7500 (43.6549)\tlr 0.000003\n",
      "epoch: [53/60][240/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:11:12\tloss 3.4527 (3.4969)\tacc 43.7500 (43.6719)\tlr 0.000003\n",
      "epoch: [53/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:11:09\tloss 3.6609 (3.4966)\tacc 40.6250 (43.6000)\tlr 0.000003\n",
      "epoch: [53/60][260/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:11:07\tloss 3.8924 (3.4990)\tacc 31.2500 (43.4976)\tlr 0.000003\n",
      "epoch: [53/60][270/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:11:04\tloss 3.5207 (3.4945)\tacc 50.0000 (43.5532)\tlr 0.000003\n",
      "epoch: [53/60][280/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:11:01\tloss 3.3018 (3.4938)\tacc 43.7500 (43.4598)\tlr 0.000003\n",
      "epoch: [53/60][290/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:10:59\tloss 3.3311 (3.4911)\tacc 37.5000 (43.4914)\tlr 0.000003\n",
      "epoch: [53/60][300/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:10:57\tloss 3.7512 (3.4930)\tacc 43.7500 (43.5417)\tlr 0.000003\n",
      "epoch: [53/60][310/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:10:54\tloss 3.6166 (3.4941)\tacc 40.6250 (43.5685)\tlr 0.000003\n",
      "epoch: [53/60][320/404]\ttime 0.226 (0.224)\tdata 0.000 (0.002)\teta 0:10:52\tloss 3.6557 (3.4944)\tacc 40.6250 (43.5156)\tlr 0.000003\n",
      "epoch: [53/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:10:49\tloss 3.6506 (3.4930)\tacc 40.6250 (43.5606)\tlr 0.000003\n",
      "epoch: [53/60][340/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:10:47\tloss 4.0800 (3.4956)\tacc 28.1250 (43.5018)\tlr 0.000003\n",
      "epoch: [53/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:10:44\tloss 2.9361 (3.4940)\tacc 59.3750 (43.6071)\tlr 0.000003\n",
      "epoch: [53/60][360/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:10:42\tloss 3.1931 (3.4947)\tacc 46.8750 (43.6198)\tlr 0.000003\n",
      "epoch: [53/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:10:40\tloss 3.6223 (3.4931)\tacc 43.7500 (43.7416)\tlr 0.000003\n",
      "epoch: [53/60][380/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:10:37\tloss 3.1579 (3.4944)\tacc 50.0000 (43.7747)\tlr 0.000003\n",
      "epoch: [53/60][390/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:10:35\tloss 3.2688 (3.4937)\tacc 50.0000 (43.8141)\tlr 0.000003\n",
      "epoch: [53/60][400/404]\ttime 0.216 (0.224)\tdata 0.000 (0.001)\teta 0:10:32\tloss 3.7644 (3.4943)\tacc 34.3750 (43.7578)\tlr 0.000003\n",
      "epoch: [54/60][10/404]\ttime 0.223 (0.282)\tdata 0.000 (0.055)\teta 0:13:13\tloss 3.5621 (3.5191)\tacc 43.7500 (43.4375)\tlr 0.000003\n",
      "epoch: [54/60][20/404]\ttime 0.220 (0.252)\tdata 0.000 (0.028)\teta 0:11:47\tloss 3.6449 (3.4688)\tacc 46.8750 (44.2188)\tlr 0.000003\n",
      "epoch: [54/60][30/404]\ttime 0.223 (0.242)\tdata 0.000 (0.018)\teta 0:11:15\tloss 3.2716 (3.4904)\tacc 46.8750 (43.9583)\tlr 0.000003\n",
      "epoch: [54/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.014)\teta 0:11:00\tloss 3.5781 (3.5255)\tacc 43.7500 (43.5156)\tlr 0.000003\n",
      "epoch: [54/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.011)\teta 0:10:49\tloss 3.3256 (3.4968)\tacc 50.0000 (43.6250)\tlr 0.000003\n",
      "epoch: [54/60][60/404]\ttime 0.223 (0.232)\tdata 0.000 (0.009)\teta 0:10:42\tloss 3.7361 (3.5089)\tacc 31.2500 (42.8125)\tlr 0.000003\n",
      "epoch: [54/60][70/404]\ttime 0.221 (0.231)\tdata 0.000 (0.008)\teta 0:10:35\tloss 3.7037 (3.5091)\tacc 37.5000 (42.5000)\tlr 0.000003\n",
      "epoch: [54/60][80/404]\ttime 0.222 (0.229)\tdata 0.000 (0.007)\teta 0:10:30\tloss 3.6953 (3.5312)\tacc 31.2500 (41.7578)\tlr 0.000003\n",
      "epoch: [54/60][90/404]\ttime 0.222 (0.229)\tdata 0.000 (0.006)\teta 0:10:26\tloss 3.6451 (3.5321)\tacc 34.3750 (41.9444)\tlr 0.000003\n",
      "epoch: [54/60][100/404]\ttime 0.221 (0.228)\tdata 0.000 (0.006)\teta 0:10:22\tloss 3.7654 (3.5230)\tacc 37.5000 (42.1875)\tlr 0.000003\n",
      "epoch: [54/60][110/404]\ttime 0.224 (0.228)\tdata 0.000 (0.005)\teta 0:10:18\tloss 3.7789 (3.5250)\tacc 37.5000 (42.3580)\tlr 0.000003\n",
      "epoch: [54/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.005)\teta 0:10:15\tloss 3.2525 (3.5103)\tacc 53.1250 (42.6302)\tlr 0.000003\n",
      "epoch: [54/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:10:12\tloss 3.0350 (3.5026)\tacc 56.2500 (42.9567)\tlr 0.000003\n",
      "epoch: [54/60][140/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:10:09\tloss 3.6600 (3.5012)\tacc 37.5000 (43.0134)\tlr 0.000003\n",
      "epoch: [54/60][150/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:10:06\tloss 3.3419 (3.4989)\tacc 56.2500 (43.3125)\tlr 0.000003\n",
      "epoch: [54/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.004)\teta 0:10:03\tloss 3.2368 (3.5032)\tacc 50.0000 (43.0664)\tlr 0.000003\n",
      "epoch: [54/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:10:00\tloss 3.6389 (3.5021)\tacc 43.7500 (43.0699)\tlr 0.000003\n",
      "epoch: [54/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:09:57\tloss 3.4331 (3.5019)\tacc 46.8750 (43.1944)\tlr 0.000003\n",
      "epoch: [54/60][190/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:09:55\tloss 3.3129 (3.5021)\tacc 46.8750 (43.2401)\tlr 0.000003\n",
      "epoch: [54/60][200/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:09:52\tloss 3.4552 (3.5027)\tacc 37.5000 (43.2188)\tlr 0.000003\n",
      "epoch: [54/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:09:49\tloss 3.4287 (3.5055)\tacc 56.2500 (43.1994)\tlr 0.000003\n",
      "epoch: [54/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:09:47\tloss 3.1343 (3.5008)\tacc 50.0000 (43.2670)\tlr 0.000003\n",
      "epoch: [54/60][230/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:09:44\tloss 3.5954 (3.5009)\tacc 43.7500 (43.4103)\tlr 0.000003\n",
      "epoch: [54/60][240/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:09:42\tloss 3.1455 (3.4987)\tacc 65.6250 (43.5026)\tlr 0.000003\n",
      "epoch: [54/60][250/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:09:39\tloss 3.4106 (3.4926)\tacc 46.8750 (43.6500)\tlr 0.000003\n",
      "epoch: [54/60][260/404]\ttime 0.222 (0.225)\tdata 0.001 (0.002)\teta 0:09:37\tloss 3.3123 (3.4902)\tacc 59.3750 (43.8101)\tlr 0.000003\n",
      "epoch: [54/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:09:34\tloss 3.2351 (3.4891)\tacc 59.3750 (43.9005)\tlr 0.000003\n",
      "epoch: [54/60][280/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:09:32\tloss 3.2355 (3.4900)\tacc 59.3750 (43.8728)\tlr 0.000003\n",
      "epoch: [54/60][290/404]\ttime 0.221 (0.225)\tdata 0.001 (0.002)\teta 0:09:29\tloss 3.9872 (3.4896)\tacc 34.3750 (43.7608)\tlr 0.000003\n",
      "epoch: [54/60][300/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:09:27\tloss 3.6860 (3.4919)\tacc 34.3750 (43.6771)\tlr 0.000003\n",
      "epoch: [54/60][310/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:09:25\tloss 3.4137 (3.4952)\tacc 37.5000 (43.6290)\tlr 0.000003\n",
      "epoch: [54/60][320/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:09:22\tloss 3.4577 (3.4910)\tacc 37.5000 (43.6621)\tlr 0.000003\n",
      "epoch: [54/60][330/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:09:20\tloss 3.4771 (3.4945)\tacc 40.6250 (43.5511)\tlr 0.000003\n",
      "epoch: [54/60][340/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:09:17\tloss 2.9134 (3.4927)\tacc 59.3750 (43.6029)\tlr 0.000003\n",
      "epoch: [54/60][350/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:09:15\tloss 3.9189 (3.4963)\tacc 28.1250 (43.5179)\tlr 0.000003\n",
      "epoch: [54/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:09:12\tloss 3.9639 (3.4967)\tacc 25.0000 (43.5330)\tlr 0.000003\n",
      "epoch: [54/60][370/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:09:10\tloss 3.5120 (3.4977)\tacc 50.0000 (43.4797)\tlr 0.000003\n",
      "epoch: [54/60][380/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:09:08\tloss 3.5972 (3.4959)\tacc 43.7500 (43.5115)\tlr 0.000003\n",
      "epoch: [54/60][390/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:09:06\tloss 3.1918 (3.4948)\tacc 59.3750 (43.5417)\tlr 0.000003\n",
      "epoch: [54/60][400/404]\ttime 0.220 (0.224)\tdata 0.000 (0.001)\teta 0:09:03\tloss 3.5304 (3.4952)\tacc 50.0000 (43.5234)\tlr 0.000003\n",
      "epoch: [55/60][10/404]\ttime 0.222 (0.288)\tdata 0.000 (0.061)\teta 0:11:36\tloss 3.8621 (3.5074)\tacc 18.7500 (40.0000)\tlr 0.000003\n",
      "epoch: [55/60][20/404]\ttime 0.221 (0.255)\tdata 0.000 (0.031)\teta 0:10:13\tloss 3.9579 (3.5111)\tacc 28.1250 (42.1875)\tlr 0.000003\n",
      "epoch: [55/60][30/404]\ttime 0.222 (0.244)\tdata 0.000 (0.020)\teta 0:09:44\tloss 3.3188 (3.4744)\tacc 62.5000 (43.2292)\tlr 0.000003\n",
      "epoch: [55/60][40/404]\ttime 0.223 (0.239)\tdata 0.000 (0.015)\teta 0:09:29\tloss 3.6321 (3.4711)\tacc 40.6250 (44.3750)\tlr 0.000003\n",
      "epoch: [55/60][50/404]\ttime 0.221 (0.236)\tdata 0.000 (0.012)\teta 0:09:19\tloss 3.4156 (3.4613)\tacc 53.1250 (44.5000)\tlr 0.000003\n",
      "epoch: [55/60][60/404]\ttime 0.222 (0.233)\tdata 0.000 (0.010)\teta 0:09:11\tloss 3.8162 (3.4751)\tacc 31.2500 (44.1146)\tlr 0.000003\n",
      "epoch: [55/60][70/404]\ttime 0.221 (0.232)\tdata 0.000 (0.009)\teta 0:09:05\tloss 3.1402 (3.4706)\tacc 56.2500 (44.5089)\tlr 0.000003\n",
      "epoch: [55/60][80/404]\ttime 0.226 (0.230)\tdata 0.000 (0.008)\teta 0:09:00\tloss 3.5310 (3.4666)\tacc 37.5000 (44.4531)\tlr 0.000003\n",
      "epoch: [55/60][90/404]\ttime 0.224 (0.229)\tdata 0.000 (0.007)\teta 0:08:55\tloss 3.7934 (3.4731)\tacc 34.3750 (43.9931)\tlr 0.000003\n",
      "epoch: [55/60][100/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:08:51\tloss 3.1401 (3.4573)\tacc 50.0000 (44.5312)\tlr 0.000003\n",
      "epoch: [55/60][110/404]\ttime 0.223 (0.228)\tdata 0.000 (0.006)\teta 0:08:47\tloss 3.6483 (3.4602)\tacc 25.0000 (44.4318)\tlr 0.000003\n",
      "epoch: [55/60][120/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:08:44\tloss 3.5332 (3.4559)\tacc 46.8750 (44.6875)\tlr 0.000003\n",
      "epoch: [55/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.005)\teta 0:08:41\tloss 3.4150 (3.4558)\tacc 56.2500 (44.7115)\tlr 0.000003\n",
      "epoch: [55/60][140/404]\ttime 0.223 (0.227)\tdata 0.000 (0.005)\teta 0:08:38\tloss 3.2022 (3.4631)\tacc 43.7500 (44.4866)\tlr 0.000003\n",
      "epoch: [55/60][150/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:08:35\tloss 3.3657 (3.4641)\tacc 46.8750 (44.5208)\tlr 0.000003\n",
      "epoch: [55/60][160/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:08:32\tloss 3.4194 (3.4637)\tacc 46.8750 (44.5117)\tlr 0.000003\n",
      "epoch: [55/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.004)\teta 0:08:29\tloss 3.4242 (3.4621)\tacc 43.7500 (44.3015)\tlr 0.000003\n",
      "epoch: [55/60][180/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:08:27\tloss 3.3507 (3.4589)\tacc 43.7500 (44.5139)\tlr 0.000003\n",
      "epoch: [55/60][190/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:08:24\tloss 3.4367 (3.4686)\tacc 46.8750 (44.2599)\tlr 0.000003\n",
      "epoch: [55/60][200/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:08:21\tloss 3.6398 (3.4681)\tacc 40.6250 (44.2031)\tlr 0.000003\n",
      "epoch: [55/60][210/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:08:19\tloss 3.7914 (3.4689)\tacc 40.6250 (44.1815)\tlr 0.000003\n",
      "epoch: [55/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:08:16\tloss 3.3140 (3.4721)\tacc 40.6250 (43.9773)\tlr 0.000003\n",
      "epoch: [55/60][230/404]\ttime 0.227 (0.225)\tdata 0.000 (0.003)\teta 0:08:14\tloss 3.7048 (3.4766)\tacc 37.5000 (43.9402)\tlr 0.000003\n",
      "epoch: [55/60][240/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:08:11\tloss 3.5570 (3.4789)\tacc 37.5000 (43.8411)\tlr 0.000003\n",
      "epoch: [55/60][250/404]\ttime 0.226 (0.225)\tdata 0.000 (0.003)\teta 0:08:09\tloss 3.3991 (3.4781)\tacc 37.5000 (43.8500)\tlr 0.000003\n",
      "epoch: [55/60][260/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:08:07\tloss 3.5026 (3.4791)\tacc 50.0000 (43.7981)\tlr 0.000003\n",
      "epoch: [55/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:08:04\tloss 3.5829 (3.4742)\tacc 31.2500 (43.9699)\tlr 0.000003\n",
      "epoch: [55/60][280/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:08:02\tloss 3.5373 (3.4757)\tacc 34.3750 (43.8170)\tlr 0.000003\n",
      "epoch: [55/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:07:59\tloss 3.7818 (3.4759)\tacc 40.6250 (43.8147)\tlr 0.000003\n",
      "epoch: [55/60][300/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:07:57\tloss 3.8532 (3.4806)\tacc 25.0000 (43.5521)\tlr 0.000003\n",
      "epoch: [55/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:07:54\tloss 3.4203 (3.4824)\tacc 46.8750 (43.5585)\tlr 0.000003\n",
      "epoch: [55/60][320/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:07:52\tloss 3.4969 (3.4808)\tacc 34.3750 (43.5352)\tlr 0.000003\n",
      "epoch: [55/60][330/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:07:50\tloss 3.6424 (3.4795)\tacc 43.7500 (43.5606)\tlr 0.000003\n",
      "epoch: [55/60][340/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:07:47\tloss 3.3429 (3.4773)\tacc 59.3750 (43.6857)\tlr 0.000003\n",
      "epoch: [55/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:07:45\tloss 3.6374 (3.4771)\tacc 31.2500 (43.7054)\tlr 0.000003\n",
      "epoch: [55/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:07:43\tloss 4.0037 (3.4805)\tacc 25.0000 (43.5677)\tlr 0.000003\n",
      "epoch: [55/60][370/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:07:40\tloss 3.7409 (3.4823)\tacc 21.8750 (43.5051)\tlr 0.000003\n",
      "epoch: [55/60][380/404]\ttime 0.228 (0.224)\tdata 0.000 (0.002)\teta 0:07:38\tloss 3.7675 (3.4814)\tacc 37.5000 (43.6020)\tlr 0.000003\n",
      "epoch: [55/60][390/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:07:36\tloss 3.6349 (3.4806)\tacc 40.6250 (43.5657)\tlr 0.000003\n",
      "epoch: [55/60][400/404]\ttime 0.218 (0.224)\tdata 0.000 (0.002)\teta 0:07:33\tloss 3.5663 (3.4837)\tacc 34.3750 (43.5312)\tlr 0.000003\n",
      "epoch: [56/60][10/404]\ttime 0.223 (0.281)\tdata 0.000 (0.051)\teta 0:09:25\tloss 3.7701 (3.4055)\tacc 43.7500 (46.2500)\tlr 0.000003\n",
      "epoch: [56/60][20/404]\ttime 0.221 (0.252)\tdata 0.000 (0.025)\teta 0:08:23\tloss 3.8201 (3.4840)\tacc 28.1250 (42.8125)\tlr 0.000003\n",
      "epoch: [56/60][30/404]\ttime 0.221 (0.242)\tdata 0.000 (0.017)\teta 0:08:01\tloss 3.8067 (3.4803)\tacc 37.5000 (44.3750)\tlr 0.000003\n",
      "epoch: [56/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.013)\teta 0:07:49\tloss 3.5489 (3.4746)\tacc 40.6250 (44.3750)\tlr 0.000003\n",
      "epoch: [56/60][50/404]\ttime 0.225 (0.234)\tdata 0.000 (0.010)\teta 0:07:41\tloss 3.5448 (3.5010)\tacc 40.6250 (43.8125)\tlr 0.000003\n",
      "epoch: [56/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.009)\teta 0:07:35\tloss 3.4080 (3.4948)\tacc 53.1250 (43.9583)\tlr 0.000003\n",
      "epoch: [56/60][70/404]\ttime 0.222 (0.231)\tdata 0.000 (0.007)\teta 0:07:30\tloss 3.1729 (3.4841)\tacc 43.7500 (43.7054)\tlr 0.000003\n",
      "epoch: [56/60][80/404]\ttime 0.223 (0.230)\tdata 0.000 (0.006)\teta 0:07:26\tloss 3.6055 (3.4929)\tacc 31.2500 (43.6719)\tlr 0.000003\n",
      "epoch: [56/60][90/404]\ttime 0.222 (0.229)\tdata 0.000 (0.006)\teta 0:07:22\tloss 3.4652 (3.4930)\tacc 37.5000 (43.7500)\tlr 0.000003\n",
      "epoch: [56/60][100/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:07:18\tloss 3.7621 (3.5095)\tacc 40.6250 (43.0000)\tlr 0.000003\n",
      "epoch: [56/60][110/404]\ttime 0.224 (0.228)\tdata 0.000 (0.005)\teta 0:07:15\tloss 2.9751 (3.4862)\tacc 56.2500 (43.5511)\tlr 0.000003\n",
      "epoch: [56/60][120/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:07:12\tloss 3.2442 (3.4835)\tacc 50.0000 (43.5677)\tlr 0.000003\n",
      "epoch: [56/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:07:09\tloss 3.2071 (3.4794)\tacc 43.7500 (43.7019)\tlr 0.000003\n",
      "epoch: [56/60][140/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:07:06\tloss 3.5666 (3.4877)\tacc 50.0000 (43.4152)\tlr 0.000003\n",
      "epoch: [56/60][150/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:07:03\tloss 3.4809 (3.4818)\tacc 43.7500 (43.7292)\tlr 0.000003\n",
      "epoch: [56/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:07:00\tloss 3.4690 (3.4816)\tacc 37.5000 (43.4375)\tlr 0.000003\n",
      "epoch: [56/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:06:58\tloss 3.3113 (3.4840)\tacc 50.0000 (43.2904)\tlr 0.000003\n",
      "epoch: [56/60][180/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:06:55\tloss 3.4514 (3.4821)\tacc 37.5000 (43.3333)\tlr 0.000003\n",
      "epoch: [56/60][190/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:06:53\tloss 3.5527 (3.4811)\tacc 37.5000 (43.4704)\tlr 0.000003\n",
      "epoch: [56/60][200/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:06:50\tloss 3.7492 (3.4834)\tacc 37.5000 (43.4531)\tlr 0.000003\n",
      "epoch: [56/60][210/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:06:48\tloss 3.6917 (3.4760)\tacc 43.7500 (43.6310)\tlr 0.000003\n",
      "epoch: [56/60][220/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:06:45\tloss 3.4422 (3.4816)\tacc 40.6250 (43.6080)\tlr 0.000003\n",
      "epoch: [56/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:06:43\tloss 3.4707 (3.4779)\tacc 50.0000 (43.8315)\tlr 0.000003\n",
      "epoch: [56/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:06:40\tloss 3.8503 (3.4773)\tacc 31.2500 (43.8802)\tlr 0.000003\n",
      "epoch: [56/60][250/404]\ttime 0.231 (0.225)\tdata 0.000 (0.002)\teta 0:06:38\tloss 3.6048 (3.4800)\tacc 40.6250 (43.7625)\tlr 0.000003\n",
      "epoch: [56/60][260/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:06:35\tloss 3.8779 (3.4819)\tacc 28.1250 (43.6178)\tlr 0.000003\n",
      "epoch: [56/60][270/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:06:33\tloss 3.3963 (3.4832)\tacc 50.0000 (43.6574)\tlr 0.000003\n",
      "epoch: [56/60][280/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:06:31\tloss 3.7150 (3.4809)\tacc 40.6250 (43.7612)\tlr 0.000003\n",
      "epoch: [56/60][290/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:06:28\tloss 3.4490 (3.4818)\tacc 40.6250 (43.7500)\tlr 0.000003\n",
      "epoch: [56/60][300/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:06:26\tloss 3.7195 (3.4772)\tacc 43.7500 (43.8021)\tlr 0.000003\n",
      "epoch: [56/60][310/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:06:24\tloss 3.6837 (3.4775)\tacc 28.1250 (43.7500)\tlr 0.000003\n",
      "epoch: [56/60][320/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:06:21\tloss 3.6301 (3.4810)\tacc 43.7500 (43.6328)\tlr 0.000003\n",
      "epoch: [56/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:06:19\tloss 3.3742 (3.4809)\tacc 37.5000 (43.5985)\tlr 0.000003\n",
      "epoch: [56/60][340/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:06:17\tloss 3.4991 (3.4794)\tacc 40.6250 (43.6765)\tlr 0.000003\n",
      "epoch: [56/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:06:14\tloss 3.5536 (3.4800)\tacc 40.6250 (43.6339)\tlr 0.000003\n",
      "epoch: [56/60][360/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:06:12\tloss 3.4250 (3.4782)\tacc 46.8750 (43.6806)\tlr 0.000003\n",
      "epoch: [56/60][370/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:06:10\tloss 3.4246 (3.4795)\tacc 43.7500 (43.6571)\tlr 0.000003\n",
      "epoch: [56/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.001)\teta 0:06:07\tloss 3.1904 (3.4766)\tacc 56.2500 (43.8076)\tlr 0.000003\n",
      "epoch: [56/60][390/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:06:05\tloss 3.9608 (3.4777)\tacc 37.5000 (43.8381)\tlr 0.000003\n",
      "epoch: [56/60][400/404]\ttime 0.221 (0.224)\tdata 0.000 (0.001)\teta 0:06:03\tloss 3.5031 (3.4757)\tacc 40.6250 (43.9688)\tlr 0.000003\n",
      "epoch: [57/60][10/404]\ttime 0.222 (0.280)\tdata 0.000 (0.056)\teta 0:07:30\tloss 3.2664 (3.4664)\tacc 43.7500 (43.4375)\tlr 0.000003\n",
      "epoch: [57/60][20/404]\ttime 0.222 (0.252)\tdata 0.000 (0.028)\teta 0:06:41\tloss 3.1321 (3.5603)\tacc 59.3750 (40.7812)\tlr 0.000003\n",
      "epoch: [57/60][30/404]\ttime 0.223 (0.242)\tdata 0.000 (0.019)\teta 0:06:23\tloss 3.6283 (3.5312)\tacc 34.3750 (41.6667)\tlr 0.000003\n",
      "epoch: [57/60][40/404]\ttime 0.222 (0.237)\tdata 0.000 (0.014)\teta 0:06:13\tloss 3.7048 (3.5236)\tacc 34.3750 (42.3438)\tlr 0.000003\n",
      "epoch: [57/60][50/404]\ttime 0.222 (0.234)\tdata 0.000 (0.011)\teta 0:06:06\tloss 3.2352 (3.5089)\tacc 56.2500 (43.2500)\tlr 0.000003\n",
      "epoch: [57/60][60/404]\ttime 0.223 (0.232)\tdata 0.000 (0.009)\teta 0:06:01\tloss 3.9450 (3.5263)\tacc 28.1250 (42.5521)\tlr 0.000003\n",
      "epoch: [57/60][70/404]\ttime 0.220 (0.231)\tdata 0.001 (0.008)\teta 0:05:56\tloss 3.2017 (3.5164)\tacc 56.2500 (43.1696)\tlr 0.000003\n",
      "epoch: [57/60][80/404]\ttime 0.221 (0.230)\tdata 0.000 (0.007)\teta 0:05:52\tloss 3.5657 (3.5084)\tacc 43.7500 (43.3594)\tlr 0.000003\n",
      "epoch: [57/60][90/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:05:49\tloss 3.5041 (3.4948)\tacc 43.7500 (43.4028)\tlr 0.000003\n",
      "epoch: [57/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.006)\teta 0:05:46\tloss 3.8119 (3.4993)\tacc 37.5000 (43.5312)\tlr 0.000003\n",
      "epoch: [57/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:05:43\tloss 3.4470 (3.4871)\tacc 46.8750 (43.8352)\tlr 0.000003\n",
      "epoch: [57/60][120/404]\ttime 0.225 (0.227)\tdata 0.000 (0.005)\teta 0:05:40\tloss 3.4770 (3.4800)\tacc 37.5000 (43.9062)\tlr 0.000003\n",
      "epoch: [57/60][130/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:05:37\tloss 3.4550 (3.4815)\tacc 46.8750 (43.7740)\tlr 0.000003\n",
      "epoch: [57/60][140/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:05:34\tloss 3.0632 (3.4803)\tacc 56.2500 (43.9955)\tlr 0.000003\n",
      "epoch: [57/60][150/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:05:31\tloss 3.8606 (3.4849)\tacc 31.2500 (43.7708)\tlr 0.000003\n",
      "epoch: [57/60][160/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:05:29\tloss 3.6806 (3.4776)\tacc 43.7500 (43.9453)\tlr 0.000003\n",
      "epoch: [57/60][170/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:05:26\tloss 3.6393 (3.4748)\tacc 37.5000 (44.0441)\tlr 0.000003\n",
      "epoch: [57/60][180/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:05:23\tloss 3.2071 (3.4775)\tacc 56.2500 (43.9757)\tlr 0.000003\n",
      "epoch: [57/60][190/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:05:21\tloss 3.4059 (3.4879)\tacc 37.5000 (43.6184)\tlr 0.000003\n",
      "epoch: [57/60][200/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:05:18\tloss 3.1082 (3.4844)\tacc 53.1250 (43.6250)\tlr 0.000003\n",
      "epoch: [57/60][210/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:05:16\tloss 3.7732 (3.4797)\tacc 34.3750 (43.8393)\tlr 0.000003\n",
      "epoch: [57/60][220/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:05:13\tloss 3.3169 (3.4743)\tacc 53.1250 (43.9631)\tlr 0.000003\n",
      "epoch: [57/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:05:11\tloss 3.3226 (3.4722)\tacc 53.1250 (43.9810)\tlr 0.000003\n",
      "epoch: [57/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:05:09\tloss 3.3953 (3.4714)\tacc 53.1250 (43.9974)\tlr 0.000003\n",
      "epoch: [57/60][250/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:05:06\tloss 3.3131 (3.4711)\tacc 43.7500 (43.9500)\tlr 0.000003\n",
      "epoch: [57/60][260/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:05:04\tloss 3.4049 (3.4722)\tacc 53.1250 (43.9663)\tlr 0.000003\n",
      "epoch: [57/60][270/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:05:01\tloss 3.3244 (3.4722)\tacc 53.1250 (44.0278)\tlr 0.000003\n",
      "epoch: [57/60][280/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:04:59\tloss 3.5304 (3.4748)\tacc 40.6250 (43.8504)\tlr 0.000003\n",
      "epoch: [57/60][290/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:04:57\tloss 3.4571 (3.4730)\tacc 34.3750 (43.8685)\tlr 0.000003\n",
      "epoch: [57/60][300/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:04:54\tloss 3.5609 (3.4730)\tacc 37.5000 (43.7812)\tlr 0.000003\n",
      "epoch: [57/60][310/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:04:52\tloss 3.3767 (3.4653)\tacc 50.0000 (43.9919)\tlr 0.000003\n",
      "epoch: [57/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:04:50\tloss 3.7251 (3.4621)\tacc 31.2500 (44.0918)\tlr 0.000003\n",
      "epoch: [57/60][330/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:04:47\tloss 3.1029 (3.4616)\tacc 50.0000 (44.1098)\tlr 0.000003\n",
      "epoch: [57/60][340/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:04:45\tloss 3.5969 (3.4638)\tacc 50.0000 (44.1085)\tlr 0.000003\n",
      "epoch: [57/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:04:43\tloss 3.2615 (3.4640)\tacc 53.1250 (44.1964)\tlr 0.000003\n",
      "epoch: [57/60][360/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:04:40\tloss 3.6474 (3.4671)\tacc 43.7500 (44.0538)\tlr 0.000003\n",
      "epoch: [57/60][370/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:04:38\tloss 3.1195 (3.4704)\tacc 50.0000 (43.9527)\tlr 0.000003\n",
      "epoch: [57/60][380/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:04:36\tloss 2.9143 (3.4688)\tacc 68.7500 (44.0543)\tlr 0.000003\n",
      "epoch: [57/60][390/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:04:34\tloss 3.8147 (3.4724)\tacc 34.3750 (44.0144)\tlr 0.000003\n",
      "epoch: [57/60][400/404]\ttime 0.217 (0.223)\tdata 0.000 (0.002)\teta 0:04:31\tloss 3.4221 (3.4714)\tacc 37.5000 (44.0078)\tlr 0.000003\n",
      "epoch: [58/60][10/404]\ttime 0.222 (0.285)\tdata 0.000 (0.052)\teta 0:05:42\tloss 3.8690 (3.5066)\tacc 43.7500 (45.9375)\tlr 0.000003\n",
      "epoch: [58/60][20/404]\ttime 0.223 (0.254)\tdata 0.000 (0.026)\teta 0:05:02\tloss 3.0855 (3.5178)\tacc 62.5000 (44.5312)\tlr 0.000003\n",
      "epoch: [58/60][30/404]\ttime 0.224 (0.243)\tdata 0.000 (0.017)\teta 0:04:47\tloss 3.3476 (3.4873)\tacc 50.0000 (44.8958)\tlr 0.000003\n",
      "epoch: [58/60][40/404]\ttime 0.221 (0.238)\tdata 0.000 (0.013)\teta 0:04:38\tloss 3.4591 (3.4866)\tacc 43.7500 (44.8438)\tlr 0.000003\n",
      "epoch: [58/60][50/404]\ttime 0.223 (0.235)\tdata 0.000 (0.011)\teta 0:04:32\tloss 3.7738 (3.4969)\tacc 40.6250 (44.4375)\tlr 0.000003\n",
      "epoch: [58/60][60/404]\ttime 0.224 (0.233)\tdata 0.000 (0.009)\teta 0:04:27\tloss 3.1734 (3.4788)\tacc 56.2500 (44.7396)\tlr 0.000003\n",
      "epoch: [58/60][70/404]\ttime 0.223 (0.231)\tdata 0.000 (0.008)\teta 0:04:23\tloss 3.5570 (3.4774)\tacc 43.7500 (44.5089)\tlr 0.000003\n",
      "epoch: [58/60][80/404]\ttime 0.223 (0.230)\tdata 0.000 (0.007)\teta 0:04:20\tloss 3.4434 (3.4718)\tacc 53.1250 (44.8438)\tlr 0.000003\n",
      "epoch: [58/60][90/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:04:17\tloss 3.3512 (3.4622)\tacc 53.1250 (45.1736)\tlr 0.000003\n",
      "epoch: [58/60][100/404]\ttime 0.224 (0.228)\tdata 0.000 (0.005)\teta 0:04:14\tloss 3.3910 (3.4642)\tacc 40.6250 (45.0938)\tlr 0.000003\n",
      "epoch: [58/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:04:11\tloss 3.4307 (3.4557)\tacc 50.0000 (45.1136)\tlr 0.000003\n",
      "epoch: [58/60][120/404]\ttime 0.219 (0.227)\tdata 0.000 (0.004)\teta 0:04:08\tloss 3.9328 (3.4663)\tacc 34.3750 (44.5052)\tlr 0.000003\n",
      "epoch: [58/60][130/404]\ttime 0.224 (0.227)\tdata 0.000 (0.004)\teta 0:04:05\tloss 3.5493 (3.4646)\tacc 43.7500 (44.5192)\tlr 0.000003\n",
      "epoch: [58/60][140/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:04:03\tloss 3.6200 (3.4648)\tacc 37.5000 (44.3527)\tlr 0.000003\n",
      "epoch: [58/60][150/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:04:00\tloss 3.7981 (3.4652)\tacc 34.3750 (44.2917)\tlr 0.000003\n",
      "epoch: [58/60][160/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:03:57\tloss 3.3193 (3.4679)\tacc 50.0000 (44.2383)\tlr 0.000003\n",
      "epoch: [58/60][170/404]\ttime 0.223 (0.226)\tdata 0.000 (0.003)\teta 0:03:55\tloss 3.4947 (3.4747)\tacc 53.1250 (44.0993)\tlr 0.000003\n",
      "epoch: [58/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:03:53\tloss 3.4925 (3.4773)\tacc 50.0000 (43.9757)\tlr 0.000003\n",
      "epoch: [58/60][190/404]\ttime 0.220 (0.226)\tdata 0.000 (0.003)\teta 0:03:50\tloss 3.5357 (3.4767)\tacc 43.7500 (44.1118)\tlr 0.000003\n",
      "epoch: [58/60][200/404]\ttime 0.220 (0.225)\tdata 0.000 (0.003)\teta 0:03:48\tloss 3.4325 (3.4767)\tacc 50.0000 (44.0469)\tlr 0.000003\n",
      "epoch: [58/60][210/404]\ttime 0.226 (0.225)\tdata 0.000 (0.003)\teta 0:03:45\tloss 3.2868 (3.4750)\tacc 50.0000 (44.1964)\tlr 0.000003\n",
      "epoch: [58/60][220/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:03:43\tloss 3.5371 (3.4782)\tacc 40.6250 (43.9347)\tlr 0.000003\n",
      "epoch: [58/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:03:41\tloss 3.3583 (3.4742)\tacc 50.0000 (44.0625)\tlr 0.000003\n",
      "epoch: [58/60][240/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:03:38\tloss 3.4008 (3.4779)\tacc 46.8750 (44.0104)\tlr 0.000003\n",
      "epoch: [58/60][250/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:03:36\tloss 3.8161 (3.4761)\tacc 31.2500 (44.0375)\tlr 0.000003\n",
      "epoch: [58/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:03:33\tloss 3.4956 (3.4749)\tacc 34.3750 (44.0745)\tlr 0.000003\n",
      "epoch: [58/60][270/404]\ttime 0.220 (0.225)\tdata 0.000 (0.002)\teta 0:03:31\tloss 3.9184 (3.4744)\tacc 28.1250 (44.1435)\tlr 0.000003\n",
      "epoch: [58/60][280/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:03:29\tloss 3.4507 (3.4749)\tacc 34.3750 (44.0513)\tlr 0.000003\n",
      "epoch: [58/60][290/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:03:27\tloss 3.2152 (3.4742)\tacc 56.2500 (44.0194)\tlr 0.000003\n",
      "epoch: [58/60][300/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:03:24\tloss 3.4280 (3.4729)\tacc 43.7500 (43.9792)\tlr 0.000003\n",
      "epoch: [58/60][310/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:03:22\tloss 3.2759 (3.4686)\tacc 46.8750 (44.1431)\tlr 0.000003\n",
      "epoch: [58/60][320/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:03:20\tloss 3.2767 (3.4727)\tacc 40.6250 (43.9062)\tlr 0.000003\n",
      "epoch: [58/60][330/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:03:17\tloss 3.6364 (3.4710)\tacc 50.0000 (44.0057)\tlr 0.000003\n",
      "epoch: [58/60][340/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:03:15\tloss 3.1762 (3.4688)\tacc 53.1250 (43.9982)\tlr 0.000003\n",
      "epoch: [58/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:03:13\tloss 3.5653 (3.4665)\tacc 43.7500 (44.1071)\tlr 0.000003\n",
      "epoch: [58/60][360/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:03:11\tloss 3.6193 (3.4682)\tacc 40.6250 (44.0191)\tlr 0.000003\n",
      "epoch: [58/60][370/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:03:08\tloss 3.4530 (3.4656)\tacc 40.6250 (44.0794)\tlr 0.000003\n",
      "epoch: [58/60][380/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:03:06\tloss 3.1792 (3.4675)\tacc 50.0000 (44.0214)\tlr 0.000003\n",
      "epoch: [58/60][390/404]\ttime 0.225 (0.224)\tdata 0.000 (0.001)\teta 0:03:04\tloss 3.3880 (3.4662)\tacc 34.3750 (44.1026)\tlr 0.000003\n",
      "epoch: [58/60][400/404]\ttime 0.217 (0.224)\tdata 0.000 (0.001)\teta 0:03:01\tloss 3.6824 (3.4672)\tacc 34.3750 (44.0234)\tlr 0.000003\n",
      "epoch: [59/60][10/404]\ttime 0.223 (0.278)\tdata 0.000 (0.056)\teta 0:03:42\tloss 3.1925 (3.3259)\tacc 43.7500 (46.2500)\tlr 0.000003\n",
      "epoch: [59/60][20/404]\ttime 0.222 (0.250)\tdata 0.000 (0.028)\teta 0:03:17\tloss 3.2262 (3.3342)\tacc 43.7500 (47.8125)\tlr 0.000003\n",
      "epoch: [59/60][30/404]\ttime 0.222 (0.245)\tdata 0.000 (0.019)\teta 0:03:10\tloss 3.2265 (3.4258)\tacc 53.1250 (44.8958)\tlr 0.000003\n",
      "epoch: [59/60][40/404]\ttime 0.222 (0.240)\tdata 0.000 (0.014)\teta 0:03:03\tloss 3.0071 (3.4019)\tacc 62.5000 (45.7812)\tlr 0.000003\n",
      "epoch: [59/60][50/404]\ttime 0.223 (0.236)\tdata 0.000 (0.011)\teta 0:02:58\tloss 3.2356 (3.4188)\tacc 56.2500 (44.9375)\tlr 0.000003\n",
      "epoch: [59/60][60/404]\ttime 0.222 (0.234)\tdata 0.000 (0.009)\teta 0:02:54\tloss 3.7770 (3.4296)\tacc 43.7500 (45.3125)\tlr 0.000003\n",
      "epoch: [59/60][70/404]\ttime 0.223 (0.232)\tdata 0.000 (0.008)\teta 0:02:51\tloss 3.1228 (3.4485)\tacc 62.5000 (45.1786)\tlr 0.000003\n",
      "epoch: [59/60][80/404]\ttime 0.221 (0.231)\tdata 0.000 (0.007)\teta 0:02:47\tloss 3.3287 (3.4374)\tacc 50.0000 (45.7812)\tlr 0.000003\n",
      "epoch: [59/60][90/404]\ttime 0.221 (0.230)\tdata 0.000 (0.006)\teta 0:02:44\tloss 3.6737 (3.4498)\tacc 31.2500 (45.2778)\tlr 0.000003\n",
      "epoch: [59/60][100/404]\ttime 0.221 (0.229)\tdata 0.000 (0.006)\teta 0:02:42\tloss 3.6353 (3.4621)\tacc 34.3750 (45.0938)\tlr 0.000003\n",
      "epoch: [59/60][110/404]\ttime 0.221 (0.228)\tdata 0.000 (0.005)\teta 0:02:39\tloss 3.3601 (3.4545)\tacc 46.8750 (45.3693)\tlr 0.000003\n",
      "epoch: [59/60][120/404]\ttime 0.221 (0.228)\tdata 0.000 (0.005)\teta 0:02:36\tloss 3.0792 (3.4549)\tacc 65.6250 (45.4688)\tlr 0.000003\n",
      "epoch: [59/60][130/404]\ttime 0.221 (0.227)\tdata 0.000 (0.004)\teta 0:02:34\tloss 3.4160 (3.4475)\tacc 46.8750 (45.5529)\tlr 0.000003\n",
      "epoch: [59/60][140/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:02:31\tloss 3.6620 (3.4426)\tacc 37.5000 (45.8482)\tlr 0.000003\n",
      "epoch: [59/60][150/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:02:29\tloss 3.5947 (3.4525)\tacc 28.1250 (45.2917)\tlr 0.000003\n",
      "epoch: [59/60][160/404]\ttime 0.222 (0.226)\tdata 0.000 (0.004)\teta 0:02:26\tloss 3.6258 (3.4501)\tacc 31.2500 (45.0195)\tlr 0.000003\n",
      "epoch: [59/60][170/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:02:24\tloss 3.2973 (3.4448)\tacc 43.7500 (45.1838)\tlr 0.000003\n",
      "epoch: [59/60][180/404]\ttime 0.221 (0.226)\tdata 0.000 (0.003)\teta 0:02:21\tloss 4.0541 (3.4469)\tacc 25.0000 (44.9479)\tlr 0.000003\n",
      "epoch: [59/60][190/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:02:19\tloss 3.5999 (3.4507)\tacc 37.5000 (44.8355)\tlr 0.000003\n",
      "epoch: [59/60][200/404]\ttime 0.225 (0.225)\tdata 0.000 (0.003)\teta 0:02:16\tloss 3.3620 (3.4463)\tacc 50.0000 (44.8594)\tlr 0.000003\n",
      "epoch: [59/60][210/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:02:14\tloss 3.2602 (3.4491)\tacc 53.1250 (44.6429)\tlr 0.000003\n",
      "epoch: [59/60][220/404]\ttime 0.223 (0.225)\tdata 0.000 (0.003)\teta 0:02:12\tloss 3.9237 (3.4463)\tacc 28.1250 (44.6591)\tlr 0.000003\n",
      "epoch: [59/60][230/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:02:10\tloss 3.4742 (3.4482)\tacc 46.8750 (44.6875)\tlr 0.000003\n",
      "epoch: [59/60][240/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:02:07\tloss 3.4169 (3.4484)\tacc 40.6250 (44.6094)\tlr 0.000003\n",
      "epoch: [59/60][250/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:02:05\tloss 3.4494 (3.4469)\tacc 31.2500 (44.5000)\tlr 0.000003\n",
      "epoch: [59/60][260/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:02:03\tloss 3.4675 (3.4498)\tacc 43.7500 (44.4591)\tlr 0.000003\n",
      "epoch: [59/60][270/404]\ttime 0.226 (0.224)\tdata 0.000 (0.002)\teta 0:02:00\tloss 3.3462 (3.4465)\tacc 43.7500 (44.6296)\tlr 0.000003\n",
      "epoch: [59/60][280/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:01:58\tloss 3.4515 (3.4451)\tacc 46.8750 (44.6763)\tlr 0.000003\n",
      "epoch: [59/60][290/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:56\tloss 3.9976 (3.4481)\tacc 28.1250 (44.5259)\tlr 0.000003\n",
      "epoch: [59/60][300/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:01:53\tloss 3.3441 (3.4494)\tacc 53.1250 (44.4375)\tlr 0.000003\n",
      "epoch: [59/60][310/404]\ttime 0.218 (0.224)\tdata 0.000 (0.002)\teta 0:01:51\tloss 3.4979 (3.4515)\tacc 37.5000 (44.4355)\tlr 0.000003\n",
      "epoch: [59/60][320/404]\ttime 0.219 (0.224)\tdata 0.000 (0.002)\teta 0:01:49\tloss 3.6316 (3.4489)\tacc 34.3750 (44.4629)\tlr 0.000003\n",
      "epoch: [59/60][330/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:47\tloss 3.4419 (3.4509)\tacc 50.0000 (44.4602)\tlr 0.000003\n",
      "epoch: [59/60][340/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:44\tloss 3.3949 (3.4508)\tacc 50.0000 (44.5588)\tlr 0.000003\n",
      "epoch: [59/60][350/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:42\tloss 3.5589 (3.4520)\tacc 43.7500 (44.4286)\tlr 0.000003\n",
      "epoch: [59/60][360/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:40\tloss 3.2117 (3.4549)\tacc 46.8750 (44.3142)\tlr 0.000003\n",
      "epoch: [59/60][370/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:01:37\tloss 3.6729 (3.4580)\tacc 46.8750 (44.2061)\tlr 0.000003\n",
      "epoch: [59/60][380/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:01:35\tloss 3.3348 (3.4610)\tacc 37.5000 (44.0789)\tlr 0.000003\n",
      "epoch: [59/60][390/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:01:33\tloss 3.3456 (3.4625)\tacc 46.8750 (44.0785)\tlr 0.000003\n",
      "epoch: [59/60][400/404]\ttime 0.217 (0.223)\tdata 0.000 (0.001)\teta 0:01:31\tloss 3.4137 (3.4665)\tacc 40.6250 (44.0391)\tlr 0.000003\n",
      "epoch: [60/60][10/404]\ttime 0.221 (0.282)\tdata 0.000 (0.052)\teta 0:01:50\tloss 3.2973 (3.5228)\tacc 46.8750 (42.8125)\tlr 0.000003\n",
      "epoch: [60/60][20/404]\ttime 0.221 (0.251)\tdata 0.000 (0.026)\teta 0:01:36\tloss 3.7276 (3.4534)\tacc 50.0000 (45.3125)\tlr 0.000003\n",
      "epoch: [60/60][30/404]\ttime 0.221 (0.242)\tdata 0.000 (0.017)\teta 0:01:30\tloss 3.4783 (3.4776)\tacc 43.7500 (44.6875)\tlr 0.000003\n",
      "epoch: [60/60][40/404]\ttime 0.221 (0.237)\tdata 0.000 (0.013)\teta 0:01:26\tloss 3.5148 (3.4844)\tacc 37.5000 (44.3750)\tlr 0.000003\n",
      "epoch: [60/60][50/404]\ttime 0.224 (0.234)\tdata 0.000 (0.011)\teta 0:01:22\tloss 3.3449 (3.4721)\tacc 53.1250 (44.5000)\tlr 0.000003\n",
      "epoch: [60/60][60/404]\ttime 0.222 (0.232)\tdata 0.000 (0.009)\teta 0:01:19\tloss 3.8147 (3.4692)\tacc 34.3750 (43.8542)\tlr 0.000003\n",
      "epoch: [60/60][70/404]\ttime 0.224 (0.231)\tdata 0.000 (0.008)\teta 0:01:17\tloss 3.4493 (3.4731)\tacc 46.8750 (44.1518)\tlr 0.000003\n",
      "epoch: [60/60][80/404]\ttime 0.221 (0.230)\tdata 0.000 (0.007)\teta 0:01:14\tloss 3.3843 (3.4681)\tacc 43.7500 (43.9453)\tlr 0.000003\n",
      "epoch: [60/60][90/404]\ttime 0.223 (0.229)\tdata 0.000 (0.006)\teta 0:01:11\tloss 3.0128 (3.4651)\tacc 59.3750 (44.1319)\tlr 0.000003\n",
      "epoch: [60/60][100/404]\ttime 0.223 (0.228)\tdata 0.000 (0.005)\teta 0:01:09\tloss 3.5115 (3.4710)\tacc 31.2500 (44.1250)\tlr 0.000003\n",
      "epoch: [60/60][110/404]\ttime 0.222 (0.228)\tdata 0.000 (0.005)\teta 0:01:06\tloss 3.3382 (3.4667)\tacc 43.7500 (44.3182)\tlr 0.000003\n",
      "epoch: [60/60][120/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:01:04\tloss 3.5850 (3.4675)\tacc 46.8750 (44.3490)\tlr 0.000003\n",
      "epoch: [60/60][130/404]\ttime 0.222 (0.227)\tdata 0.000 (0.004)\teta 0:01:02\tloss 3.5988 (3.4714)\tacc 50.0000 (44.2308)\tlr 0.000003\n",
      "epoch: [60/60][140/404]\ttime 0.228 (0.227)\tdata 0.000 (0.004)\teta 0:00:59\tloss 3.4792 (3.4676)\tacc 56.2500 (44.3527)\tlr 0.000003\n",
      "epoch: [60/60][150/404]\ttime 0.221 (0.226)\tdata 0.000 (0.004)\teta 0:00:57\tloss 3.3265 (3.4623)\tacc 59.3750 (44.5625)\tlr 0.000003\n",
      "epoch: [60/60][160/404]\ttime 0.224 (0.226)\tdata 0.000 (0.003)\teta 0:00:55\tloss 3.2080 (3.4697)\tacc 50.0000 (44.3555)\tlr 0.000003\n",
      "epoch: [60/60][170/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:00:52\tloss 3.4562 (3.4689)\tacc 37.5000 (44.2279)\tlr 0.000003\n",
      "epoch: [60/60][180/404]\ttime 0.222 (0.226)\tdata 0.000 (0.003)\teta 0:00:50\tloss 3.3263 (3.4620)\tacc 53.1250 (44.2535)\tlr 0.000003\n",
      "epoch: [60/60][190/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:00:48\tloss 3.5995 (3.4547)\tacc 40.6250 (44.4408)\tlr 0.000003\n",
      "epoch: [60/60][200/404]\ttime 0.222 (0.225)\tdata 0.000 (0.003)\teta 0:00:45\tloss 3.1551 (3.4519)\tacc 53.1250 (44.6406)\tlr 0.000003\n",
      "epoch: [60/60][210/404]\ttime 0.221 (0.225)\tdata 0.000 (0.003)\teta 0:00:43\tloss 3.6463 (3.4547)\tacc 28.1250 (44.5685)\tlr 0.000003\n",
      "epoch: [60/60][220/404]\ttime 0.224 (0.225)\tdata 0.000 (0.002)\teta 0:00:41\tloss 3.6253 (3.4498)\tacc 34.3750 (44.7727)\tlr 0.000003\n",
      "epoch: [60/60][230/404]\ttime 0.223 (0.225)\tdata 0.000 (0.002)\teta 0:00:39\tloss 3.4281 (3.4518)\tacc 50.0000 (44.7418)\tlr 0.000003\n",
      "epoch: [60/60][240/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:00:36\tloss 3.6341 (3.4570)\tacc 28.1250 (44.3750)\tlr 0.000003\n",
      "epoch: [60/60][250/404]\ttime 0.232 (0.225)\tdata 0.000 (0.002)\teta 0:00:34\tloss 3.7598 (3.4596)\tacc 31.2500 (44.2125)\tlr 0.000003\n",
      "epoch: [60/60][260/404]\ttime 0.225 (0.225)\tdata 0.000 (0.002)\teta 0:00:32\tloss 3.1648 (3.4584)\tacc 59.3750 (44.2548)\tlr 0.000003\n",
      "epoch: [60/60][270/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:00:30\tloss 3.2872 (3.4569)\tacc 50.0000 (44.3287)\tlr 0.000003\n",
      "epoch: [60/60][280/404]\ttime 0.222 (0.225)\tdata 0.000 (0.002)\teta 0:00:27\tloss 3.6550 (3.4632)\tacc 37.5000 (44.1406)\tlr 0.000003\n",
      "epoch: [60/60][290/404]\ttime 0.221 (0.225)\tdata 0.000 (0.002)\teta 0:00:25\tloss 3.5254 (3.4663)\tacc 50.0000 (44.1164)\tlr 0.000003\n",
      "epoch: [60/60][300/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:00:23\tloss 3.2587 (3.4653)\tacc 43.7500 (44.2188)\tlr 0.000003\n",
      "epoch: [60/60][310/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:00:21\tloss 3.1833 (3.4586)\tacc 59.3750 (44.4960)\tlr 0.000003\n",
      "epoch: [60/60][320/404]\ttime 0.222 (0.224)\tdata 0.000 (0.002)\teta 0:00:18\tloss 3.0026 (3.4586)\tacc 65.6250 (44.5605)\tlr 0.000003\n",
      "epoch: [60/60][330/404]\ttime 0.224 (0.224)\tdata 0.000 (0.002)\teta 0:00:16\tloss 3.5858 (3.4604)\tacc 37.5000 (44.5265)\tlr 0.000003\n",
      "epoch: [60/60][340/404]\ttime 0.225 (0.224)\tdata 0.000 (0.002)\teta 0:00:14\tloss 3.3706 (3.4578)\tacc 43.7500 (44.6875)\tlr 0.000003\n",
      "epoch: [60/60][350/404]\ttime 0.223 (0.224)\tdata 0.000 (0.002)\teta 0:00:12\tloss 3.8491 (3.4594)\tacc 37.5000 (44.5804)\tlr 0.000003\n",
      "epoch: [60/60][360/404]\ttime 0.221 (0.224)\tdata 0.000 (0.002)\teta 0:00:09\tloss 3.0041 (3.4578)\tacc 56.2500 (44.5833)\tlr 0.000003\n",
      "epoch: [60/60][370/404]\ttime 0.220 (0.224)\tdata 0.000 (0.002)\teta 0:00:07\tloss 3.2989 (3.4583)\tacc 43.7500 (44.5693)\tlr 0.000003\n",
      "epoch: [60/60][380/404]\ttime 0.224 (0.224)\tdata 0.000 (0.001)\teta 0:00:05\tloss 3.4791 (3.4619)\tacc 50.0000 (44.4984)\tlr 0.000003\n",
      "epoch: [60/60][390/404]\ttime 0.223 (0.224)\tdata 0.000 (0.001)\teta 0:00:03\tloss 3.0139 (3.4615)\tacc 46.8750 (44.4151)\tlr 0.000003\n",
      "epoch: [60/60][400/404]\ttime 0.219 (0.224)\tdata 0.000 (0.001)\teta 0:00:00\tloss 2.9207 (3.4619)\tacc 59.3750 (44.4141)\tlr 0.000003\n",
      "=> Final test\n",
      "##### Evaluating cv_data (target) #####\n",
      "Extracting features from query set ...\n",
      "Done, obtained 39-by-2048 matrix\n",
      "Extracting features from gallery set ...\n",
      "Done, obtained 180-by-2048 matrix\n",
      "Speed: 0.0108 sec/batch\n",
      "Computing distance matrix with metric=euclidean ...\n",
      "Computing CMC and mAP ...\n",
      "** Results **\n",
      "mAP: 42.9%\n",
      "CMC curve\n",
      "Rank-1  : 35.9%\n",
      "Rank-5  : 66.7%\n",
      "Rank-10 : 79.5%\n",
      "Rank-20 : 84.6%\n",
      "Checkpoint saved to \"log/test-softmax-market1501-cv-test/model/model.pth.tar-60\"\n",
      "Elapsed 0:46:13\n"
     ]
    }
   ],
   "source": [
    "engine.run(\n",
    "    save_dir='log/test-softmax-market1501-cv-test',\n",
    "    max_epoch=60,\n",
    "    eval_freq=10,\n",
    "    print_freq=10,\n",
    "    start_epoch = start_epoch\n",
    ")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "id": "paIw2ic2Uyox"
   },
   "source": [
    "This model performed with a mAP of 42.9% and has a Rank-1 and Rank-5 of 35.9% and 66.7% which is decent for Rank-5 performance. All features extracted from this model are found within the visrank_cvision_results directory"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "id": "iJM1jWMkVE7A"
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "accelerator": "GPU",
  "colab": {
   "authorship_tag": "ABX9TyOMrJi0lWNNCGRZWVgLNpWm",
   "collapsed_sections": [],
   "name": "person-reid.ipynb",
   "provenance": []
  },
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.8.5"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 1
}